Aug 01 19:45:04 user nova-compute[72504]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 01 19:45:07 user nova-compute[72504]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72504) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 01 19:45:07 user nova-compute[72504]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72504) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 01 19:45:07 user nova-compute[72504]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72504) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 01 19:45:07 user nova-compute[72504]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 01 19:45:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:45:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:45:07 user nova-compute[72504]: INFO nova.virt.driver [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 01 19:45:08 user nova-compute[72504]: INFO nova.compute.provider_config [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] Acquiring lock "singleton_lock" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] Acquired lock "singleton_lock" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] Releasing lock "singleton_lock" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] Full set of CONF: {{(pid=72504) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ******************************************************************************** {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] Configuration options gathered from: {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ================================================================================ {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] allow_resize_to_same_host      = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] arq_binding_timeout            = 300 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] backdoor_port                  = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] backdoor_socket                = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] block_device_allocate_retries  = 300 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] block_device_allocate_retries_interval = 5 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cert                           = self.pem {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] compute_monitors               = [] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] config_dir                     = [] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] config_drive_format            = iso9660 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] config_source                  = [] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] console_host                   = user {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] control_exchange               = nova {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cpu_allocation_ratio           = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] daemon                         = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] debug                          = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] default_access_ip_network_name = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] default_availability_zone      = nova {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] default_ephemeral_format       = ext4 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] default_schedule_zone          = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] disk_allocation_ratio          = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] enable_new_services            = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] enabled_ssl_apis               = [] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] flat_injected                  = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] force_config_drive             = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] force_raw_images               = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] graceful_shutdown_timeout      = 5 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] heal_instance_info_cache_interval = 60 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] host                           = user {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] instance_build_timeout         = 0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] instance_delete_interval       = 300 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] instance_name_template         = instance-%08x {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] instance_usage_audit           = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] instance_usage_audit_period    = month {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] internal_service_availability_zone = internal {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] key                            = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] live_migration_retry_count     = 30 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] log_config_append              = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] log_dir                        = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] log_file                       = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] log_options                    = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] log_rotate_interval            = 1 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] log_rotate_interval_type       = days {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] log_rotation_type              = none {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] long_rpc_timeout               = 1800 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] max_concurrent_builds          = 10 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] max_concurrent_live_migrations = 1 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] max_concurrent_snapshots       = 5 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] max_local_block_devices        = 3 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] max_logfile_count              = 30 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] max_logfile_size_mb            = 200 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] maximum_instance_delete_attempts = 5 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] metadata_listen                = 0.0.0.0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] metadata_listen_port           = 8775 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] metadata_workers               = 3 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] migrate_max_retries            = -1 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] mkisofs_cmd                    = genisoimage {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] my_ip                          = 10.0.0.210 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] network_allocate_retries       = 0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] osapi_compute_listen_port      = 8774 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] osapi_compute_unique_server_name_scope =  {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] osapi_compute_workers          = 3 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] password_length                = 12 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] periodic_enable                = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] periodic_fuzzy_delay           = 60 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] pointer_model                  = ps2mouse {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] preallocate_images             = none {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] publish_errors                 = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] pybasedir                      = /opt/stack/nova {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ram_allocation_ratio           = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] rate_limit_burst               = 0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] rate_limit_except_level        = CRITICAL {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] rate_limit_interval            = 0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] reboot_timeout                 = 0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] reclaim_instance_interval      = 0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] record                         = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] reimage_timeout_per_gb         = 60 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] report_interval                = 10 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] rescue_timeout                 = 0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] reserved_host_cpus             = 0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] reserved_host_disk_mb          = 0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] reserved_host_memory_mb        = 512 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] reserved_huge_pages            = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] resize_confirm_window          = 0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] resize_fs_using_block_device   = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] resume_guests_state_on_host_boot = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] rpc_response_timeout           = 60 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] run_external_periodic_tasks    = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] running_deleted_instance_action = reap {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] running_deleted_instance_timeout = 0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] scheduler_instance_sync_interval = 120 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] service_down_time              = 60 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] servicegroup_driver            = db {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] shelved_offload_time           = 0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] shelved_poll_interval          = 3600 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] shutdown_timeout               = 0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] source_is_ipv6                 = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ssl_only                       = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] state_path                     = /opt/stack/data/nova {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] sync_power_state_interval      = 600 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] sync_power_state_pool_size     = 1000 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] syslog_log_facility            = LOG_USER {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] tempdir                        = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] timeout_nbd                    = 10 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] transport_url                  = **** {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] update_resources_interval      = 0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] use_cow_images                 = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] use_eventlog                   = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] use_journal                    = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] use_json                       = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] use_rootwrap_daemon            = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] use_stderr                     = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] use_syslog                     = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vcpu_pin_set                   = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vif_plugging_is_fatal          = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vif_plugging_timeout           = 0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] virt_mkfs                      = [] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] volume_usage_poll_interval     = 0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] watch_log_file                 = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] web                            = /usr/share/spice-html5 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_concurrency.disable_process_locking = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api.auth_strategy              = keystone {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api.compute_link_prefix        = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api.dhcp_domain                = novalocal {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api.enable_instance_password   = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api.glance_link_prefix         = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api.instance_list_per_project_cells = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api.list_records_by_skipping_down_cells = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api.local_metadata_per_cell    = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api.max_limit                  = 1000 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api.metadata_cache_expiration  = 15 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api.neutron_default_tenant_id  = default {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api.use_forwarded_for          = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api.use_neutron_default_nets   = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api.vendordata_dynamic_targets = [] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api.vendordata_jsonfile_path   = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.backend_argument         = **** {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.config_prefix            = cache.oslo {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.dead_timeout             = 60.0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.debug_cache_backend      = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.enable_retry_client      = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.enable_socket_keepalive  = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.enabled                  = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.expiration_time          = 600 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.hashclient_retry_attempts = 2 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.memcache_dead_retry      = 300 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.memcache_password        =  {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.memcache_sasl_enabled    = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.memcache_username        =  {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.proxies                  = [] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.retry_attempts           = 2 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.retry_delay              = 0.0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.socket_keepalive_count   = 1 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.socket_keepalive_idle    = 1 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.socket_keepalive_interval = 1 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.tls_allowed_ciphers      = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.tls_cafile               = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.tls_certfile             = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.tls_enabled              = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cache.tls_keyfile              = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cinder.auth_section            = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cinder.auth_type               = password {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cinder.cafile                  = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cinder.certfile                = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cinder.collect_timing          = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cinder.cross_az_attach         = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cinder.debug                   = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cinder.endpoint_template       = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cinder.http_retries            = 3 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cinder.insecure                = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cinder.keyfile                 = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cinder.os_region_name          = RegionOne {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cinder.split_loggers           = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cinder.timeout                 = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] compute.cpu_dedicated_set      = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] compute.cpu_shared_set         = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] compute.image_type_exclude_list = [] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] compute.resource_provider_association_refresh = 300 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] compute.shutdown_retry_interval = 10 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] conductor.workers              = 3 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] console.allowed_origins        = [] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] console.ssl_ciphers            = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] console.ssl_minimum_version    = default {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] consoleauth.token_ttl          = 600 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cyborg.cafile                  = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cyborg.certfile                = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cyborg.collect_timing          = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cyborg.connect_retries         = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cyborg.connect_retry_delay     = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cyborg.endpoint_override       = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cyborg.insecure                = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cyborg.keyfile                 = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cyborg.max_version             = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cyborg.min_version             = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cyborg.region_name             = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cyborg.service_name            = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cyborg.service_type            = accelerator {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cyborg.split_loggers           = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cyborg.status_code_retries     = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cyborg.status_code_retry_delay = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cyborg.timeout                 = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] cyborg.version                 = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] database.backend               = sqlalchemy {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] database.connection            = **** {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] database.connection_debug      = 0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] database.connection_parameters =  {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] database.connection_recycle_time = 3600 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] database.connection_trace      = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] database.db_inc_retry_interval = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] database.db_max_retries        = 20 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] database.db_max_retry_interval = 10 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] database.db_retry_interval     = 1 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] database.max_overflow          = 50 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] database.max_pool_size         = 5 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] database.max_retries           = 10 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] database.mysql_enable_ndb      = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] database.mysql_wsrep_sync_wait = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] database.pool_timeout          = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] database.retry_interval        = 10 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] database.slave_connection      = **** {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] database.sqlite_synchronous    = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api_database.backend           = sqlalchemy {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api_database.connection        = **** {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api_database.connection_debug  = 0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api_database.connection_parameters =  {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api_database.connection_recycle_time = 3600 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api_database.connection_trace  = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api_database.db_inc_retry_interval = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api_database.db_max_retries    = 20 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api_database.db_max_retry_interval = 10 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api_database.db_retry_interval = 1 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api_database.max_overflow      = 50 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api_database.max_pool_size     = 5 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api_database.max_retries       = 10 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api_database.mysql_enable_ndb  = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api_database.pool_timeout      = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api_database.retry_interval    = 10 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api_database.slave_connection  = **** {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] api_database.sqlite_synchronous = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] devices.enabled_mdev_types     = [] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ephemeral_storage_encryption.enabled = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.api_servers             = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.cafile                  = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.certfile                = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.collect_timing          = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.connect_retries         = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.connect_retry_delay     = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.debug                   = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.default_trusted_certificate_ids = [] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.enable_certificate_validation = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.enable_rbd_download     = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.endpoint_override       = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.insecure                = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.keyfile                 = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.max_version             = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.min_version             = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.num_retries             = 3 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.rbd_ceph_conf           =  {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.rbd_connect_timeout     = 5 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.rbd_pool                =  {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.rbd_user                =  {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.region_name             = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.service_name            = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.service_type            = image {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.split_loggers           = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.status_code_retries     = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.status_code_retry_delay = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.timeout                 = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.verify_glance_signatures = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] glance.version                 = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] guestfs.debug                  = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] hyperv.config_drive_cdrom      = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] hyperv.config_drive_inject_password = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] hyperv.enable_remotefx         = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] hyperv.instances_path_share    =  {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] hyperv.limit_cpu_features      = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] hyperv.use_multipath_io        = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] hyperv.vswitch_name            = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] mks.enabled                    = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] image_cache.manager_interval   = 2400 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] image_cache.precache_concurrency = 1 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] image_cache.remove_unused_base_images = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] image_cache.subdirectory_name  = _base {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ironic.api_max_retries         = 60 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ironic.api_retry_interval      = 2 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ironic.auth_section            = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ironic.auth_type               = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ironic.cafile                  = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ironic.certfile                = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ironic.collect_timing          = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ironic.connect_retries         = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ironic.connect_retry_delay     = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ironic.endpoint_override       = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ironic.insecure                = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ironic.keyfile                 = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ironic.max_version             = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ironic.min_version             = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ironic.partition_key           = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ironic.peer_list               = [] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ironic.region_name             = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ironic.serial_console_state_timeout = 10 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ironic.service_name            = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ironic.service_type            = baremetal {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ironic.split_loggers           = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ironic.status_code_retries     = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ironic.status_code_retry_delay = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ironic.timeout                 = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ironic.version                 = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] key_manager.fixed_key          = **** {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] barbican.barbican_api_version  = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] barbican.barbican_endpoint     = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] barbican.barbican_endpoint_type = public {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] barbican.barbican_region_name  = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] barbican.cafile                = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] barbican.certfile              = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] barbican.collect_timing        = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] barbican.insecure              = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] barbican.keyfile               = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] barbican.number_of_retries     = 60 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] barbican.retry_delay           = 1 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] barbican.send_service_user_token = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] barbican.split_loggers         = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] barbican.timeout               = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] barbican.verify_ssl            = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] barbican.verify_ssl_path       = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] barbican_service_user.auth_section = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] barbican_service_user.auth_type = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] barbican_service_user.cafile   = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] barbican_service_user.certfile = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] barbican_service_user.collect_timing = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] barbican_service_user.insecure = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] barbican_service_user.keyfile  = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] barbican_service_user.split_loggers = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] barbican_service_user.timeout  = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vault.approle_role_id          = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vault.approle_secret_id        = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vault.cafile                   = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vault.certfile                 = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vault.collect_timing           = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vault.insecure                 = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vault.keyfile                  = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vault.kv_mountpoint            = secret {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vault.kv_version               = 2 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vault.namespace                = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vault.root_token_id            = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vault.split_loggers            = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vault.ssl_ca_crt_file          = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vault.timeout                  = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vault.use_ssl                  = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] keystone.cafile                = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] keystone.certfile              = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] keystone.collect_timing        = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] keystone.connect_retries       = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] keystone.connect_retry_delay   = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] keystone.endpoint_override     = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] keystone.insecure              = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] keystone.keyfile               = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] keystone.max_version           = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] keystone.min_version           = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] keystone.region_name           = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] keystone.service_name          = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] keystone.service_type          = identity {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] keystone.split_loggers         = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] keystone.status_code_retries   = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] keystone.status_code_retry_delay = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] keystone.timeout               = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] keystone.version               = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.connection_uri         =  {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.cpu_mode               = custom {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: WARNING oslo_config.cfg [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.cpu_power_governor_high = performance {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.cpu_power_management   = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.device_detach_attempts = 8 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.device_detach_timeout  = 20 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.disk_cachemodes        = [] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.disk_prefix            = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.enabled_perf_events    = [] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.file_backed_memory     = 0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.gid_maps               = [] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.hw_disk_discard        = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.hw_machine_type        = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.images_rbd_pool        = rbd {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.images_type            = default {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.images_volume_group    = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.inject_key             = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.inject_partition       = -2 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.inject_password        = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.iscsi_iface            = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.iser_use_multipath     = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.live_migration_downtime = 500 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.live_migration_inbound_addr = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.live_migration_scheme  = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.live_migration_timeout_action = abort {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.live_migration_tunnelled = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: WARNING oslo_config.cfg [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 01 19:45:08 user nova-compute[72504]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 01 19:45:08 user nova-compute[72504]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 01 19:45:08 user nova-compute[72504]: and ``live_migration_inbound_addr`` respectively.
Aug 01 19:45:08 user nova-compute[72504]: ).  Its value may be silently ignored in the future.
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.live_migration_with_native_tls = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.max_queues             = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.nfs_mount_options      = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.num_pcie_ports         = 0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.pmem_namespaces        = [] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.quobyte_client_cfg     = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.rbd_secret_uuid        = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.rbd_user               = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.rescue_image_id        = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.rescue_kernel_id       = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.rx_queue_size          = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.smbfs_mount_options    =  {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.snapshot_compression   = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.snapshot_image_format  = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.sparse_logical_volumes = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.swtpm_enabled          = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.swtpm_group            = tss {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.swtpm_user             = tss {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.sysinfo_serial         = unique {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.tb_cache_size          = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.tx_queue_size          = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.uid_maps               = [] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.use_virtio_for_bridges = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.virt_type              = kvm {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.volume_clear           = zero {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.volume_clear_size      = 0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.volume_use_multipath   = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.vzstorage_cache_path   = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] neutron.auth_section           = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] neutron.auth_type              = password {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] neutron.cafile                 = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] neutron.certfile               = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] neutron.collect_timing         = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] neutron.connect_retries        = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] neutron.connect_retry_delay    = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] neutron.default_floating_pool  = public {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] neutron.endpoint_override      = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] neutron.extension_sync_interval = 600 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] neutron.http_retries           = 3 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] neutron.insecure               = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] neutron.keyfile                = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] neutron.max_version            = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] neutron.min_version            = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] neutron.ovs_bridge             = br-int {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] neutron.physnets               = [] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] neutron.region_name            = RegionOne {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] neutron.service_metadata_proxy = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] neutron.service_name           = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] neutron.service_type           = network {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] neutron.split_loggers          = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] neutron.status_code_retries    = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] neutron.status_code_retry_delay = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] neutron.timeout                = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] neutron.version                = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] notifications.bdms_in_notifications = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] notifications.default_level    = INFO {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] notifications.notification_format = unversioned {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] notifications.notify_on_state_change = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] pci.alias                      = [] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] pci.device_spec                = [] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] pci.report_in_placement        = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.auth_section         = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.auth_type            = password {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.cafile               = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.certfile             = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.collect_timing       = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.connect_retries      = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.connect_retry_delay  = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.default_domain_id    = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.default_domain_name  = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.domain_id            = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.domain_name          = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.endpoint_override    = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.insecure             = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.keyfile              = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.max_version          = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.min_version          = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.password             = **** {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.project_domain_id    = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.project_domain_name  = Default {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.project_id           = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.project_name         = service {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.region_name          = RegionOne {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.service_name         = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.service_type         = placement {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.split_loggers        = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.status_code_retries  = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.status_code_retry_delay = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.system_scope         = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.timeout              = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.trust_id             = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.user_domain_id       = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.user_domain_name     = Default {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.user_id              = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.username             = placement {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] placement.version              = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] quota.cores                    = 20 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] quota.count_usage_from_placement = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] quota.injected_file_content_bytes = 10240 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] quota.injected_file_path_length = 255 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] quota.injected_files           = 5 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] quota.instances                = 10 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] quota.key_pairs                = 100 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] quota.metadata_items           = 128 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] quota.ram                      = 51200 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] quota.recheck_quota            = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] quota.server_group_members     = 10 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] quota.server_groups            = 10 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] rdp.enabled                    = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] scheduler.image_metadata_prefilter = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] scheduler.max_attempts         = 3 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] scheduler.max_placement_results = 1000 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] scheduler.workers              = 3 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] filter_scheduler.host_subset_size = 1 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] filter_scheduler.isolated_hosts = [] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] filter_scheduler.isolated_images = [] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] filter_scheduler.pci_in_placement = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] filter_scheduler.track_instance_changes = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] metrics.required               = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] metrics.weight_multiplier      = 1.0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] metrics.weight_setting         = [] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] serial_console.enabled         = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] serial_console.port_range      = 10000:20000 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] serial_console.serialproxy_port = 6083 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] service_user.auth_section      = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] service_user.auth_type         = password {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] service_user.cafile            = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] service_user.certfile          = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] service_user.collect_timing    = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] service_user.insecure          = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] service_user.keyfile           = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] service_user.send_service_user_token = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] service_user.split_loggers     = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] service_user.timeout           = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] spice.agent_enabled            = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] spice.enabled                  = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] spice.html5proxy_port          = 6082 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] spice.image_compression        = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] spice.jpeg_compression         = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] spice.playback_compression     = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] spice.server_listen            = 127.0.0.1 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] spice.streaming_mode           = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] spice.zlib_compression         = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] upgrade_levels.baseapi         = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] upgrade_levels.cert            = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] upgrade_levels.compute         = auto {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] upgrade_levels.conductor       = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] upgrade_levels.scheduler       = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vendordata_dynamic_auth.cafile = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vendordata_dynamic_auth.certfile = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vendordata_dynamic_auth.insecure = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vendordata_dynamic_auth.timeout = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vmware.api_retry_count         = 10 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vmware.ca_file                 = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vmware.cache_prefix            = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vmware.cluster_name            = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vmware.connection_pool_size    = 10 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vmware.console_delay_seconds   = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vmware.datastore_regex         = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vmware.host_ip                 = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vmware.host_password           = **** {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vmware.host_port               = 443 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vmware.host_username           = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vmware.insecure                = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vmware.integration_bridge      = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vmware.maximum_objects         = 100 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vmware.pbm_default_policy      = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vmware.pbm_enabled             = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vmware.pbm_wsdl_location       = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vmware.serial_port_proxy_uri   = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vmware.serial_port_service_uri = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vmware.task_poll_interval      = 0.5 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vmware.use_linked_clone        = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vmware.vnc_keymap              = en-us {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vmware.vnc_port                = 5900 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vmware.vnc_port_total          = 10000 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vnc.auth_schemes               = ['none'] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vnc.enabled                    = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vnc.novncproxy_port            = 6080 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vnc.vencrypt_ca_certs          = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vnc.vencrypt_client_cert       = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vnc.vencrypt_client_key        = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] workarounds.disable_rootwrap   = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] workarounds.enable_numa_live_migration = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] workarounds.libvirt_disable_apic = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] wsgi.client_socket_timeout     = 900 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] wsgi.default_pool_size         = 1000 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] wsgi.keep_alive                = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] wsgi.max_header_line           = 16384 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] wsgi.ssl_ca_file               = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] wsgi.ssl_cert_file             = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] wsgi.ssl_key_file              = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] wsgi.tcp_keepidle              = 600 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] zvm.ca_file                    = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] zvm.cloud_connector_url        = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] zvm.reachable_timeout          = 300 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_policy.enforce_new_defaults = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_policy.enforce_scope      = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_policy.policy_default_rule = default {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] profiler.connection_string     = messaging:// {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] profiler.enabled               = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] profiler.es_doc_type           = notification {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] profiler.es_scroll_size        = 10000 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] profiler.es_scroll_time        = 2m {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] profiler.filter_error_trace    = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] profiler.hmac_keys             = **** {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] profiler.sentinel_service_name = mymaster {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] profiler.socket_timeout        = 0.1 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] profiler.trace_requests        = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] profiler.trace_sqlalchemy      = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] profiler_jaeger.process_tags   = {} {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] profiler_jaeger.service_name_prefix = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] profiler_otlp.service_name_prefix = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] remote_debug.host              = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] remote_debug.port              = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_notifications.retry = -1 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_limit.auth_section        = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_limit.auth_type           = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_limit.cafile              = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_limit.certfile            = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_limit.collect_timing      = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_limit.connect_retries     = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_limit.connect_retry_delay = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_limit.endpoint_id         = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_limit.endpoint_override   = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_limit.insecure            = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_limit.keyfile             = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_limit.max_version         = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_limit.min_version         = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_limit.region_name         = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_limit.service_name        = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_limit.service_type        = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_limit.split_loggers       = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_limit.status_code_retries = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_limit.status_code_retry_delay = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_limit.timeout             = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_limit.valid_interfaces    = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_limit.version             = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_reports.file_event_handler = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] oslo_reports.log_dir           = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vif_plug_ovs_privileged.group  = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] vif_plug_ovs_privileged.user   = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] os_vif_ovs.isolate_vif         = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] os_brick.lock_path             = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] privsep_osbrick.capabilities   = [21] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] privsep_osbrick.group          = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] privsep_osbrick.helper_command = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] privsep_osbrick.user           = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] nova_sys_admin.group           = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] nova_sys_admin.helper_command  = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] nova_sys_admin.user            = None {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG oslo_service.service [None req-ce4a200c-8193-4d08-9884-ef5e6a79a027 None None] ******************************************************************************** {{(pid=72504) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Aug 01 19:45:08 user nova-compute[72504]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 01 19:45:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Starting native event thread {{(pid=72504) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Starting green dispatch thread {{(pid=72504) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Starting connection event dispatch thread {{(pid=72504) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Connecting to libvirt: qemu:///system {{(pid=72504) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7ff4168f4a30> {{(pid=72504) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 01 19:45:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7ff4168f4a30> {{(pid=72504) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 01 19:45:08 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Connection event '1' reason 'None'
Aug 01 19:45:08 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 01 19:45:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.mount [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Initialising _HostMountState generation 0 {{(pid=72504) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 01 19:45:16 user nova-compute[72504]: INFO nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Libvirt host capabilities <capabilities>
Aug 01 19:45:16 user nova-compute[72504]:   <host>
Aug 01 19:45:16 user nova-compute[72504]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 01 19:45:16 user nova-compute[72504]:     <cpu>
Aug 01 19:45:16 user nova-compute[72504]:       <arch>x86_64</arch>
Aug 01 19:45:16 user nova-compute[72504]:       <model>IvyBridge-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <vendor>Intel</vendor>
Aug 01 19:45:16 user nova-compute[72504]:       <microcode version='1070'/>
Aug 01 19:45:16 user nova-compute[72504]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 01 19:45:16 user nova-compute[72504]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature name='ss'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature name='vmx'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature name='pcid'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature name='osxsave'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature name='hypervisor'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature name='arat'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature name='tsc_adjust'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature name='md-clear'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature name='stibp'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature name='arch-capabilities'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature name='ssbd'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature name='invtsc'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature name='rsba'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature name='skip-l1dfl-vmentry'/>
Aug 01 19:45:16 user nova-compute[72504]:       <pages unit='KiB' size='4'/>
Aug 01 19:45:16 user nova-compute[72504]:       <pages unit='KiB' size='2048'/>
Aug 01 19:45:16 user nova-compute[72504]:     </cpu>
Aug 01 19:45:16 user nova-compute[72504]:     <power_management>
Aug 01 19:45:16 user nova-compute[72504]:       <suspend_mem/>
Aug 01 19:45:16 user nova-compute[72504]:       <suspend_disk/>
Aug 01 19:45:16 user nova-compute[72504]:       <suspend_hybrid/>
Aug 01 19:45:16 user nova-compute[72504]:     </power_management>
Aug 01 19:45:16 user nova-compute[72504]:     <iommu support='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     <migration_features>
Aug 01 19:45:16 user nova-compute[72504]:       <live/>
Aug 01 19:45:16 user nova-compute[72504]:       <uri_transports>
Aug 01 19:45:16 user nova-compute[72504]:         <uri_transport>tcp</uri_transport>
Aug 01 19:45:16 user nova-compute[72504]:         <uri_transport>rdma</uri_transport>
Aug 01 19:45:16 user nova-compute[72504]:       </uri_transports>
Aug 01 19:45:16 user nova-compute[72504]:     </migration_features>
Aug 01 19:45:16 user nova-compute[72504]:     <topology>
Aug 01 19:45:16 user nova-compute[72504]:       <cells num='2'>
Aug 01 19:45:16 user nova-compute[72504]:         <cell id='0'>
Aug 01 19:45:16 user nova-compute[72504]:           <memory unit='KiB'>8189224</memory>
Aug 01 19:45:16 user nova-compute[72504]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 01 19:45:16 user nova-compute[72504]:           <pages unit='KiB' size='2048'>0</pages>
Aug 01 19:45:16 user nova-compute[72504]:           <distances>
Aug 01 19:45:16 user nova-compute[72504]:             <sibling id='0' value='10'/>
Aug 01 19:45:16 user nova-compute[72504]:             <sibling id='1' value='20'/>
Aug 01 19:45:16 user nova-compute[72504]:           </distances>
Aug 01 19:45:16 user nova-compute[72504]:           <cpus num='6'>
Aug 01 19:45:16 user nova-compute[72504]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 01 19:45:16 user nova-compute[72504]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 01 19:45:16 user nova-compute[72504]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 01 19:45:16 user nova-compute[72504]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 01 19:45:16 user nova-compute[72504]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 01 19:45:16 user nova-compute[72504]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 01 19:45:16 user nova-compute[72504]:           </cpus>
Aug 01 19:45:16 user nova-compute[72504]:         </cell>
Aug 01 19:45:16 user nova-compute[72504]:         <cell id='1'>
Aug 01 19:45:16 user nova-compute[72504]:           <memory unit='KiB'>8206460</memory>
Aug 01 19:45:16 user nova-compute[72504]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 01 19:45:16 user nova-compute[72504]:           <pages unit='KiB' size='2048'>0</pages>
Aug 01 19:45:16 user nova-compute[72504]:           <distances>
Aug 01 19:45:16 user nova-compute[72504]:             <sibling id='0' value='20'/>
Aug 01 19:45:16 user nova-compute[72504]:             <sibling id='1' value='10'/>
Aug 01 19:45:16 user nova-compute[72504]:           </distances>
Aug 01 19:45:16 user nova-compute[72504]:           <cpus num='6'>
Aug 01 19:45:16 user nova-compute[72504]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 01 19:45:16 user nova-compute[72504]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 01 19:45:16 user nova-compute[72504]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 01 19:45:16 user nova-compute[72504]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 01 19:45:16 user nova-compute[72504]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 01 19:45:16 user nova-compute[72504]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 01 19:45:16 user nova-compute[72504]:           </cpus>
Aug 01 19:45:16 user nova-compute[72504]:         </cell>
Aug 01 19:45:16 user nova-compute[72504]:       </cells>
Aug 01 19:45:16 user nova-compute[72504]:     </topology>
Aug 01 19:45:16 user nova-compute[72504]:     <cache>
Aug 01 19:45:16 user nova-compute[72504]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 01 19:45:16 user nova-compute[72504]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 01 19:45:16 user nova-compute[72504]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 01 19:45:16 user nova-compute[72504]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 01 19:45:16 user nova-compute[72504]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 01 19:45:16 user nova-compute[72504]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 01 19:45:16 user nova-compute[72504]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 01 19:45:16 user nova-compute[72504]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 01 19:45:16 user nova-compute[72504]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 01 19:45:16 user nova-compute[72504]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 01 19:45:16 user nova-compute[72504]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 01 19:45:16 user nova-compute[72504]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 01 19:45:16 user nova-compute[72504]:     </cache>
Aug 01 19:45:16 user nova-compute[72504]:     <secmodel>
Aug 01 19:45:16 user nova-compute[72504]:       <model>apparmor</model>
Aug 01 19:45:16 user nova-compute[72504]:       <doi>0</doi>
Aug 01 19:45:16 user nova-compute[72504]:     </secmodel>
Aug 01 19:45:16 user nova-compute[72504]:     <secmodel>
Aug 01 19:45:16 user nova-compute[72504]:       <model>dac</model>
Aug 01 19:45:16 user nova-compute[72504]:       <doi>0</doi>
Aug 01 19:45:16 user nova-compute[72504]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 01 19:45:16 user nova-compute[72504]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 01 19:45:16 user nova-compute[72504]:     </secmodel>
Aug 01 19:45:16 user nova-compute[72504]:   </host>
Aug 01 19:45:16 user nova-compute[72504]:   <guest>
Aug 01 19:45:16 user nova-compute[72504]:     <os_type>hvm</os_type>
Aug 01 19:45:16 user nova-compute[72504]:     <arch name='alpha'>
Aug 01 19:45:16 user nova-compute[72504]:       <wordsize>64</wordsize>
Aug 01 19:45:16 user nova-compute[72504]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>clipper</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <domain type='qemu'/>
Aug 01 19:45:16 user nova-compute[72504]:     </arch>
Aug 01 19:45:16 user nova-compute[72504]:     <features>
Aug 01 19:45:16 user nova-compute[72504]:       <cpuselection/>
Aug 01 19:45:16 user nova-compute[72504]:       <deviceboot/>
Aug 01 19:45:16 user nova-compute[72504]:       <disksnapshot default='on' toggle='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     </features>
Aug 01 19:45:16 user nova-compute[72504]:   </guest>
Aug 01 19:45:16 user nova-compute[72504]:   <guest>
Aug 01 19:45:16 user nova-compute[72504]:     <os_type>hvm</os_type>
Aug 01 19:45:16 user nova-compute[72504]:     <arch name='armv6l'>
Aug 01 19:45:16 user nova-compute[72504]:       <wordsize>32</wordsize>
Aug 01 19:45:16 user nova-compute[72504]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>integratorcp</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>borzoi</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>spitz</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>nuri</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>musca-b1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>versatileab</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>kzm</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>musca-a</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>smdkc210</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>sx1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>z2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>tosa</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>sabrelite</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>realview-eb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>n810</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>n800</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>versatilepb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>terrier</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mainstone</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>midway</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>musicpal</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>microbit</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>cubieboard</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>verdex</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>netduino2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>raspi2b</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>cheetah</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>highbank</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>akita</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>connex</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>collie</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>raspi0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <domain type='qemu'/>
Aug 01 19:45:16 user nova-compute[72504]:     </arch>
Aug 01 19:45:16 user nova-compute[72504]:     <features>
Aug 01 19:45:16 user nova-compute[72504]:       <cpuselection/>
Aug 01 19:45:16 user nova-compute[72504]:       <deviceboot/>
Aug 01 19:45:16 user nova-compute[72504]:       <disksnapshot default='on' toggle='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     </features>
Aug 01 19:45:16 user nova-compute[72504]:   </guest>
Aug 01 19:45:16 user nova-compute[72504]:   <guest>
Aug 01 19:45:16 user nova-compute[72504]:     <os_type>hvm</os_type>
Aug 01 19:45:16 user nova-compute[72504]:     <arch name='armv7l'>
Aug 01 19:45:16 user nova-compute[72504]:       <wordsize>32</wordsize>
Aug 01 19:45:16 user nova-compute[72504]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>integratorcp</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>borzoi</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>spitz</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>nuri</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>musca-b1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>versatileab</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>kzm</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>musca-a</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>smdkc210</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>sx1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>z2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>tosa</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>sabrelite</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>realview-eb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>n810</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>n800</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>versatilepb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>terrier</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mainstone</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>midway</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>musicpal</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>microbit</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>cubieboard</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>verdex</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>netduino2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>raspi2b</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>cheetah</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>highbank</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>akita</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>connex</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>collie</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>raspi0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <domain type='qemu'/>
Aug 01 19:45:16 user nova-compute[72504]:     </arch>
Aug 01 19:45:16 user nova-compute[72504]:     <features>
Aug 01 19:45:16 user nova-compute[72504]:       <cpuselection/>
Aug 01 19:45:16 user nova-compute[72504]:       <deviceboot/>
Aug 01 19:45:16 user nova-compute[72504]:       <disksnapshot default='on' toggle='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     </features>
Aug 01 19:45:16 user nova-compute[72504]:   </guest>
Aug 01 19:45:16 user nova-compute[72504]:   <guest>
Aug 01 19:45:16 user nova-compute[72504]:     <os_type>hvm</os_type>
Aug 01 19:45:16 user nova-compute[72504]:     <arch name='aarch64'>
Aug 01 19:45:16 user nova-compute[72504]:       <wordsize>64</wordsize>
Aug 01 19:45:16 user nova-compute[72504]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>integratorcp</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>borzoi</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>spitz</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>nuri</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>musca-b1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>versatileab</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>kzm</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>musca-a</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>smdkc210</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>sx1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>z2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>tosa</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>sabrelite</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>realview-eb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>n810</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>n800</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>versatilepb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>terrier</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mainstone</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>midway</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>musicpal</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>microbit</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>cubieboard</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>verdex</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>netduino2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>raspi3b</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>raspi2b</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>cheetah</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>highbank</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>akita</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>connex</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>collie</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>raspi0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <domain type='qemu'/>
Aug 01 19:45:16 user nova-compute[72504]:     </arch>
Aug 01 19:45:16 user nova-compute[72504]:     <features>
Aug 01 19:45:16 user nova-compute[72504]:       <acpi default='on' toggle='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:       <cpuselection/>
Aug 01 19:45:16 user nova-compute[72504]:       <deviceboot/>
Aug 01 19:45:16 user nova-compute[72504]:       <disksnapshot default='on' toggle='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     </features>
Aug 01 19:45:16 user nova-compute[72504]:   </guest>
Aug 01 19:45:16 user nova-compute[72504]:   <guest>
Aug 01 19:45:16 user nova-compute[72504]:     <os_type>hvm</os_type>
Aug 01 19:45:16 user nova-compute[72504]:     <arch name='cris'>
Aug 01 19:45:16 user nova-compute[72504]:       <wordsize>32</wordsize>
Aug 01 19:45:16 user nova-compute[72504]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <domain type='qemu'/>
Aug 01 19:45:16 user nova-compute[72504]:     </arch>
Aug 01 19:45:16 user nova-compute[72504]:     <features>
Aug 01 19:45:16 user nova-compute[72504]:       <cpuselection/>
Aug 01 19:45:16 user nova-compute[72504]:       <deviceboot/>
Aug 01 19:45:16 user nova-compute[72504]:       <disksnapshot default='on' toggle='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     </features>
Aug 01 19:45:16 user nova-compute[72504]:   </guest>
Aug 01 19:45:16 user nova-compute[72504]:   <guest>
Aug 01 19:45:16 user nova-compute[72504]:     <os_type>hvm</os_type>
Aug 01 19:45:16 user nova-compute[72504]:     <arch name='i686'>
Aug 01 19:45:16 user nova-compute[72504]:       <wordsize>32</wordsize>
Aug 01 19:45:16 user nova-compute[72504]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>x-remote</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>isapc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>microvm</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <domain type='qemu'/>
Aug 01 19:45:16 user nova-compute[72504]:       <domain type='kvm'/>
Aug 01 19:45:16 user nova-compute[72504]:     </arch>
Aug 01 19:45:16 user nova-compute[72504]:     <features>
Aug 01 19:45:16 user nova-compute[72504]:       <pae/>
Aug 01 19:45:16 user nova-compute[72504]:       <nonpae/>
Aug 01 19:45:16 user nova-compute[72504]:       <acpi default='on' toggle='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:       <apic default='on' toggle='no'/>
Aug 01 19:45:16 user nova-compute[72504]:       <cpuselection/>
Aug 01 19:45:16 user nova-compute[72504]:       <deviceboot/>
Aug 01 19:45:16 user nova-compute[72504]:       <disksnapshot default='on' toggle='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     </features>
Aug 01 19:45:16 user nova-compute[72504]:   </guest>
Aug 01 19:45:16 user nova-compute[72504]:   <guest>
Aug 01 19:45:16 user nova-compute[72504]:     <os_type>hvm</os_type>
Aug 01 19:45:16 user nova-compute[72504]:     <arch name='m68k'>
Aug 01 19:45:16 user nova-compute[72504]:       <wordsize>32</wordsize>
Aug 01 19:45:16 user nova-compute[72504]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>an5206</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>q800</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>next-cube</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <domain type='qemu'/>
Aug 01 19:45:16 user nova-compute[72504]:     </arch>
Aug 01 19:45:16 user nova-compute[72504]:     <features>
Aug 01 19:45:16 user nova-compute[72504]:       <cpuselection/>
Aug 01 19:45:16 user nova-compute[72504]:       <deviceboot/>
Aug 01 19:45:16 user nova-compute[72504]:       <disksnapshot default='on' toggle='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     </features>
Aug 01 19:45:16 user nova-compute[72504]:   </guest>
Aug 01 19:45:16 user nova-compute[72504]:   <guest>
Aug 01 19:45:16 user nova-compute[72504]:     <os_type>hvm</os_type>
Aug 01 19:45:16 user nova-compute[72504]:     <arch name='microblaze'>
Aug 01 19:45:16 user nova-compute[72504]:       <wordsize>32</wordsize>
Aug 01 19:45:16 user nova-compute[72504]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <domain type='qemu'/>
Aug 01 19:45:16 user nova-compute[72504]:     </arch>
Aug 01 19:45:16 user nova-compute[72504]:     <features>
Aug 01 19:45:16 user nova-compute[72504]:       <cpuselection/>
Aug 01 19:45:16 user nova-compute[72504]:       <deviceboot/>
Aug 01 19:45:16 user nova-compute[72504]:       <disksnapshot default='on' toggle='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     </features>
Aug 01 19:45:16 user nova-compute[72504]:   </guest>
Aug 01 19:45:16 user nova-compute[72504]:   <guest>
Aug 01 19:45:16 user nova-compute[72504]:     <os_type>hvm</os_type>
Aug 01 19:45:16 user nova-compute[72504]:     <arch name='microblazeel'>
Aug 01 19:45:16 user nova-compute[72504]:       <wordsize>32</wordsize>
Aug 01 19:45:16 user nova-compute[72504]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <domain type='qemu'/>
Aug 01 19:45:16 user nova-compute[72504]:     </arch>
Aug 01 19:45:16 user nova-compute[72504]:     <features>
Aug 01 19:45:16 user nova-compute[72504]:       <cpuselection/>
Aug 01 19:45:16 user nova-compute[72504]:       <deviceboot/>
Aug 01 19:45:16 user nova-compute[72504]:       <disksnapshot default='on' toggle='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     </features>
Aug 01 19:45:16 user nova-compute[72504]:   </guest>
Aug 01 19:45:16 user nova-compute[72504]:   <guest>
Aug 01 19:45:16 user nova-compute[72504]:     <os_type>hvm</os_type>
Aug 01 19:45:16 user nova-compute[72504]:     <arch name='mips'>
Aug 01 19:45:16 user nova-compute[72504]:       <wordsize>32</wordsize>
Aug 01 19:45:16 user nova-compute[72504]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='16'>malta</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <domain type='qemu'/>
Aug 01 19:45:16 user nova-compute[72504]:     </arch>
Aug 01 19:45:16 user nova-compute[72504]:     <features>
Aug 01 19:45:16 user nova-compute[72504]:       <cpuselection/>
Aug 01 19:45:16 user nova-compute[72504]:       <deviceboot/>
Aug 01 19:45:16 user nova-compute[72504]:       <disksnapshot default='on' toggle='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     </features>
Aug 01 19:45:16 user nova-compute[72504]:   </guest>
Aug 01 19:45:16 user nova-compute[72504]:   <guest>
Aug 01 19:45:16 user nova-compute[72504]:     <os_type>hvm</os_type>
Aug 01 19:45:16 user nova-compute[72504]:     <arch name='mipsel'>
Aug 01 19:45:16 user nova-compute[72504]:       <wordsize>32</wordsize>
Aug 01 19:45:16 user nova-compute[72504]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='16'>malta</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <domain type='qemu'/>
Aug 01 19:45:16 user nova-compute[72504]:     </arch>
Aug 01 19:45:16 user nova-compute[72504]:     <features>
Aug 01 19:45:16 user nova-compute[72504]:       <cpuselection/>
Aug 01 19:45:16 user nova-compute[72504]:       <deviceboot/>
Aug 01 19:45:16 user nova-compute[72504]:       <disksnapshot default='on' toggle='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     </features>
Aug 01 19:45:16 user nova-compute[72504]:   </guest>
Aug 01 19:45:16 user nova-compute[72504]:   <guest>
Aug 01 19:45:16 user nova-compute[72504]:     <os_type>hvm</os_type>
Aug 01 19:45:16 user nova-compute[72504]:     <arch name='mips64'>
Aug 01 19:45:16 user nova-compute[72504]:       <wordsize>64</wordsize>
Aug 01 19:45:16 user nova-compute[72504]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='16'>malta</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>pica61</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>magnum</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <domain type='qemu'/>
Aug 01 19:45:16 user nova-compute[72504]:     </arch>
Aug 01 19:45:16 user nova-compute[72504]:     <features>
Aug 01 19:45:16 user nova-compute[72504]:       <cpuselection/>
Aug 01 19:45:16 user nova-compute[72504]:       <deviceboot/>
Aug 01 19:45:16 user nova-compute[72504]:       <disksnapshot default='on' toggle='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     </features>
Aug 01 19:45:16 user nova-compute[72504]:   </guest>
Aug 01 19:45:16 user nova-compute[72504]:   <guest>
Aug 01 19:45:16 user nova-compute[72504]:     <os_type>hvm</os_type>
Aug 01 19:45:16 user nova-compute[72504]:     <arch name='mips64el'>
Aug 01 19:45:16 user nova-compute[72504]:       <wordsize>64</wordsize>
Aug 01 19:45:16 user nova-compute[72504]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='16'>malta</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>pica61</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>magnum</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='16'>boston</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <domain type='qemu'/>
Aug 01 19:45:16 user nova-compute[72504]:     </arch>
Aug 01 19:45:16 user nova-compute[72504]:     <features>
Aug 01 19:45:16 user nova-compute[72504]:       <cpuselection/>
Aug 01 19:45:16 user nova-compute[72504]:       <deviceboot/>
Aug 01 19:45:16 user nova-compute[72504]:       <disksnapshot default='on' toggle='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     </features>
Aug 01 19:45:16 user nova-compute[72504]:   </guest>
Aug 01 19:45:16 user nova-compute[72504]:   <guest>
Aug 01 19:45:16 user nova-compute[72504]:     <os_type>hvm</os_type>
Aug 01 19:45:16 user nova-compute[72504]:     <arch name='ppc'>
Aug 01 19:45:16 user nova-compute[72504]:       <wordsize>32</wordsize>
Aug 01 19:45:16 user nova-compute[72504]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>g3beige</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mac99</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='32'>ppce500</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>pegasos2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>sam460ex</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>bamboo</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>40p</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>ref405ep</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>taihu</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <domain type='qemu'/>
Aug 01 19:45:16 user nova-compute[72504]:     </arch>
Aug 01 19:45:16 user nova-compute[72504]:     <features>
Aug 01 19:45:16 user nova-compute[72504]:       <cpuselection/>
Aug 01 19:45:16 user nova-compute[72504]:       <deviceboot/>
Aug 01 19:45:16 user nova-compute[72504]:       <disksnapshot default='on' toggle='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     </features>
Aug 01 19:45:16 user nova-compute[72504]:   </guest>
Aug 01 19:45:16 user nova-compute[72504]:   <guest>
Aug 01 19:45:16 user nova-compute[72504]:     <os_type>hvm</os_type>
Aug 01 19:45:16 user nova-compute[72504]:     <arch name='ppc64'>
Aug 01 19:45:16 user nova-compute[72504]:       <wordsize>64</wordsize>
Aug 01 19:45:16 user nova-compute[72504]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2048'>powernv9</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>taihu</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2048'>powernv10</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='32'>ppce500</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>40p</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>pegasos2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>bamboo</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>g3beige</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mac99</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>sam460ex</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>ref405ep</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2048'>powernv8</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <domain type='qemu'/>
Aug 01 19:45:16 user nova-compute[72504]:     </arch>
Aug 01 19:45:16 user nova-compute[72504]:     <features>
Aug 01 19:45:16 user nova-compute[72504]:       <cpuselection/>
Aug 01 19:45:16 user nova-compute[72504]:       <deviceboot/>
Aug 01 19:45:16 user nova-compute[72504]:       <disksnapshot default='on' toggle='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     </features>
Aug 01 19:45:16 user nova-compute[72504]:   </guest>
Aug 01 19:45:16 user nova-compute[72504]:   <guest>
Aug 01 19:45:16 user nova-compute[72504]:     <os_type>hvm</os_type>
Aug 01 19:45:16 user nova-compute[72504]:     <arch name='ppc64le'>
Aug 01 19:45:16 user nova-compute[72504]:       <wordsize>64</wordsize>
Aug 01 19:45:16 user nova-compute[72504]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2048'>powernv9</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>taihu</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2048'>powernv10</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='32'>ppce500</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>40p</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>pegasos2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>bamboo</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>g3beige</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>mac99</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>sam460ex</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>ref405ep</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2048'>powernv8</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <domain type='qemu'/>
Aug 01 19:45:16 user nova-compute[72504]:     </arch>
Aug 01 19:45:16 user nova-compute[72504]:     <features>
Aug 01 19:45:16 user nova-compute[72504]:       <cpuselection/>
Aug 01 19:45:16 user nova-compute[72504]:       <deviceboot/>
Aug 01 19:45:16 user nova-compute[72504]:       <disksnapshot default='on' toggle='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     </features>
Aug 01 19:45:16 user nova-compute[72504]:   </guest>
Aug 01 19:45:16 user nova-compute[72504]:   <guest>
Aug 01 19:45:16 user nova-compute[72504]:     <os_type>hvm</os_type>
Aug 01 19:45:16 user nova-compute[72504]:     <arch name='riscv32'>
Aug 01 19:45:16 user nova-compute[72504]:       <wordsize>32</wordsize>
Aug 01 19:45:16 user nova-compute[72504]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='8'>spike</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>opentitan</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='5'>sifive_u</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>sifive_e</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='8'>virt</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <domain type='qemu'/>
Aug 01 19:45:16 user nova-compute[72504]:     </arch>
Aug 01 19:45:16 user nova-compute[72504]:     <features>
Aug 01 19:45:16 user nova-compute[72504]:       <cpuselection/>
Aug 01 19:45:16 user nova-compute[72504]:       <deviceboot/>
Aug 01 19:45:16 user nova-compute[72504]:       <disksnapshot default='on' toggle='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     </features>
Aug 01 19:45:16 user nova-compute[72504]:   </guest>
Aug 01 19:45:16 user nova-compute[72504]:   <guest>
Aug 01 19:45:16 user nova-compute[72504]:     <os_type>hvm</os_type>
Aug 01 19:45:16 user nova-compute[72504]:     <arch name='riscv64'>
Aug 01 19:45:16 user nova-compute[72504]:       <wordsize>64</wordsize>
Aug 01 19:45:16 user nova-compute[72504]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='8'>spike</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='5'>sifive_u</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>shakti_c</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>sifive_e</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='8'>virt</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <domain type='qemu'/>
Aug 01 19:45:16 user nova-compute[72504]:     </arch>
Aug 01 19:45:16 user nova-compute[72504]:     <features>
Aug 01 19:45:16 user nova-compute[72504]:       <cpuselection/>
Aug 01 19:45:16 user nova-compute[72504]:       <deviceboot/>
Aug 01 19:45:16 user nova-compute[72504]:       <disksnapshot default='on' toggle='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     </features>
Aug 01 19:45:16 user nova-compute[72504]:   </guest>
Aug 01 19:45:16 user nova-compute[72504]:   <guest>
Aug 01 19:45:16 user nova-compute[72504]:     <os_type>hvm</os_type>
Aug 01 19:45:16 user nova-compute[72504]:     <arch name='s390x'>
Aug 01 19:45:16 user nova-compute[72504]:       <wordsize>64</wordsize>
Aug 01 19:45:16 user nova-compute[72504]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <domain type='qemu'/>
Aug 01 19:45:16 user nova-compute[72504]:     </arch>
Aug 01 19:45:16 user nova-compute[72504]:     <features>
Aug 01 19:45:16 user nova-compute[72504]:       <cpuselection/>
Aug 01 19:45:16 user nova-compute[72504]:       <deviceboot/>
Aug 01 19:45:16 user nova-compute[72504]:       <disksnapshot default='on' toggle='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     </features>
Aug 01 19:45:16 user nova-compute[72504]:   </guest>
Aug 01 19:45:16 user nova-compute[72504]:   <guest>
Aug 01 19:45:16 user nova-compute[72504]:     <os_type>hvm</os_type>
Aug 01 19:45:16 user nova-compute[72504]:     <arch name='sh4'>
Aug 01 19:45:16 user nova-compute[72504]:       <wordsize>32</wordsize>
Aug 01 19:45:16 user nova-compute[72504]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>shix</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>r2d</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <domain type='qemu'/>
Aug 01 19:45:16 user nova-compute[72504]:     </arch>
Aug 01 19:45:16 user nova-compute[72504]:     <features>
Aug 01 19:45:16 user nova-compute[72504]:       <cpuselection/>
Aug 01 19:45:16 user nova-compute[72504]:       <deviceboot/>
Aug 01 19:45:16 user nova-compute[72504]:       <disksnapshot default='on' toggle='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     </features>
Aug 01 19:45:16 user nova-compute[72504]:   </guest>
Aug 01 19:45:16 user nova-compute[72504]:   <guest>
Aug 01 19:45:16 user nova-compute[72504]:     <os_type>hvm</os_type>
Aug 01 19:45:16 user nova-compute[72504]:     <arch name='sh4eb'>
Aug 01 19:45:16 user nova-compute[72504]:       <wordsize>64</wordsize>
Aug 01 19:45:16 user nova-compute[72504]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>shix</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>r2d</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <domain type='qemu'/>
Aug 01 19:45:16 user nova-compute[72504]:     </arch>
Aug 01 19:45:16 user nova-compute[72504]:     <features>
Aug 01 19:45:16 user nova-compute[72504]:       <cpuselection/>
Aug 01 19:45:16 user nova-compute[72504]:       <deviceboot/>
Aug 01 19:45:16 user nova-compute[72504]:       <disksnapshot default='on' toggle='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     </features>
Aug 01 19:45:16 user nova-compute[72504]:   </guest>
Aug 01 19:45:16 user nova-compute[72504]:   <guest>
Aug 01 19:45:16 user nova-compute[72504]:     <os_type>hvm</os_type>
Aug 01 19:45:16 user nova-compute[72504]:     <arch name='sparc'>
Aug 01 19:45:16 user nova-compute[72504]:       <wordsize>32</wordsize>
Aug 01 19:45:16 user nova-compute[72504]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>SS-5</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>SS-20</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>LX</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>SS-4</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>SS-10</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>Voyager</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <domain type='qemu'/>
Aug 01 19:45:16 user nova-compute[72504]:     </arch>
Aug 01 19:45:16 user nova-compute[72504]:     <features>
Aug 01 19:45:16 user nova-compute[72504]:       <cpuselection/>
Aug 01 19:45:16 user nova-compute[72504]:       <deviceboot/>
Aug 01 19:45:16 user nova-compute[72504]:       <disksnapshot default='on' toggle='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     </features>
Aug 01 19:45:16 user nova-compute[72504]:   </guest>
Aug 01 19:45:16 user nova-compute[72504]:   <guest>
Aug 01 19:45:16 user nova-compute[72504]:     <os_type>hvm</os_type>
Aug 01 19:45:16 user nova-compute[72504]:     <arch name='sparc64'>
Aug 01 19:45:16 user nova-compute[72504]:       <wordsize>64</wordsize>
Aug 01 19:45:16 user nova-compute[72504]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>sun4u</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>niagara</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>sun4v</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <domain type='qemu'/>
Aug 01 19:45:16 user nova-compute[72504]:     </arch>
Aug 01 19:45:16 user nova-compute[72504]:     <features>
Aug 01 19:45:16 user nova-compute[72504]:       <cpuselection/>
Aug 01 19:45:16 user nova-compute[72504]:       <deviceboot/>
Aug 01 19:45:16 user nova-compute[72504]:       <disksnapshot default='on' toggle='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     </features>
Aug 01 19:45:16 user nova-compute[72504]:   </guest>
Aug 01 19:45:16 user nova-compute[72504]:   <guest>
Aug 01 19:45:16 user nova-compute[72504]:     <os_type>hvm</os_type>
Aug 01 19:45:16 user nova-compute[72504]:     <arch name='x86_64'>
Aug 01 19:45:16 user nova-compute[72504]:       <wordsize>64</wordsize>
Aug 01 19:45:16 user nova-compute[72504]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>x-remote</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='1'>isapc</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>microvm</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <domain type='qemu'/>
Aug 01 19:45:16 user nova-compute[72504]:       <domain type='kvm'/>
Aug 01 19:45:16 user nova-compute[72504]:     </arch>
Aug 01 19:45:16 user nova-compute[72504]:     <features>
Aug 01 19:45:16 user nova-compute[72504]:       <acpi default='on' toggle='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:       <apic default='on' toggle='no'/>
Aug 01 19:45:16 user nova-compute[72504]:       <cpuselection/>
Aug 01 19:45:16 user nova-compute[72504]:       <deviceboot/>
Aug 01 19:45:16 user nova-compute[72504]:       <disksnapshot default='on' toggle='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     </features>
Aug 01 19:45:16 user nova-compute[72504]:   </guest>
Aug 01 19:45:16 user nova-compute[72504]:   <guest>
Aug 01 19:45:16 user nova-compute[72504]:     <os_type>hvm</os_type>
Aug 01 19:45:16 user nova-compute[72504]:     <arch name='xtensa'>
Aug 01 19:45:16 user nova-compute[72504]:       <wordsize>32</wordsize>
Aug 01 19:45:16 user nova-compute[72504]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>sim</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='32'>kc705</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='32'>ml605</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='32'>virt</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='32'>lx200</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='32'>lx60</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <domain type='qemu'/>
Aug 01 19:45:16 user nova-compute[72504]:     </arch>
Aug 01 19:45:16 user nova-compute[72504]:     <features>
Aug 01 19:45:16 user nova-compute[72504]:       <cpuselection/>
Aug 01 19:45:16 user nova-compute[72504]:       <deviceboot/>
Aug 01 19:45:16 user nova-compute[72504]:       <disksnapshot default='on' toggle='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     </features>
Aug 01 19:45:16 user nova-compute[72504]:   </guest>
Aug 01 19:45:16 user nova-compute[72504]:   <guest>
Aug 01 19:45:16 user nova-compute[72504]:     <os_type>hvm</os_type>
Aug 01 19:45:16 user nova-compute[72504]:     <arch name='xtensaeb'>
Aug 01 19:45:16 user nova-compute[72504]:       <wordsize>32</wordsize>
Aug 01 19:45:16 user nova-compute[72504]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='4'>sim</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='32'>kc705</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='32'>ml605</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='32'>virt</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='32'>lx200</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='32'>lx60</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 01 19:45:16 user nova-compute[72504]:       <domain type='qemu'/>
Aug 01 19:45:16 user nova-compute[72504]:     </arch>
Aug 01 19:45:16 user nova-compute[72504]:     <features>
Aug 01 19:45:16 user nova-compute[72504]:       <cpuselection/>
Aug 01 19:45:16 user nova-compute[72504]:       <deviceboot/>
Aug 01 19:45:16 user nova-compute[72504]:       <disksnapshot default='on' toggle='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     </features>
Aug 01 19:45:16 user nova-compute[72504]:   </guest>
Aug 01 19:45:16 user nova-compute[72504]: </capabilities>
Aug 01 19:45:16 user nova-compute[72504]: 
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72504) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72504) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72504) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72504) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72504) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'ubuntu', 'pc', 'q35'} {{(pid=72504) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 01 19:45:16 user nova-compute[72504]: <domainCapabilities>
Aug 01 19:45:16 user nova-compute[72504]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 19:45:16 user nova-compute[72504]:   <domain>kvm</domain>
Aug 01 19:45:16 user nova-compute[72504]:   <machine>pc-q35-jammy</machine>
Aug 01 19:45:16 user nova-compute[72504]:   <arch>i686</arch>
Aug 01 19:45:16 user nova-compute[72504]:   <vcpu max='288'/>
Aug 01 19:45:16 user nova-compute[72504]:   <iothreads supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:   <os supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:     <enum name='firmware'/>
Aug 01 19:45:16 user nova-compute[72504]:     <loader supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='type'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>rom</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>pflash</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='readonly'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>yes</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>no</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='secure'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>no</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </loader>
Aug 01 19:45:16 user nova-compute[72504]:   </os>
Aug 01 19:45:16 user nova-compute[72504]:   <cpu>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='host-passthrough' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='hostPassthroughMigratable'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>off</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='maximum' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='maximumMigratable'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>on</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>off</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='host-model' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <vendor>Intel</vendor>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ss'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='vmx'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='pcid'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='hypervisor'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='arat'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='umip'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='md-clear'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='stibp'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ssbd'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ibpb'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ibrs'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='amd-stibp'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='disable' name='erms'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='disable' name='lm'/>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='custom' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>qemu64</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>qemu32</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>phenom</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>pentium3</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>pentium2</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>pentium</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>n270</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>kvm64</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>kvm32</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>coreduo</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>core2duo</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>athlon</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Westmere</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Snowridge</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Server</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Client</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>SandyBridge</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Penryn</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G5</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G4</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G3</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G2</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G1</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Nehalem</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>IvyBridge</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Icelake-Server</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC-Rome</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC-Milan</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Dhyana</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Cooperlake</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Conroe</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>486</model>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:   </cpu>
Aug 01 19:45:16 user nova-compute[72504]:   <memoryBacking supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:     <enum name='sourceType'>
Aug 01 19:45:16 user nova-compute[72504]:       <value>file</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>anonymous</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>memfd</value>
Aug 01 19:45:16 user nova-compute[72504]:     </enum>
Aug 01 19:45:16 user nova-compute[72504]:   </memoryBacking>
Aug 01 19:45:16 user nova-compute[72504]:   <devices>
Aug 01 19:45:16 user nova-compute[72504]:     <disk supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='diskDevice'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>disk</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>cdrom</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>floppy</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>lun</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='bus'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>fdc</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>scsi</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>usb</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>sata</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='model'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-non-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </disk>
Aug 01 19:45:16 user nova-compute[72504]:     <graphics supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='type'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>sdl</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>vnc</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>spice</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>egl-headless</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </graphics>
Aug 01 19:45:16 user nova-compute[72504]:     <video supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='modelType'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>vga</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>cirrus</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>vmvga</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>qxl</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>none</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>bochs</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>ramfb</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </video>
Aug 01 19:45:16 user nova-compute[72504]:     <hostdev supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='mode'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>subsystem</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='startupPolicy'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>default</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>mandatory</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>requisite</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>optional</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='subsysType'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>usb</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>pci</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>scsi</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='capsType'/>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='pciBackend'/>
Aug 01 19:45:16 user nova-compute[72504]:     </hostdev>
Aug 01 19:45:16 user nova-compute[72504]:     <rng supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='model'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-non-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='backendModel'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>random</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>egd</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>builtin</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </rng>
Aug 01 19:45:16 user nova-compute[72504]:     <filesystem supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='driverType'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>path</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>handle</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtiofs</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </filesystem>
Aug 01 19:45:16 user nova-compute[72504]:     <tpm supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='model'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>tpm-tis</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>tpm-crb</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='backendModel'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>passthrough</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>emulator</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </tpm>
Aug 01 19:45:16 user nova-compute[72504]:   </devices>
Aug 01 19:45:16 user nova-compute[72504]:   <features>
Aug 01 19:45:16 user nova-compute[72504]:     <gic supported='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     <vmcoreinfo supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <genid supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <backingStoreInput supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <backup supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <sev supported='no'/>
Aug 01 19:45:16 user nova-compute[72504]:   </features>
Aug 01 19:45:16 user nova-compute[72504]: </domainCapabilities>
Aug 01 19:45:16 user nova-compute[72504]:  {{(pid=72504) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 01 19:45:16 user nova-compute[72504]: <domainCapabilities>
Aug 01 19:45:16 user nova-compute[72504]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 19:45:16 user nova-compute[72504]:   <domain>kvm</domain>
Aug 01 19:45:16 user nova-compute[72504]:   <machine>pc-i440fx-jammy</machine>
Aug 01 19:45:16 user nova-compute[72504]:   <arch>i686</arch>
Aug 01 19:45:16 user nova-compute[72504]:   <vcpu max='255'/>
Aug 01 19:45:16 user nova-compute[72504]:   <iothreads supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:   <os supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:     <enum name='firmware'/>
Aug 01 19:45:16 user nova-compute[72504]:     <loader supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='type'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>rom</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>pflash</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='readonly'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>yes</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>no</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='secure'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>no</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </loader>
Aug 01 19:45:16 user nova-compute[72504]:   </os>
Aug 01 19:45:16 user nova-compute[72504]:   <cpu>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='host-passthrough' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='hostPassthroughMigratable'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>off</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='maximum' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='maximumMigratable'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>on</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>off</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='host-model' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <vendor>Intel</vendor>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ss'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='vmx'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='pcid'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='hypervisor'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='arat'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='umip'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='md-clear'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='stibp'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ssbd'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ibpb'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ibrs'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='amd-stibp'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='disable' name='erms'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='disable' name='lm'/>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='custom' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>qemu64</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>qemu32</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>phenom</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>pentium3</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>pentium2</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>pentium</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>n270</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>kvm64</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>kvm32</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>coreduo</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>core2duo</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>athlon</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Westmere</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Snowridge</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Server</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Client</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>SandyBridge</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Penryn</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G5</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G4</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G3</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G2</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G1</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Nehalem</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>IvyBridge</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Icelake-Server</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC-Rome</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC-Milan</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Dhyana</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Cooperlake</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Conroe</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>486</model>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:   </cpu>
Aug 01 19:45:16 user nova-compute[72504]:   <memoryBacking supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:     <enum name='sourceType'>
Aug 01 19:45:16 user nova-compute[72504]:       <value>file</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>anonymous</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>memfd</value>
Aug 01 19:45:16 user nova-compute[72504]:     </enum>
Aug 01 19:45:16 user nova-compute[72504]:   </memoryBacking>
Aug 01 19:45:16 user nova-compute[72504]:   <devices>
Aug 01 19:45:16 user nova-compute[72504]:     <disk supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='diskDevice'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>disk</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>cdrom</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>floppy</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>lun</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='bus'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>ide</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>fdc</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>scsi</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>usb</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>sata</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='model'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-non-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </disk>
Aug 01 19:45:16 user nova-compute[72504]:     <graphics supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='type'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>sdl</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>vnc</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>spice</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>egl-headless</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </graphics>
Aug 01 19:45:16 user nova-compute[72504]:     <video supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='modelType'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>vga</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>cirrus</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>vmvga</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>qxl</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>none</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>bochs</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>ramfb</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </video>
Aug 01 19:45:16 user nova-compute[72504]:     <hostdev supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='mode'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>subsystem</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='startupPolicy'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>default</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>mandatory</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>requisite</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>optional</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='subsysType'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>usb</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>pci</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>scsi</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='capsType'/>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='pciBackend'/>
Aug 01 19:45:16 user nova-compute[72504]:     </hostdev>
Aug 01 19:45:16 user nova-compute[72504]:     <rng supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='model'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-non-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='backendModel'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>random</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>egd</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>builtin</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </rng>
Aug 01 19:45:16 user nova-compute[72504]:     <filesystem supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='driverType'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>path</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>handle</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtiofs</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </filesystem>
Aug 01 19:45:16 user nova-compute[72504]:     <tpm supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='model'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>tpm-tis</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>tpm-crb</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='backendModel'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>passthrough</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>emulator</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </tpm>
Aug 01 19:45:16 user nova-compute[72504]:   </devices>
Aug 01 19:45:16 user nova-compute[72504]:   <features>
Aug 01 19:45:16 user nova-compute[72504]:     <gic supported='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     <vmcoreinfo supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <genid supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <backingStoreInput supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <backup supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <sev supported='no'/>
Aug 01 19:45:16 user nova-compute[72504]:   </features>
Aug 01 19:45:16 user nova-compute[72504]: </domainCapabilities>
Aug 01 19:45:16 user nova-compute[72504]:  {{(pid=72504) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 01 19:45:16 user nova-compute[72504]: <domainCapabilities>
Aug 01 19:45:16 user nova-compute[72504]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 19:45:16 user nova-compute[72504]:   <domain>kvm</domain>
Aug 01 19:45:16 user nova-compute[72504]:   <machine>pc-i440fx-6.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:   <arch>i686</arch>
Aug 01 19:45:16 user nova-compute[72504]:   <vcpu max='255'/>
Aug 01 19:45:16 user nova-compute[72504]:   <iothreads supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:   <os supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:     <enum name='firmware'/>
Aug 01 19:45:16 user nova-compute[72504]:     <loader supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='type'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>rom</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>pflash</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='readonly'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>yes</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>no</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='secure'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>no</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </loader>
Aug 01 19:45:16 user nova-compute[72504]:   </os>
Aug 01 19:45:16 user nova-compute[72504]:   <cpu>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='host-passthrough' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='hostPassthroughMigratable'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>off</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='maximum' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='maximumMigratable'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>on</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>off</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='host-model' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <vendor>Intel</vendor>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ss'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='vmx'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='pcid'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='hypervisor'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='arat'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='umip'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='md-clear'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='stibp'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ssbd'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ibpb'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ibrs'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='amd-stibp'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='disable' name='erms'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='disable' name='lm'/>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='custom' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>qemu64</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>qemu32</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>phenom</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>pentium3</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>pentium2</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>pentium</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>n270</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>kvm64</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>kvm32</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>coreduo</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>core2duo</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>athlon</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Westmere</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Snowridge</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Server</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Client</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>SandyBridge</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Penryn</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G5</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G4</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G3</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G2</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G1</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Nehalem</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>IvyBridge</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Icelake-Server</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC-Rome</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC-Milan</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Dhyana</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Cooperlake</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Conroe</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>486</model>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:   </cpu>
Aug 01 19:45:16 user nova-compute[72504]:   <memoryBacking supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:     <enum name='sourceType'>
Aug 01 19:45:16 user nova-compute[72504]:       <value>file</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>anonymous</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>memfd</value>
Aug 01 19:45:16 user nova-compute[72504]:     </enum>
Aug 01 19:45:16 user nova-compute[72504]:   </memoryBacking>
Aug 01 19:45:16 user nova-compute[72504]:   <devices>
Aug 01 19:45:16 user nova-compute[72504]:     <disk supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='diskDevice'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>disk</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>cdrom</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>floppy</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>lun</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='bus'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>ide</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>fdc</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>scsi</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>usb</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>sata</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='model'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-non-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </disk>
Aug 01 19:45:16 user nova-compute[72504]:     <graphics supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='type'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>sdl</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>vnc</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>spice</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>egl-headless</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </graphics>
Aug 01 19:45:16 user nova-compute[72504]:     <video supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='modelType'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>vga</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>cirrus</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>vmvga</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>qxl</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>none</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>bochs</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>ramfb</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </video>
Aug 01 19:45:16 user nova-compute[72504]:     <hostdev supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='mode'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>subsystem</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='startupPolicy'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>default</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>mandatory</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>requisite</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>optional</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='subsysType'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>usb</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>pci</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>scsi</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='capsType'/>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='pciBackend'/>
Aug 01 19:45:16 user nova-compute[72504]:     </hostdev>
Aug 01 19:45:16 user nova-compute[72504]:     <rng supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='model'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-non-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='backendModel'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>random</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>egd</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>builtin</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </rng>
Aug 01 19:45:16 user nova-compute[72504]:     <filesystem supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='driverType'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>path</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>handle</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtiofs</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </filesystem>
Aug 01 19:45:16 user nova-compute[72504]:     <tpm supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='model'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>tpm-tis</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>tpm-crb</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='backendModel'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>passthrough</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>emulator</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </tpm>
Aug 01 19:45:16 user nova-compute[72504]:   </devices>
Aug 01 19:45:16 user nova-compute[72504]:   <features>
Aug 01 19:45:16 user nova-compute[72504]:     <gic supported='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     <vmcoreinfo supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <genid supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <backingStoreInput supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <backup supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <sev supported='no'/>
Aug 01 19:45:16 user nova-compute[72504]:   </features>
Aug 01 19:45:16 user nova-compute[72504]: </domainCapabilities>
Aug 01 19:45:16 user nova-compute[72504]:  {{(pid=72504) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 01 19:45:16 user nova-compute[72504]: <domainCapabilities>
Aug 01 19:45:16 user nova-compute[72504]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 19:45:16 user nova-compute[72504]:   <domain>kvm</domain>
Aug 01 19:45:16 user nova-compute[72504]:   <machine>pc-q35-6.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:   <arch>i686</arch>
Aug 01 19:45:16 user nova-compute[72504]:   <vcpu max='288'/>
Aug 01 19:45:16 user nova-compute[72504]:   <iothreads supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:   <os supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:     <enum name='firmware'/>
Aug 01 19:45:16 user nova-compute[72504]:     <loader supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='type'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>rom</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>pflash</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='readonly'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>yes</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>no</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='secure'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>no</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </loader>
Aug 01 19:45:16 user nova-compute[72504]:   </os>
Aug 01 19:45:16 user nova-compute[72504]:   <cpu>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='host-passthrough' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='hostPassthroughMigratable'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>off</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='maximum' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='maximumMigratable'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>on</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>off</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='host-model' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <vendor>Intel</vendor>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ss'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='vmx'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='pcid'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='hypervisor'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='arat'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='umip'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='md-clear'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='stibp'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ssbd'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ibpb'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ibrs'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='amd-stibp'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='disable' name='erms'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='disable' name='lm'/>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='custom' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>qemu64</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>qemu32</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>phenom</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>pentium3</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>pentium2</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>pentium</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>n270</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>kvm64</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>kvm32</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>coreduo</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>core2duo</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>athlon</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Westmere</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Snowridge</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Server</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Client</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>SandyBridge</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Penryn</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G5</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G4</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G3</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G2</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G1</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Nehalem</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>IvyBridge</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Icelake-Server</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC-Rome</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC-Milan</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Dhyana</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Cooperlake</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Conroe</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>486</model>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:   </cpu>
Aug 01 19:45:16 user nova-compute[72504]:   <memoryBacking supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:     <enum name='sourceType'>
Aug 01 19:45:16 user nova-compute[72504]:       <value>file</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>anonymous</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>memfd</value>
Aug 01 19:45:16 user nova-compute[72504]:     </enum>
Aug 01 19:45:16 user nova-compute[72504]:   </memoryBacking>
Aug 01 19:45:16 user nova-compute[72504]:   <devices>
Aug 01 19:45:16 user nova-compute[72504]:     <disk supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='diskDevice'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>disk</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>cdrom</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>floppy</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>lun</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='bus'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>fdc</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>scsi</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>usb</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>sata</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='model'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-non-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </disk>
Aug 01 19:45:16 user nova-compute[72504]:     <graphics supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='type'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>sdl</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>vnc</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>spice</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>egl-headless</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </graphics>
Aug 01 19:45:16 user nova-compute[72504]:     <video supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='modelType'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>vga</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>cirrus</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>vmvga</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>qxl</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>none</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>bochs</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>ramfb</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </video>
Aug 01 19:45:16 user nova-compute[72504]:     <hostdev supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='mode'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>subsystem</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='startupPolicy'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>default</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>mandatory</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>requisite</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>optional</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='subsysType'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>usb</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>pci</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>scsi</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='capsType'/>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='pciBackend'/>
Aug 01 19:45:16 user nova-compute[72504]:     </hostdev>
Aug 01 19:45:16 user nova-compute[72504]:     <rng supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='model'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-non-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='backendModel'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>random</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>egd</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>builtin</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </rng>
Aug 01 19:45:16 user nova-compute[72504]:     <filesystem supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='driverType'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>path</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>handle</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtiofs</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </filesystem>
Aug 01 19:45:16 user nova-compute[72504]:     <tpm supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='model'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>tpm-tis</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>tpm-crb</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='backendModel'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>passthrough</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>emulator</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </tpm>
Aug 01 19:45:16 user nova-compute[72504]:   </devices>
Aug 01 19:45:16 user nova-compute[72504]:   <features>
Aug 01 19:45:16 user nova-compute[72504]:     <gic supported='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     <vmcoreinfo supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <genid supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <backingStoreInput supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <backup supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <sev supported='no'/>
Aug 01 19:45:16 user nova-compute[72504]:   </features>
Aug 01 19:45:16 user nova-compute[72504]: </domainCapabilities>
Aug 01 19:45:16 user nova-compute[72504]:  {{(pid=72504) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72504) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72504) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72504) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72504) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72504) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72504) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72504) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72504) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=72504) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=72504) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72504) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72504) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72504) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72504) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72504) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72504) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72504) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'ubuntu', 'pc', 'q35'} {{(pid=72504) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 01 19:45:16 user nova-compute[72504]: <domainCapabilities>
Aug 01 19:45:16 user nova-compute[72504]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 19:45:16 user nova-compute[72504]:   <domain>kvm</domain>
Aug 01 19:45:16 user nova-compute[72504]:   <machine>pc-q35-jammy</machine>
Aug 01 19:45:16 user nova-compute[72504]:   <arch>x86_64</arch>
Aug 01 19:45:16 user nova-compute[72504]:   <vcpu max='288'/>
Aug 01 19:45:16 user nova-compute[72504]:   <iothreads supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:   <os supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:     <enum name='firmware'>
Aug 01 19:45:16 user nova-compute[72504]:       <value>efi</value>
Aug 01 19:45:16 user nova-compute[72504]:     </enum>
Aug 01 19:45:16 user nova-compute[72504]:     <loader supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='type'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>rom</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>pflash</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='readonly'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>yes</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>no</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='secure'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>yes</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>no</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </loader>
Aug 01 19:45:16 user nova-compute[72504]:   </os>
Aug 01 19:45:16 user nova-compute[72504]:   <cpu>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='host-passthrough' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='hostPassthroughMigratable'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>on</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>off</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='maximum' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='maximumMigratable'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>on</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>off</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='host-model' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <vendor>Intel</vendor>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ss'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='vmx'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='pcid'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='hypervisor'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='arat'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='umip'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='md-clear'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='stibp'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ssbd'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='invtsc'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ibpb'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ibrs'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='amd-stibp'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='rsba'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='disable' name='erms'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='custom' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>qemu64</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>qemu32</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>phenom</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>pentium3</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>pentium2</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>pentium</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>n270</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>kvm64</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>kvm32</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>coreduo</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>core2duo</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>athlon</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>Westmere</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Snowridge</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Server</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Client</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>SandyBridge</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>Penryn</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G5</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G4</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G3</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G2</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>Opteron_G1</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>Nehalem</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>IvyBridge</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Icelake-Server</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC-Rome</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC-Milan</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Dhyana</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Cooperlake</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>Conroe</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>486</model>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:   </cpu>
Aug 01 19:45:16 user nova-compute[72504]:   <memoryBacking supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:     <enum name='sourceType'>
Aug 01 19:45:16 user nova-compute[72504]:       <value>file</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>anonymous</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>memfd</value>
Aug 01 19:45:16 user nova-compute[72504]:     </enum>
Aug 01 19:45:16 user nova-compute[72504]:   </memoryBacking>
Aug 01 19:45:16 user nova-compute[72504]:   <devices>
Aug 01 19:45:16 user nova-compute[72504]:     <disk supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='diskDevice'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>disk</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>cdrom</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>floppy</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>lun</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='bus'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>fdc</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>scsi</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>usb</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>sata</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='model'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-non-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </disk>
Aug 01 19:45:16 user nova-compute[72504]:     <graphics supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='type'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>sdl</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>vnc</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>spice</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>egl-headless</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </graphics>
Aug 01 19:45:16 user nova-compute[72504]:     <video supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='modelType'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>vga</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>cirrus</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>vmvga</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>qxl</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>none</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>bochs</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>ramfb</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </video>
Aug 01 19:45:16 user nova-compute[72504]:     <hostdev supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='mode'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>subsystem</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='startupPolicy'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>default</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>mandatory</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>requisite</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>optional</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='subsysType'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>usb</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>pci</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>scsi</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='capsType'/>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='pciBackend'/>
Aug 01 19:45:16 user nova-compute[72504]:     </hostdev>
Aug 01 19:45:16 user nova-compute[72504]:     <rng supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='model'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-non-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='backendModel'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>random</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>egd</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>builtin</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </rng>
Aug 01 19:45:16 user nova-compute[72504]:     <filesystem supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='driverType'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>path</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>handle</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtiofs</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </filesystem>
Aug 01 19:45:16 user nova-compute[72504]:     <tpm supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='model'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>tpm-tis</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>tpm-crb</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='backendModel'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>passthrough</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>emulator</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </tpm>
Aug 01 19:45:16 user nova-compute[72504]:   </devices>
Aug 01 19:45:16 user nova-compute[72504]:   <features>
Aug 01 19:45:16 user nova-compute[72504]:     <gic supported='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     <vmcoreinfo supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <genid supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <backingStoreInput supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <backup supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <sev supported='no'/>
Aug 01 19:45:16 user nova-compute[72504]:   </features>
Aug 01 19:45:16 user nova-compute[72504]: </domainCapabilities>
Aug 01 19:45:16 user nova-compute[72504]:  {{(pid=72504) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 01 19:45:16 user nova-compute[72504]: <domainCapabilities>
Aug 01 19:45:16 user nova-compute[72504]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 19:45:16 user nova-compute[72504]:   <domain>kvm</domain>
Aug 01 19:45:16 user nova-compute[72504]:   <machine>pc-i440fx-jammy</machine>
Aug 01 19:45:16 user nova-compute[72504]:   <arch>x86_64</arch>
Aug 01 19:45:16 user nova-compute[72504]:   <vcpu max='255'/>
Aug 01 19:45:16 user nova-compute[72504]:   <iothreads supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:   <os supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:     <enum name='firmware'>
Aug 01 19:45:16 user nova-compute[72504]:       <value>efi</value>
Aug 01 19:45:16 user nova-compute[72504]:     </enum>
Aug 01 19:45:16 user nova-compute[72504]:     <loader supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='type'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>rom</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>pflash</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='readonly'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>yes</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>no</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='secure'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>no</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </loader>
Aug 01 19:45:16 user nova-compute[72504]:   </os>
Aug 01 19:45:16 user nova-compute[72504]:   <cpu>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='host-passthrough' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='hostPassthroughMigratable'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>on</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>off</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='maximum' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='maximumMigratable'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>on</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>off</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='host-model' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <vendor>Intel</vendor>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ss'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='vmx'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='pcid'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='hypervisor'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='arat'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='umip'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='md-clear'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='stibp'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ssbd'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='invtsc'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ibpb'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ibrs'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='amd-stibp'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='rsba'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='disable' name='erms'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='custom' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>qemu64</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>qemu32</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>phenom</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>pentium3</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>pentium2</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>pentium</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>n270</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>kvm64</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>kvm32</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>coreduo</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>core2duo</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>athlon</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>Westmere</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Snowridge</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Server</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Client</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>SandyBridge</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>Penryn</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G5</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G4</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G3</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G2</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>Opteron_G1</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>Nehalem</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>IvyBridge</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Icelake-Server</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC-Rome</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC-Milan</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Dhyana</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Cooperlake</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>Conroe</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>486</model>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:   </cpu>
Aug 01 19:45:16 user nova-compute[72504]:   <memoryBacking supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:     <enum name='sourceType'>
Aug 01 19:45:16 user nova-compute[72504]:       <value>file</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>anonymous</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>memfd</value>
Aug 01 19:45:16 user nova-compute[72504]:     </enum>
Aug 01 19:45:16 user nova-compute[72504]:   </memoryBacking>
Aug 01 19:45:16 user nova-compute[72504]:   <devices>
Aug 01 19:45:16 user nova-compute[72504]:     <disk supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='diskDevice'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>disk</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>cdrom</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>floppy</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>lun</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='bus'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>ide</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>fdc</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>scsi</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>usb</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>sata</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='model'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-non-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </disk>
Aug 01 19:45:16 user nova-compute[72504]:     <graphics supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='type'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>sdl</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>vnc</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>spice</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>egl-headless</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </graphics>
Aug 01 19:45:16 user nova-compute[72504]:     <video supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='modelType'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>vga</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>cirrus</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>vmvga</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>qxl</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>none</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>bochs</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>ramfb</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </video>
Aug 01 19:45:16 user nova-compute[72504]:     <hostdev supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='mode'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>subsystem</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='startupPolicy'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>default</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>mandatory</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>requisite</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>optional</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='subsysType'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>usb</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>pci</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>scsi</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='capsType'/>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='pciBackend'/>
Aug 01 19:45:16 user nova-compute[72504]:     </hostdev>
Aug 01 19:45:16 user nova-compute[72504]:     <rng supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='model'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-non-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='backendModel'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>random</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>egd</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>builtin</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </rng>
Aug 01 19:45:16 user nova-compute[72504]:     <filesystem supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='driverType'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>path</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>handle</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtiofs</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </filesystem>
Aug 01 19:45:16 user nova-compute[72504]:     <tpm supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='model'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>tpm-tis</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>tpm-crb</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='backendModel'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>passthrough</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>emulator</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </tpm>
Aug 01 19:45:16 user nova-compute[72504]:   </devices>
Aug 01 19:45:16 user nova-compute[72504]:   <features>
Aug 01 19:45:16 user nova-compute[72504]:     <gic supported='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     <vmcoreinfo supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <genid supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <backingStoreInput supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <backup supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <sev supported='no'/>
Aug 01 19:45:16 user nova-compute[72504]:   </features>
Aug 01 19:45:16 user nova-compute[72504]: </domainCapabilities>
Aug 01 19:45:16 user nova-compute[72504]:  {{(pid=72504) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 01 19:45:16 user nova-compute[72504]: <domainCapabilities>
Aug 01 19:45:16 user nova-compute[72504]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 19:45:16 user nova-compute[72504]:   <domain>kvm</domain>
Aug 01 19:45:16 user nova-compute[72504]:   <machine>pc-i440fx-6.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:   <arch>x86_64</arch>
Aug 01 19:45:16 user nova-compute[72504]:   <vcpu max='255'/>
Aug 01 19:45:16 user nova-compute[72504]:   <iothreads supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:   <os supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:     <enum name='firmware'>
Aug 01 19:45:16 user nova-compute[72504]:       <value>efi</value>
Aug 01 19:45:16 user nova-compute[72504]:     </enum>
Aug 01 19:45:16 user nova-compute[72504]:     <loader supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='type'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>rom</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>pflash</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='readonly'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>yes</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>no</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='secure'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>no</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </loader>
Aug 01 19:45:16 user nova-compute[72504]:   </os>
Aug 01 19:45:16 user nova-compute[72504]:   <cpu>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='host-passthrough' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='hostPassthroughMigratable'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>on</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>off</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='maximum' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='maximumMigratable'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>on</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>off</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='host-model' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <vendor>Intel</vendor>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ss'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='vmx'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='pcid'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='hypervisor'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='arat'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='umip'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='md-clear'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='stibp'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ssbd'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='invtsc'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ibpb'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ibrs'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='amd-stibp'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='rsba'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='disable' name='erms'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='custom' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>qemu64</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>qemu32</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>phenom</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>pentium3</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>pentium2</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>pentium</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>n270</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>kvm64</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>kvm32</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>coreduo</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>core2duo</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>athlon</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>Westmere</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Snowridge</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Server</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Client</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>SandyBridge</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>Penryn</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G5</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G4</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G3</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G2</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>Opteron_G1</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>Nehalem</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>IvyBridge</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Icelake-Server</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC-Rome</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC-Milan</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Dhyana</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Cooperlake</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>Conroe</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>486</model>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:   </cpu>
Aug 01 19:45:16 user nova-compute[72504]:   <memoryBacking supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:     <enum name='sourceType'>
Aug 01 19:45:16 user nova-compute[72504]:       <value>file</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>anonymous</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>memfd</value>
Aug 01 19:45:16 user nova-compute[72504]:     </enum>
Aug 01 19:45:16 user nova-compute[72504]:   </memoryBacking>
Aug 01 19:45:16 user nova-compute[72504]:   <devices>
Aug 01 19:45:16 user nova-compute[72504]:     <disk supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='diskDevice'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>disk</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>cdrom</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>floppy</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>lun</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='bus'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>ide</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>fdc</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>scsi</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>usb</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>sata</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='model'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-non-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </disk>
Aug 01 19:45:16 user nova-compute[72504]:     <graphics supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='type'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>sdl</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>vnc</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>spice</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>egl-headless</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </graphics>
Aug 01 19:45:16 user nova-compute[72504]:     <video supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='modelType'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>vga</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>cirrus</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>vmvga</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>qxl</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>none</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>bochs</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>ramfb</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </video>
Aug 01 19:45:16 user nova-compute[72504]:     <hostdev supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='mode'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>subsystem</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='startupPolicy'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>default</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>mandatory</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>requisite</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>optional</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='subsysType'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>usb</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>pci</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>scsi</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='capsType'/>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='pciBackend'/>
Aug 01 19:45:16 user nova-compute[72504]:     </hostdev>
Aug 01 19:45:16 user nova-compute[72504]:     <rng supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='model'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-non-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='backendModel'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>random</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>egd</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>builtin</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </rng>
Aug 01 19:45:16 user nova-compute[72504]:     <filesystem supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='driverType'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>path</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>handle</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtiofs</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </filesystem>
Aug 01 19:45:16 user nova-compute[72504]:     <tpm supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='model'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>tpm-tis</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>tpm-crb</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='backendModel'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>passthrough</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>emulator</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </tpm>
Aug 01 19:45:16 user nova-compute[72504]:   </devices>
Aug 01 19:45:16 user nova-compute[72504]:   <features>
Aug 01 19:45:16 user nova-compute[72504]:     <gic supported='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     <vmcoreinfo supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <genid supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <backingStoreInput supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <backup supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <sev supported='no'/>
Aug 01 19:45:16 user nova-compute[72504]:   </features>
Aug 01 19:45:16 user nova-compute[72504]: </domainCapabilities>
Aug 01 19:45:16 user nova-compute[72504]:  {{(pid=72504) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 01 19:45:16 user nova-compute[72504]: <domainCapabilities>
Aug 01 19:45:16 user nova-compute[72504]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 19:45:16 user nova-compute[72504]:   <domain>kvm</domain>
Aug 01 19:45:16 user nova-compute[72504]:   <machine>pc-q35-6.2</machine>
Aug 01 19:45:16 user nova-compute[72504]:   <arch>x86_64</arch>
Aug 01 19:45:16 user nova-compute[72504]:   <vcpu max='288'/>
Aug 01 19:45:16 user nova-compute[72504]:   <iothreads supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:   <os supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:     <enum name='firmware'>
Aug 01 19:45:16 user nova-compute[72504]:       <value>efi</value>
Aug 01 19:45:16 user nova-compute[72504]:     </enum>
Aug 01 19:45:16 user nova-compute[72504]:     <loader supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='type'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>rom</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>pflash</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='readonly'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>yes</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>no</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='secure'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>yes</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>no</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </loader>
Aug 01 19:45:16 user nova-compute[72504]:   </os>
Aug 01 19:45:16 user nova-compute[72504]:   <cpu>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='host-passthrough' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='hostPassthroughMigratable'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>on</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>off</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='maximum' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='maximumMigratable'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>on</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>off</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='host-model' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <vendor>Intel</vendor>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ss'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='vmx'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='pcid'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='hypervisor'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='arat'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='umip'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='md-clear'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='stibp'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ssbd'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='invtsc'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ibpb'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='ibrs'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='amd-stibp'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='rsba'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='disable' name='erms'/>
Aug 01 19:45:16 user nova-compute[72504]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:     <mode name='custom' supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>qemu64</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>qemu32</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>phenom</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>pentium3</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>pentium2</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>pentium</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>n270</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>kvm64</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>kvm32</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>coreduo</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>core2duo</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>athlon</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>Westmere</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Snowridge</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Server</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Skylake-Client</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>SandyBridge</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>Penryn</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G5</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G4</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G3</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Opteron_G2</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>Opteron_G1</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>Nehalem</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>IvyBridge</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Icelake-Server</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Haswell</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC-Rome</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC-Milan</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>EPYC</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Dhyana</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Cooperlake</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>Conroe</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='no'>Broadwell</model>
Aug 01 19:45:16 user nova-compute[72504]:       <model usable='yes'>486</model>
Aug 01 19:45:16 user nova-compute[72504]:     </mode>
Aug 01 19:45:16 user nova-compute[72504]:   </cpu>
Aug 01 19:45:16 user nova-compute[72504]:   <memoryBacking supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:     <enum name='sourceType'>
Aug 01 19:45:16 user nova-compute[72504]:       <value>file</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>anonymous</value>
Aug 01 19:45:16 user nova-compute[72504]:       <value>memfd</value>
Aug 01 19:45:16 user nova-compute[72504]:     </enum>
Aug 01 19:45:16 user nova-compute[72504]:   </memoryBacking>
Aug 01 19:45:16 user nova-compute[72504]:   <devices>
Aug 01 19:45:16 user nova-compute[72504]:     <disk supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='diskDevice'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>disk</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>cdrom</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>floppy</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>lun</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='bus'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>fdc</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>scsi</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>usb</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>sata</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='model'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-non-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </disk>
Aug 01 19:45:16 user nova-compute[72504]:     <graphics supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='type'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>sdl</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>vnc</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>spice</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>egl-headless</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </graphics>
Aug 01 19:45:16 user nova-compute[72504]:     <video supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='modelType'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>vga</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>cirrus</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>vmvga</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>qxl</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>none</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>bochs</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>ramfb</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </video>
Aug 01 19:45:16 user nova-compute[72504]:     <hostdev supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='mode'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>subsystem</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='startupPolicy'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>default</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>mandatory</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>requisite</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>optional</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='subsysType'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>usb</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>pci</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>scsi</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='capsType'/>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='pciBackend'/>
Aug 01 19:45:16 user nova-compute[72504]:     </hostdev>
Aug 01 19:45:16 user nova-compute[72504]:     <rng supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='model'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtio-non-transitional</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='backendModel'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>random</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>egd</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>builtin</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </rng>
Aug 01 19:45:16 user nova-compute[72504]:     <filesystem supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='driverType'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>path</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>handle</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>virtiofs</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </filesystem>
Aug 01 19:45:16 user nova-compute[72504]:     <tpm supported='yes'>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='model'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>tpm-tis</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>tpm-crb</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:       <enum name='backendModel'>
Aug 01 19:45:16 user nova-compute[72504]:         <value>passthrough</value>
Aug 01 19:45:16 user nova-compute[72504]:         <value>emulator</value>
Aug 01 19:45:16 user nova-compute[72504]:       </enum>
Aug 01 19:45:16 user nova-compute[72504]:     </tpm>
Aug 01 19:45:16 user nova-compute[72504]:   </devices>
Aug 01 19:45:16 user nova-compute[72504]:   <features>
Aug 01 19:45:16 user nova-compute[72504]:     <gic supported='no'/>
Aug 01 19:45:16 user nova-compute[72504]:     <vmcoreinfo supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <genid supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <backingStoreInput supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <backup supported='yes'/>
Aug 01 19:45:16 user nova-compute[72504]:     <sev supported='no'/>
Aug 01 19:45:16 user nova-compute[72504]:   </features>
Aug 01 19:45:16 user nova-compute[72504]: </domainCapabilities>
Aug 01 19:45:16 user nova-compute[72504]:  {{(pid=72504) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72504) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72504) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72504) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Checking secure boot support for host arch (x86_64) {{(pid=72504) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 01 19:45:16 user nova-compute[72504]: INFO nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Secure Boot support detected
Aug 01 19:45:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] cpu compare xml: <cpu match="exact">
Aug 01 19:45:16 user nova-compute[72504]:   <model>Nehalem</model>
Aug 01 19:45:16 user nova-compute[72504]: </cpu>
Aug 01 19:45:16 user nova-compute[72504]:  {{(pid=72504) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 01 19:45:16 user nova-compute[72504]: INFO nova.virt.node [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Generated node identity b951a798-e88c-472c-8347-2c5f6a05d47c
Aug 01 19:45:16 user nova-compute[72504]: INFO nova.virt.node [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Wrote node identity b951a798-e88c-472c-8347-2c5f6a05d47c to /opt/stack/data/nova/compute_id
Aug 01 19:45:16 user nova-compute[72504]: WARNING nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Compute nodes ['b951a798-e88c-472c-8347-2c5f6a05d47c'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 01 19:45:16 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 01 19:45:17 user nova-compute[72504]: WARNING nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 01 19:45:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:45:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:45:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:45:17 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:45:17 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:45:17 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:45:17 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Hypervisor/Node resource view: name=user free_ram=10913MB free_disk=26.209644317626953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:45:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:45:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:45:17 user nova-compute[72504]: WARNING nova.compute.resource_tracker [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] No compute node record for user:b951a798-e88c-472c-8347-2c5f6a05d47c: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host b951a798-e88c-472c-8347-2c5f6a05d47c could not be found.
Aug 01 19:45:17 user nova-compute[72504]: INFO nova.compute.resource_tracker [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Compute node record created for user:user with uuid: b951a798-e88c-472c-8347-2c5f6a05d47c
Aug 01 19:45:17 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:45:17 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:45:17 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [req-a73dc316-38e2-48cb-bdc6-00d477ab7a29] Created resource provider record via placement API for resource provider with UUID b951a798-e88c-472c-8347-2c5f6a05d47c and name user.
Aug 01 19:45:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72504) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 01 19:45:17 user nova-compute[72504]: INFO nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] kernel doesn't support AMD SEV
Aug 01 19:45:17 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Updating inventory in ProviderTree for provider b951a798-e88c-472c-8347-2c5f6a05d47c with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 19:45:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:45:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Libvirt baseline CPU <cpu>
Aug 01 19:45:17 user nova-compute[72504]:   <arch>x86_64</arch>
Aug 01 19:45:17 user nova-compute[72504]:   <model>Nehalem</model>
Aug 01 19:45:17 user nova-compute[72504]:   <vendor>Intel</vendor>
Aug 01 19:45:17 user nova-compute[72504]:   <topology sockets="6" cores="1" threads="1"/>
Aug 01 19:45:17 user nova-compute[72504]: </cpu>
Aug 01 19:45:17 user nova-compute[72504]:  {{(pid=72504) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 01 19:45:17 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Updated inventory for provider b951a798-e88c-472c-8347-2c5f6a05d47c with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 01 19:45:17 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Updating resource provider b951a798-e88c-472c-8347-2c5f6a05d47c generation from 0 to 1 during operation: update_inventory {{(pid=72504) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 01 19:45:17 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Updating inventory in ProviderTree for provider b951a798-e88c-472c-8347-2c5f6a05d47c with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 19:45:17 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Updating resource provider b951a798-e88c-472c-8347-2c5f6a05d47c generation from 1 to 2 during operation: update_traits {{(pid=72504) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 01 19:45:17 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:45:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.600s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:45:17 user nova-compute[72504]: DEBUG nova.service [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Creating RPC server for service compute {{(pid=72504) start /opt/stack/nova/nova/service.py:182}}
Aug 01 19:45:17 user nova-compute[72504]: DEBUG nova.service [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Join ServiceGroup membership for this service compute {{(pid=72504) start /opt/stack/nova/nova/service.py:199}}
Aug 01 19:45:17 user nova-compute[72504]: DEBUG nova.servicegroup.drivers.db [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72504) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 01 19:45:56 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:45:56 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:46:07 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:46:07 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:46:07 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:46:07 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 19:46:07 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Didn't find any instances for network info cache update. {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 19:46:07 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:46:07 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:46:07 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:46:07 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:46:07 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:46:07 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:46:07 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:46:07 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:46:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:46:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:46:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:46:07 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:46:08 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:46:08 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:46:08 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=10300MB free_disk=26.113449096679688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:46:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:46:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:46:08 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:46:08 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:46:08 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:46:08 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:46:08 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:46:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.116s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:47:08 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:47:08 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:47:08 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:47:08 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:47:08 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:47:08 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:47:08 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:47:08 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:47:09 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:47:09 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:47:09 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 19:47:09 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Didn't find any instances for network info cache update. {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 19:47:09 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:47:09 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:47:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:47:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:47:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:47:09 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:47:10 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:47:10 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:47:10 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=10232MB free_disk=26.159683227539062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:47:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:47:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:47:10 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:47:10 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:47:10 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:47:10 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:47:10 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:47:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:48:08 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:48:08 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:48:09 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:48:09 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:48:09 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:48:09 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:48:09 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:48:09 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:48:09 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:48:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:48:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:48:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:48:09 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:48:10 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:48:10 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:48:10 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=10218MB free_disk=25.93271255493164GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:48:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:48:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:48:10 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:48:10 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:48:10 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:48:10 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:48:10 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:48:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:48:11 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:48:11 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:48:11 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 19:48:11 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Didn't find any instances for network info cache update. {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 19:49:07 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:49:09 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:49:09 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:49:09 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:49:09 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:49:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:09 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:49:10 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:49:10 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:49:10 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=9520MB free_disk=25.963970184326172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:49:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:10 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:49:10 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:49:10 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:49:10 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:49:10 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:49:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:11 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:49:11 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:49:11 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:49:11 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:49:11 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:49:12 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:49:12 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:49:12 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 19:49:12 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Didn't find any instances for network info cache update. {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 19:49:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Acquiring lock "8eae5ffe-ab54-4dac-8169-69325448b92f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lock "8eae5ffe-ab54-4dac-8169-69325448b92f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:24 user nova-compute[72504]: DEBUG nova.compute.manager [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 19:49:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:24 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:49:24 user nova-compute[72504]: INFO nova.compute.claims [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Claim successful on node user
Aug 01 19:49:25 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:49:25 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:49:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.302s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:25 user nova-compute[72504]: DEBUG nova.compute.manager [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 19:49:25 user nova-compute[72504]: DEBUG nova.compute.manager [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 19:49:25 user nova-compute[72504]: DEBUG nova.network.neutron [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 19:49:25 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 19:49:25 user nova-compute[72504]: DEBUG nova.compute.manager [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 19:49:25 user nova-compute[72504]: DEBUG nova.compute.manager [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 19:49:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:49:25 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Creating image(s)
Aug 01 19:49:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Acquiring lock "/opt/stack/data/nova/instances/8eae5ffe-ab54-4dac-8169-69325448b92f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lock "/opt/stack/data/nova/instances/8eae5ffe-ab54-4dac-8169-69325448b92f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lock "/opt/stack/data/nova/instances/8eae5ffe-ab54-4dac-8169-69325448b92f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5.part --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:26 user nova-compute[72504]: DEBUG nova.policy [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0a266d46b9d84e1ab0385ddf2d4b0b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2371740586fa42249a5299af53448e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 19:49:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "39b3076d-ce59-4e7c-976f-9355bf2f6ff4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "39b3076d-ce59-4e7c-976f-9355bf2f6ff4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5.part --force-share --output=json" returned: 0 in 0.188s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:26 user nova-compute[72504]: DEBUG nova.virt.images [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] 3f5e9e2d-95fb-46b2-b205-6c41a2b0b089 was qcow2, converting to raw {{(pid=72504) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 19:49:26 user nova-compute[72504]: DEBUG nova.privsep.utils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72504) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 19:49:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5.part /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5.converted {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:26 user nova-compute[72504]: DEBUG nova.compute.manager [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 19:49:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:26 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:49:26 user nova-compute[72504]: INFO nova.compute.claims [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Claim successful on node user
Aug 01 19:49:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5.part /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5.converted" returned: 0 in 0.248s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5.converted --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "5193c770-80ca-44c3-9950-cb25c65e94e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:26 user nova-compute[72504]: DEBUG nova.compute.manager [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 19:49:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5.converted --force-share --output=json" returned: 0 in 0.160s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.349s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:26 user nova-compute[72504]: INFO oslo.privsep.daemon [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp_d65qfkv/privsep.sock']
Aug 01 19:49:26 user sudo[81659]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp_d65qfkv/privsep.sock
Aug 01 19:49:26 user sudo[81659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 01 19:49:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:26 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:49:26 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:49:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.297s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:27 user nova-compute[72504]: DEBUG nova.compute.manager [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 19:49:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.074s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:27 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:49:27 user nova-compute[72504]: INFO nova.compute.claims [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Claim successful on node user
Aug 01 19:49:27 user nova-compute[72504]: DEBUG nova.compute.manager [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 19:49:27 user nova-compute[72504]: DEBUG nova.network.neutron [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 19:49:27 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 19:49:27 user nova-compute[72504]: DEBUG nova.compute.manager [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 19:49:27 user nova-compute[72504]: DEBUG nova.compute.manager [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 19:49:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:49:27 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Creating image(s)
Aug 01 19:49:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "/opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "/opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "/opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:27 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:49:27 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:49:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:27 user nova-compute[72504]: DEBUG nova.compute.manager [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 19:49:27 user nova-compute[72504]: DEBUG nova.compute.manager [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 19:49:27 user nova-compute[72504]: DEBUG nova.network.neutron [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 19:49:27 user nova-compute[72504]: DEBUG nova.policy [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01263cb2c1874026be1c735abc966b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82898c99bce4f04afda7e9ff6e4d5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 19:49:27 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 19:49:27 user nova-compute[72504]: DEBUG nova.compute.manager [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 19:49:27 user nova-compute[72504]: DEBUG nova.compute.manager [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 19:49:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:49:27 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Creating image(s)
Aug 01 19:49:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "/opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "/opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "/opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:28 user nova-compute[72504]: DEBUG nova.policy [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '98fd620d741b433ba699e5bbbc5ae1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6958054d48748c68942fb4d36d5ca8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 19:49:28 user sudo[81659]: pam_unix(sudo:session): session closed for user root
Aug 01 19:49:28 user nova-compute[72504]: INFO oslo.privsep.daemon [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Spawned new privsep daemon via rootwrap
Aug 01 19:49:28 user nova-compute[72504]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 01 19:49:28 user nova-compute[72504]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 01 19:49:28 user nova-compute[72504]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 01 19:49:28 user nova-compute[72504]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81663
Aug 01 19:49:28 user nova-compute[72504]: WARNING oslo_privsep.priv_context [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] privsep daemon already running
Aug 01 19:49:28 user nova-compute[72504]: WARNING oslo_privsep.priv_context [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] privsep daemon already running
Aug 01 19:49:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.128s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.122s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.145s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/8eae5ffe-ab54-4dac-8169-69325448b92f/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/8eae5ffe-ab54-4dac-8169-69325448b92f/disk 1073741824" returned: 0 in 0.050s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG nova.network.neutron [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Successfully created port: a4953c19-ef72-4bbe-b271-40cc5162842d {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.202s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.171s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8eae5ffe-ab54-4dac-8169-69325448b92f/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eae5ffe-ab54-4dac-8169-69325448b92f/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.163s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk 1073741824" returned: 0 in 0.053s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.444s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eae5ffe-ab54-4dac-8169-69325448b92f/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Cannot resize image /opt/stack/data/nova/instances/8eae5ffe-ab54-4dac-8169-69325448b92f/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG nova.objects.instance [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lazy-loading 'migration_context' on Instance uuid 8eae5ffe-ab54-4dac-8169-69325448b92f {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Ensure instance console log exists: /opt/stack/data/nova/instances/8eae5ffe-ab54-4dac-8169-69325448b92f/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.159s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.162s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk 1073741824" returned: 0 in 0.053s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Cannot resize image /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG nova.objects.instance [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lazy-loading 'migration_context' on Instance uuid 5193c770-80ca-44c3-9950-cb25c65e94e8 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Ensure instance console log exists: /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.151s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Checking if we can resize image /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 19:49:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:30 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Cannot resize image /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 19:49:30 user nova-compute[72504]: DEBUG nova.objects.instance [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lazy-loading 'migration_context' on Instance uuid 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:49:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 19:49:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Ensure instance console log exists: /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:49:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:30 user nova-compute[72504]: DEBUG nova.network.neutron [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Successfully created port: 81de2627-8b32-47dc-ba79-56afa5d60500 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:49:30 user nova-compute[72504]: DEBUG nova.network.neutron [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Successfully updated port: a4953c19-ef72-4bbe-b271-40cc5162842d {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:49:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "refresh_cache-39b3076d-ce59-4e7c-976f-9355bf2f6ff4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:49:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquired lock "refresh_cache-39b3076d-ce59-4e7c-976f-9355bf2f6ff4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:49:31 user nova-compute[72504]: DEBUG nova.network.neutron [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:49:31 user nova-compute[72504]: DEBUG nova.compute.manager [req-c4a1500b-750a-4a1b-aa2a-87a84292c52b req-70cc8eca-189c-47b6-b5bd-142231e3fa42 service nova] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Received event network-changed-a4953c19-ef72-4bbe-b271-40cc5162842d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:49:31 user nova-compute[72504]: DEBUG nova.compute.manager [req-c4a1500b-750a-4a1b-aa2a-87a84292c52b req-70cc8eca-189c-47b6-b5bd-142231e3fa42 service nova] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Refreshing instance network info cache due to event network-changed-a4953c19-ef72-4bbe-b271-40cc5162842d. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:49:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c4a1500b-750a-4a1b-aa2a-87a84292c52b req-70cc8eca-189c-47b6-b5bd-142231e3fa42 service nova] Acquiring lock "refresh_cache-39b3076d-ce59-4e7c-976f-9355bf2f6ff4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:49:31 user nova-compute[72504]: DEBUG nova.network.neutron [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:49:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:31 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:49:32 user nova-compute[72504]: INFO nova.compute.claims [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Claim successful on node user
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.network.neutron [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Successfully created port: 8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.network.neutron [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 19:49:32 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.network.neutron [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Updating instance_info_cache with network_info: [{"id": "a4953c19-ef72-4bbe-b271-40cc5162842d", "address": "fa:16:3e:86:10:53", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4953c19-ef", "ovs_interfaceid": "a4953c19-ef72-4bbe-b271-40cc5162842d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Releasing lock "refresh_cache-39b3076d-ce59-4e7c-976f-9355bf2f6ff4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.compute.manager [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Instance network_info: |[{"id": "a4953c19-ef72-4bbe-b271-40cc5162842d", "address": "fa:16:3e:86:10:53", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4953c19-ef", "ovs_interfaceid": "a4953c19-ef72-4bbe-b271-40cc5162842d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c4a1500b-750a-4a1b-aa2a-87a84292c52b req-70cc8eca-189c-47b6-b5bd-142231e3fa42 service nova] Acquired lock "refresh_cache-39b3076d-ce59-4e7c-976f-9355bf2f6ff4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.network.neutron [req-c4a1500b-750a-4a1b-aa2a-87a84292c52b req-70cc8eca-189c-47b6-b5bd-142231e3fa42 service nova] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Refreshing network info cache for port a4953c19-ef72-4bbe-b271-40cc5162842d {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Start _get_guest_xml network_info=[{"id": "a4953c19-ef72-4bbe-b271-40cc5162842d", "address": "fa:16:3e:86:10:53", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4953c19-ef", "ovs_interfaceid": "a4953c19-ef72-4bbe-b271-40cc5162842d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:49:32 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:49:32 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.privsep.utils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72504) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:49:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-348118529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-348118529',id=2,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b82898c99bce4f04afda7e9ff6e4d5db',ramdisk_id='',reservation_id='r-kgrbxdal',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-519115368',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:49:27Z,user_data=None,user_id='01263cb2c1874026be1c735abc966b45',uuid=39b3076d-ce59-4e7c-976f-9355bf2f6ff4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4953c19-ef72-4bbe-b271-40cc5162842d", "address": "fa:16:3e:86:10:53", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4953c19-ef", "ovs_interfaceid": "a4953c19-ef72-4bbe-b271-40cc5162842d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Converting VIF {"id": "a4953c19-ef72-4bbe-b271-40cc5162842d", "address": "fa:16:3e:86:10:53", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4953c19-ef", "ovs_interfaceid": "a4953c19-ef72-4bbe-b271-40cc5162842d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:10:53,bridge_name='br-int',has_traffic_filtering=True,id=a4953c19-ef72-4bbe-b271-40cc5162842d,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4953c19-ef') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.objects.instance [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lazy-loading 'pci_devices' on Instance uuid 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:49:32 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Creating image(s)
Aug 01 19:49:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "/opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "/opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "/opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:49:32 user nova-compute[72504]:   <uuid>39b3076d-ce59-4e7c-976f-9355bf2f6ff4</uuid>
Aug 01 19:49:32 user nova-compute[72504]:   <name>instance-00000002</name>
Aug 01 19:49:32 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:49:32 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:49:32 user nova-compute[72504]:   <metadata>
Aug 01 19:49:32 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:49:32 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:49:32 user nova-compute[72504]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-348118529</nova:name>
Aug 01 19:49:32 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:49:32</nova:creationTime>
Aug 01 19:49:32 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:49:32 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:49:32 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:49:32 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:49:32 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:49:32 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:49:32 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:49:32 user nova-compute[72504]:       <nova:owner>
Aug 01 19:49:32 user nova-compute[72504]:         <nova:user uuid="01263cb2c1874026be1c735abc966b45">tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member</nova:user>
Aug 01 19:49:32 user nova-compute[72504]:         <nova:project uuid="b82898c99bce4f04afda7e9ff6e4d5db">tempest-ServerBootFromVolumeStableRescueTest-519115368</nova:project>
Aug 01 19:49:32 user nova-compute[72504]:       </nova:owner>
Aug 01 19:49:32 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:49:32 user nova-compute[72504]:       <nova:ports>
Aug 01 19:49:32 user nova-compute[72504]:         <nova:port uuid="a4953c19-ef72-4bbe-b271-40cc5162842d">
Aug 01 19:49:32 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 19:49:32 user nova-compute[72504]:         </nova:port>
Aug 01 19:49:32 user nova-compute[72504]:       </nova:ports>
Aug 01 19:49:32 user nova-compute[72504]:     </nova:instance>
Aug 01 19:49:32 user nova-compute[72504]:   </metadata>
Aug 01 19:49:32 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:49:32 user nova-compute[72504]:     <system>
Aug 01 19:49:32 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:49:32 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:49:32 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:49:32 user nova-compute[72504]:       <entry name="serial">39b3076d-ce59-4e7c-976f-9355bf2f6ff4</entry>
Aug 01 19:49:32 user nova-compute[72504]:       <entry name="uuid">39b3076d-ce59-4e7c-976f-9355bf2f6ff4</entry>
Aug 01 19:49:32 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:49:32 user nova-compute[72504]:     </system>
Aug 01 19:49:32 user nova-compute[72504]:   </sysinfo>
Aug 01 19:49:32 user nova-compute[72504]:   <os>
Aug 01 19:49:32 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:49:32 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:49:32 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:49:32 user nova-compute[72504]:   </os>
Aug 01 19:49:32 user nova-compute[72504]:   <features>
Aug 01 19:49:32 user nova-compute[72504]:     <acpi/>
Aug 01 19:49:32 user nova-compute[72504]:     <apic/>
Aug 01 19:49:32 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:49:32 user nova-compute[72504]:   </features>
Aug 01 19:49:32 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:49:32 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:49:32 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:49:32 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:49:32 user nova-compute[72504]:   </clock>
Aug 01 19:49:32 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:49:32 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:49:32 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:49:32 user nova-compute[72504]:   </cpu>
Aug 01 19:49:32 user nova-compute[72504]:   <devices>
Aug 01 19:49:32 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:49:32 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:49:32 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk"/>
Aug 01 19:49:32 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:49:32 user nova-compute[72504]:     </disk>
Aug 01 19:49:32 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:49:32 user nova-compute[72504]:       <mac address="fa:16:3e:86:10:53"/>
Aug 01 19:49:32 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:49:32 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:49:32 user nova-compute[72504]:       <target dev="tapa4953c19-ef"/>
Aug 01 19:49:32 user nova-compute[72504]:     </interface>
Aug 01 19:49:32 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:49:32 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/console.log" append="off"/>
Aug 01 19:49:32 user nova-compute[72504]:     </serial>
Aug 01 19:49:32 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:49:32 user nova-compute[72504]:     <video>
Aug 01 19:49:32 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:49:32 user nova-compute[72504]:     </video>
Aug 01 19:49:32 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:49:32 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:49:32 user nova-compute[72504]:     </rng>
Aug 01 19:49:32 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:49:32 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:49:32 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:49:32 user nova-compute[72504]:     </memballoon>
Aug 01 19:49:32 user nova-compute[72504]:   </devices>
Aug 01 19:49:32 user nova-compute[72504]: </domain>
Aug 01 19:49:32 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:49:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-348118529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-348118529',id=2,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b82898c99bce4f04afda7e9ff6e4d5db',ramdisk_id='',reservation_id='r-kgrbxdal',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-519115368',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:49:27Z,user_data=None,user_id='01263cb2c1874026be1c735abc966b45',uuid=39b3076d-ce59-4e7c-976f-9355bf2f6ff4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4953c19-ef72-4bbe-b271-40cc5162842d", "address": "fa:16:3e:86:10:53", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4953c19-ef", "ovs_interfaceid": "a4953c19-ef72-4bbe-b271-40cc5162842d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Converting VIF {"id": "a4953c19-ef72-4bbe-b271-40cc5162842d", "address": "fa:16:3e:86:10:53", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4953c19-ef", "ovs_interfaceid": "a4953c19-ef72-4bbe-b271-40cc5162842d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:10:53,bridge_name='br-int',has_traffic_filtering=True,id=a4953c19-ef72-4bbe-b271-40cc5162842d,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4953c19-ef') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG os_vif [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:10:53,bridge_name='br-int',has_traffic_filtering=True,id=a4953c19-ef72-4bbe-b271-40cc5162842d,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4953c19-ef') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Created schema index Interface.name {{(pid=72504) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Created schema index Port.name {{(pid=72504) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Created schema index Bridge.name {{(pid=72504) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "1de87977-532f-45f7-856b-84df41b2a567" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "1de87977-532f-45f7-856b-84df41b2a567" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [POLLOUT] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.143s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG nova.policy [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6260679430fa4828b07bc890c62878c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04aaa8143b44d5aa21f59a89cd57ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 19:49:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:49:33 user nova-compute[72504]: INFO oslo.privsep.daemon [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmphxn5dtwk/privsep.sock']
Aug 01 19:49:33 user sudo[81720]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmphxn5dtwk/privsep.sock
Aug 01 19:49:33 user sudo[81720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 01 19:49:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.163s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:49:33 user nova-compute[72504]: INFO nova.compute.claims [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Claim successful on node user
Aug 01 19:49:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk 1073741824" returned: 0 in 0.065s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.155s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Cannot resize image /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG nova.objects.instance [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lazy-loading 'migration_context' on Instance uuid 76aa3861-0ca1-4e7f-9a15-9219037bc1ee {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Ensure instance console log exists: /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG nova.network.neutron [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 19:49:33 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 19:49:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:49:33 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Creating image(s)
Aug 01 19:49:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "/opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "/opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "/opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG nova.policy [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '451baacc96384f35bd8bbb87626ac52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cc01820f324654b0959d5fb2adefc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.153s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:34 user nova-compute[72504]: DEBUG nova.network.neutron [req-c4a1500b-750a-4a1b-aa2a-87a84292c52b req-70cc8eca-189c-47b6-b5bd-142231e3fa42 service nova] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Updated VIF entry in instance network info cache for port a4953c19-ef72-4bbe-b271-40cc5162842d. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:49:34 user nova-compute[72504]: DEBUG nova.network.neutron [req-c4a1500b-750a-4a1b-aa2a-87a84292c52b req-70cc8eca-189c-47b6-b5bd-142231e3fa42 service nova] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Updating instance_info_cache with network_info: [{"id": "a4953c19-ef72-4bbe-b271-40cc5162842d", "address": "fa:16:3e:86:10:53", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4953c19-ef", "ovs_interfaceid": "a4953c19-ef72-4bbe-b271-40cc5162842d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:49:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c4a1500b-750a-4a1b-aa2a-87a84292c52b req-70cc8eca-189c-47b6-b5bd-142231e3fa42 service nova] Releasing lock "refresh_cache-39b3076d-ce59-4e7c-976f-9355bf2f6ff4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:49:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.172s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk 1073741824" returned: 0 in 0.048s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.151s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:34 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 19:49:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:34 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Cannot resize image /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 19:49:34 user nova-compute[72504]: DEBUG nova.objects.instance [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lazy-loading 'migration_context' on Instance uuid 1de87977-532f-45f7-856b-84df41b2a567 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:49:34 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 19:49:34 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Ensure instance console log exists: /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:49:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:34 user sudo[81720]: pam_unix(sudo:session): session closed for user root
Aug 01 19:49:34 user nova-compute[72504]: INFO oslo.privsep.daemon [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Spawned new privsep daemon via rootwrap
Aug 01 19:49:34 user nova-compute[72504]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 01 19:49:34 user nova-compute[72504]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 01 19:49:34 user nova-compute[72504]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 01 19:49:34 user nova-compute[72504]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81749
Aug 01 19:49:34 user nova-compute[72504]: DEBUG nova.network.neutron [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Successfully updated port: 81de2627-8b32-47dc-ba79-56afa5d60500 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:49:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Acquiring lock "refresh_cache-8eae5ffe-ab54-4dac-8169-69325448b92f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:49:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Acquired lock "refresh_cache-8eae5ffe-ab54-4dac-8169-69325448b92f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:49:34 user nova-compute[72504]: DEBUG nova.network.neutron [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:49:35 user nova-compute[72504]: DEBUG nova.network.neutron [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:49:35 user nova-compute[72504]: DEBUG nova.compute.manager [req-f2da1574-69a5-4dd3-903e-b3cad416f8d2 req-379e2e18-efad-4122-be87-d5ead15d7f17 service nova] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Received event network-changed-81de2627-8b32-47dc-ba79-56afa5d60500 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:49:35 user nova-compute[72504]: DEBUG nova.compute.manager [req-f2da1574-69a5-4dd3-903e-b3cad416f8d2 req-379e2e18-efad-4122-be87-d5ead15d7f17 service nova] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Refreshing instance network info cache due to event network-changed-81de2627-8b32-47dc-ba79-56afa5d60500. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:49:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f2da1574-69a5-4dd3-903e-b3cad416f8d2 req-379e2e18-efad-4122-be87-d5ead15d7f17 service nova] Acquiring lock "refresh_cache-8eae5ffe-ab54-4dac-8169-69325448b92f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:49:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4953c19-ef, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:49:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa4953c19-ef, col_values=(('external_ids', {'iface-id': 'a4953c19-ef72-4bbe-b271-40cc5162842d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:10:53', 'vm-uuid': '39b3076d-ce59-4e7c-976f-9355bf2f6ff4'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:49:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:49:35 user nova-compute[72504]: INFO os_vif [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:10:53,bridge_name='br-int',has_traffic_filtering=True,id=a4953c19-ef72-4bbe-b271-40cc5162842d,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4953c19-ef')
Aug 01 19:49:35 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:49:35 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] No VIF found with MAC fa:16:3e:86:10:53, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:49:35 user nova-compute[72504]: DEBUG nova.network.neutron [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Successfully created port: 5ecd0d2b-2f55-49b1-8858-3ab96e942b4f {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.network.neutron [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Successfully updated port: 8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "refresh_cache-5193c770-80ca-44c3-9950-cb25c65e94e8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquired lock "refresh_cache-5193c770-80ca-44c3-9950-cb25c65e94e8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.network.neutron [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.network.neutron [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Successfully created port: 2edbeaad-cd66-4a79-9fae-544f2a33e922 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.network.neutron [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.network.neutron [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Updating instance_info_cache with network_info: [{"id": "81de2627-8b32-47dc-ba79-56afa5d60500", "address": "fa:16:3e:8d:56:4a", "network": {"id": "e40d9428-7acd-446e-ae33-f0da22181354", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1238785586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2371740586fa42249a5299af53448e5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81de2627-8b", "ovs_interfaceid": "81de2627-8b32-47dc-ba79-56afa5d60500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Releasing lock "refresh_cache-8eae5ffe-ab54-4dac-8169-69325448b92f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.compute.manager [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Instance network_info: |[{"id": "81de2627-8b32-47dc-ba79-56afa5d60500", "address": "fa:16:3e:8d:56:4a", "network": {"id": "e40d9428-7acd-446e-ae33-f0da22181354", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1238785586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2371740586fa42249a5299af53448e5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81de2627-8b", "ovs_interfaceid": "81de2627-8b32-47dc-ba79-56afa5d60500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f2da1574-69a5-4dd3-903e-b3cad416f8d2 req-379e2e18-efad-4122-be87-d5ead15d7f17 service nova] Acquired lock "refresh_cache-8eae5ffe-ab54-4dac-8169-69325448b92f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.network.neutron [req-f2da1574-69a5-4dd3-903e-b3cad416f8d2 req-379e2e18-efad-4122-be87-d5ead15d7f17 service nova] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Refreshing network info cache for port 81de2627-8b32-47dc-ba79-56afa5d60500 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Start _get_guest_xml network_info=[{"id": "81de2627-8b32-47dc-ba79-56afa5d60500", "address": "fa:16:3e:8d:56:4a", "network": {"id": "e40d9428-7acd-446e-ae33-f0da22181354", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1238785586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2371740586fa42249a5299af53448e5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81de2627-8b", "ovs_interfaceid": "81de2627-8b32-47dc-ba79-56afa5d60500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:49:36 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:49:36 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1316361796',display_name='tempest-DeleteServersTestJSON-server-1316361796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1316361796',id=1,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2371740586fa42249a5299af53448e5a',ramdisk_id='',reservation_id='r-25eer93s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1074648156',owner_user_name='tempest-DeleteServersTestJSON-1074648156-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:49:25Z,user_data=None,user_id='0a266d46b9d84e1ab0385ddf2d4b0b6f',uuid=8eae5ffe-ab54-4dac-8169-69325448b92f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81de2627-8b32-47dc-ba79-56afa5d60500", "address": "fa:16:3e:8d:56:4a", "network": {"id": "e40d9428-7acd-446e-ae33-f0da22181354", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1238785586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2371740586fa42249a5299af53448e5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81de2627-8b", "ovs_interfaceid": "81de2627-8b32-47dc-ba79-56afa5d60500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Converting VIF {"id": "81de2627-8b32-47dc-ba79-56afa5d60500", "address": "fa:16:3e:8d:56:4a", "network": {"id": "e40d9428-7acd-446e-ae33-f0da22181354", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1238785586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2371740586fa42249a5299af53448e5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81de2627-8b", "ovs_interfaceid": "81de2627-8b32-47dc-ba79-56afa5d60500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:56:4a,bridge_name='br-int',has_traffic_filtering=True,id=81de2627-8b32-47dc-ba79-56afa5d60500,network=Network(e40d9428-7acd-446e-ae33-f0da22181354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81de2627-8b') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.objects.instance [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lazy-loading 'pci_devices' on Instance uuid 8eae5ffe-ab54-4dac-8169-69325448b92f {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:49:36 user nova-compute[72504]:   <uuid>8eae5ffe-ab54-4dac-8169-69325448b92f</uuid>
Aug 01 19:49:36 user nova-compute[72504]:   <name>instance-00000001</name>
Aug 01 19:49:36 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:49:36 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:49:36 user nova-compute[72504]:   <metadata>
Aug 01 19:49:36 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:49:36 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:49:36 user nova-compute[72504]:       <nova:name>tempest-DeleteServersTestJSON-server-1316361796</nova:name>
Aug 01 19:49:36 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:49:36</nova:creationTime>
Aug 01 19:49:36 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:49:36 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:49:36 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:49:36 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:49:36 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:49:36 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:49:36 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:49:36 user nova-compute[72504]:       <nova:owner>
Aug 01 19:49:36 user nova-compute[72504]:         <nova:user uuid="0a266d46b9d84e1ab0385ddf2d4b0b6f">tempest-DeleteServersTestJSON-1074648156-project-member</nova:user>
Aug 01 19:49:36 user nova-compute[72504]:         <nova:project uuid="2371740586fa42249a5299af53448e5a">tempest-DeleteServersTestJSON-1074648156</nova:project>
Aug 01 19:49:36 user nova-compute[72504]:       </nova:owner>
Aug 01 19:49:36 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:49:36 user nova-compute[72504]:       <nova:ports>
Aug 01 19:49:36 user nova-compute[72504]:         <nova:port uuid="81de2627-8b32-47dc-ba79-56afa5d60500">
Aug 01 19:49:36 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 19:49:36 user nova-compute[72504]:         </nova:port>
Aug 01 19:49:36 user nova-compute[72504]:       </nova:ports>
Aug 01 19:49:36 user nova-compute[72504]:     </nova:instance>
Aug 01 19:49:36 user nova-compute[72504]:   </metadata>
Aug 01 19:49:36 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:49:36 user nova-compute[72504]:     <system>
Aug 01 19:49:36 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:49:36 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:49:36 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:49:36 user nova-compute[72504]:       <entry name="serial">8eae5ffe-ab54-4dac-8169-69325448b92f</entry>
Aug 01 19:49:36 user nova-compute[72504]:       <entry name="uuid">8eae5ffe-ab54-4dac-8169-69325448b92f</entry>
Aug 01 19:49:36 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:49:36 user nova-compute[72504]:     </system>
Aug 01 19:49:36 user nova-compute[72504]:   </sysinfo>
Aug 01 19:49:36 user nova-compute[72504]:   <os>
Aug 01 19:49:36 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:49:36 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:49:36 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:49:36 user nova-compute[72504]:   </os>
Aug 01 19:49:36 user nova-compute[72504]:   <features>
Aug 01 19:49:36 user nova-compute[72504]:     <acpi/>
Aug 01 19:49:36 user nova-compute[72504]:     <apic/>
Aug 01 19:49:36 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:49:36 user nova-compute[72504]:   </features>
Aug 01 19:49:36 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:49:36 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:49:36 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:49:36 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:49:36 user nova-compute[72504]:   </clock>
Aug 01 19:49:36 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:49:36 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:49:36 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:49:36 user nova-compute[72504]:   </cpu>
Aug 01 19:49:36 user nova-compute[72504]:   <devices>
Aug 01 19:49:36 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:49:36 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:49:36 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/8eae5ffe-ab54-4dac-8169-69325448b92f/disk"/>
Aug 01 19:49:36 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:49:36 user nova-compute[72504]:     </disk>
Aug 01 19:49:36 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:49:36 user nova-compute[72504]:       <mac address="fa:16:3e:8d:56:4a"/>
Aug 01 19:49:36 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:49:36 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:49:36 user nova-compute[72504]:       <target dev="tap81de2627-8b"/>
Aug 01 19:49:36 user nova-compute[72504]:     </interface>
Aug 01 19:49:36 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:49:36 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/8eae5ffe-ab54-4dac-8169-69325448b92f/console.log" append="off"/>
Aug 01 19:49:36 user nova-compute[72504]:     </serial>
Aug 01 19:49:36 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:49:36 user nova-compute[72504]:     <video>
Aug 01 19:49:36 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:49:36 user nova-compute[72504]:     </video>
Aug 01 19:49:36 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:49:36 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:49:36 user nova-compute[72504]:     </rng>
Aug 01 19:49:36 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:49:36 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:49:36 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:49:36 user nova-compute[72504]:     </memballoon>
Aug 01 19:49:36 user nova-compute[72504]:   </devices>
Aug 01 19:49:36 user nova-compute[72504]: </domain>
Aug 01 19:49:36 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1316361796',display_name='tempest-DeleteServersTestJSON-server-1316361796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1316361796',id=1,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2371740586fa42249a5299af53448e5a',ramdisk_id='',reservation_id='r-25eer93s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1074648156',owner_user_name='tempest-DeleteServersTestJSON-1074648156-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:49:25Z,user_data=None,user_id='0a266d46b9d84e1ab0385ddf2d4b0b6f',uuid=8eae5ffe-ab54-4dac-8169-69325448b92f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81de2627-8b32-47dc-ba79-56afa5d60500", "address": "fa:16:3e:8d:56:4a", "network": {"id": "e40d9428-7acd-446e-ae33-f0da22181354", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1238785586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2371740586fa42249a5299af53448e5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81de2627-8b", "ovs_interfaceid": "81de2627-8b32-47dc-ba79-56afa5d60500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Converting VIF {"id": "81de2627-8b32-47dc-ba79-56afa5d60500", "address": "fa:16:3e:8d:56:4a", "network": {"id": "e40d9428-7acd-446e-ae33-f0da22181354", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1238785586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2371740586fa42249a5299af53448e5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81de2627-8b", "ovs_interfaceid": "81de2627-8b32-47dc-ba79-56afa5d60500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:56:4a,bridge_name='br-int',has_traffic_filtering=True,id=81de2627-8b32-47dc-ba79-56afa5d60500,network=Network(e40d9428-7acd-446e-ae33-f0da22181354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81de2627-8b') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG os_vif [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:56:4a,bridge_name='br-int',has_traffic_filtering=True,id=81de2627-8b32-47dc-ba79-56afa5d60500,network=Network(e40d9428-7acd-446e-ae33-f0da22181354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81de2627-8b') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81de2627-8b, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap81de2627-8b, col_values=(('external_ids', {'iface-id': '81de2627-8b32-47dc-ba79-56afa5d60500', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:56:4a', 'vm-uuid': '8eae5ffe-ab54-4dac-8169-69325448b92f'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:36 user nova-compute[72504]: INFO os_vif [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:56:4a,bridge_name='br-int',has_traffic_filtering=True,id=81de2627-8b32-47dc-ba79-56afa5d60500,network=Network(e40d9428-7acd-446e-ae33-f0da22181354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81de2627-8b')
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] No VIF found with MAC fa:16:3e:8d:56:4a, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.compute.manager [req-12890658-7cfb-4bdd-ad94-e819a69fd503 req-f2893b60-55c0-4860-a114-f489faf208ea service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Received event network-changed-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.compute.manager [req-12890658-7cfb-4bdd-ad94-e819a69fd503 req-f2893b60-55c0-4860-a114-f489faf208ea service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Refreshing instance network info cache due to event network-changed-8f1cca03-e1f6-44db-b8d3-d7a305fc1461. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-12890658-7cfb-4bdd-ad94-e819a69fd503 req-f2893b60-55c0-4860-a114-f489faf208ea service nova] Acquiring lock "refresh_cache-5193c770-80ca-44c3-9950-cb25c65e94e8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.network.neutron [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Updating instance_info_cache with network_info: [{"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Releasing lock "refresh_cache-5193c770-80ca-44c3-9950-cb25c65e94e8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.compute.manager [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Instance network_info: |[{"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-12890658-7cfb-4bdd-ad94-e819a69fd503 req-f2893b60-55c0-4860-a114-f489faf208ea service nova] Acquired lock "refresh_cache-5193c770-80ca-44c3-9950-cb25c65e94e8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.network.neutron [req-12890658-7cfb-4bdd-ad94-e819a69fd503 req-f2893b60-55c0-4860-a114-f489faf208ea service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Refreshing network info cache for port 8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Start _get_guest_xml network_info=[{"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:49:37 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:49:37 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:49:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1940907332',display_name='tempest-ServerActionsTestOtherB-server-1940907332',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1940907332',id=3,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzhjBwv/fwyuXjW1x6h8vd/kIx1PP+lp3UGnSLHNEmFgbtKuVpQ2lyUbVPsnNcWUwbyAFXlofeww/O420ZBkncMBF2kewUMxpZllUL90MSl7NE91UoBCSbwKPcmnMcunA==',key_name='tempest-keypair-1272671103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6958054d48748c68942fb4d36d5ca8b',ramdisk_id='',reservation_id='r-uhmjifqg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1731713993',owner_user_name='tempest-ServerActionsTestOtherB-1731713993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:49:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98fd620d741b433ba699e5bbbc5ae1c0',uuid=5193c770-80ca-44c3-9950-cb25c65e94e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Converting VIF {"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:8a:a8,bridge_name='br-int',has_traffic_filtering=True,id=8f1cca03-e1f6-44db-b8d3-d7a305fc1461,network=Network(a1278c28-de03-4929-8689-60655553da2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cca03-e1') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.objects.instance [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lazy-loading 'pci_devices' on Instance uuid 5193c770-80ca-44c3-9950-cb25c65e94e8 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:49:37 user nova-compute[72504]:   <uuid>5193c770-80ca-44c3-9950-cb25c65e94e8</uuid>
Aug 01 19:49:37 user nova-compute[72504]:   <name>instance-00000003</name>
Aug 01 19:49:37 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:49:37 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:49:37 user nova-compute[72504]:   <metadata>
Aug 01 19:49:37 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:49:37 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:49:37 user nova-compute[72504]:       <nova:name>tempest-ServerActionsTestOtherB-server-1940907332</nova:name>
Aug 01 19:49:37 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:49:37</nova:creationTime>
Aug 01 19:49:37 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:49:37 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:49:37 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:49:37 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:49:37 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:49:37 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:49:37 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:49:37 user nova-compute[72504]:       <nova:owner>
Aug 01 19:49:37 user nova-compute[72504]:         <nova:user uuid="98fd620d741b433ba699e5bbbc5ae1c0">tempest-ServerActionsTestOtherB-1731713993-project-member</nova:user>
Aug 01 19:49:37 user nova-compute[72504]:         <nova:project uuid="b6958054d48748c68942fb4d36d5ca8b">tempest-ServerActionsTestOtherB-1731713993</nova:project>
Aug 01 19:49:37 user nova-compute[72504]:       </nova:owner>
Aug 01 19:49:37 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:49:37 user nova-compute[72504]:       <nova:ports>
Aug 01 19:49:37 user nova-compute[72504]:         <nova:port uuid="8f1cca03-e1f6-44db-b8d3-d7a305fc1461">
Aug 01 19:49:37 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 19:49:37 user nova-compute[72504]:         </nova:port>
Aug 01 19:49:37 user nova-compute[72504]:       </nova:ports>
Aug 01 19:49:37 user nova-compute[72504]:     </nova:instance>
Aug 01 19:49:37 user nova-compute[72504]:   </metadata>
Aug 01 19:49:37 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:49:37 user nova-compute[72504]:     <system>
Aug 01 19:49:37 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:49:37 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:49:37 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:49:37 user nova-compute[72504]:       <entry name="serial">5193c770-80ca-44c3-9950-cb25c65e94e8</entry>
Aug 01 19:49:37 user nova-compute[72504]:       <entry name="uuid">5193c770-80ca-44c3-9950-cb25c65e94e8</entry>
Aug 01 19:49:37 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:49:37 user nova-compute[72504]:     </system>
Aug 01 19:49:37 user nova-compute[72504]:   </sysinfo>
Aug 01 19:49:37 user nova-compute[72504]:   <os>
Aug 01 19:49:37 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:49:37 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:49:37 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:49:37 user nova-compute[72504]:   </os>
Aug 01 19:49:37 user nova-compute[72504]:   <features>
Aug 01 19:49:37 user nova-compute[72504]:     <acpi/>
Aug 01 19:49:37 user nova-compute[72504]:     <apic/>
Aug 01 19:49:37 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:49:37 user nova-compute[72504]:   </features>
Aug 01 19:49:37 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:49:37 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:49:37 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:49:37 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:49:37 user nova-compute[72504]:   </clock>
Aug 01 19:49:37 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:49:37 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:49:37 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:49:37 user nova-compute[72504]:   </cpu>
Aug 01 19:49:37 user nova-compute[72504]:   <devices>
Aug 01 19:49:37 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:49:37 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:49:37 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk"/>
Aug 01 19:49:37 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:49:37 user nova-compute[72504]:     </disk>
Aug 01 19:49:37 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:49:37 user nova-compute[72504]:       <mac address="fa:16:3e:46:8a:a8"/>
Aug 01 19:49:37 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:49:37 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:49:37 user nova-compute[72504]:       <target dev="tap8f1cca03-e1"/>
Aug 01 19:49:37 user nova-compute[72504]:     </interface>
Aug 01 19:49:37 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:49:37 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/console.log" append="off"/>
Aug 01 19:49:37 user nova-compute[72504]:     </serial>
Aug 01 19:49:37 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:49:37 user nova-compute[72504]:     <video>
Aug 01 19:49:37 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:49:37 user nova-compute[72504]:     </video>
Aug 01 19:49:37 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:49:37 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:49:37 user nova-compute[72504]:     </rng>
Aug 01 19:49:37 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:49:37 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:49:37 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:49:37 user nova-compute[72504]:     </memballoon>
Aug 01 19:49:37 user nova-compute[72504]:   </devices>
Aug 01 19:49:37 user nova-compute[72504]: </domain>
Aug 01 19:49:37 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:49:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1940907332',display_name='tempest-ServerActionsTestOtherB-server-1940907332',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1940907332',id=3,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzhjBwv/fwyuXjW1x6h8vd/kIx1PP+lp3UGnSLHNEmFgbtKuVpQ2lyUbVPsnNcWUwbyAFXlofeww/O420ZBkncMBF2kewUMxpZllUL90MSl7NE91UoBCSbwKPcmnMcunA==',key_name='tempest-keypair-1272671103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6958054d48748c68942fb4d36d5ca8b',ramdisk_id='',reservation_id='r-uhmjifqg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1731713993',owner_user_name='tempest-ServerActionsTestOtherB-1731713993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:49:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98fd620d741b433ba699e5bbbc5ae1c0',uuid=5193c770-80ca-44c3-9950-cb25c65e94e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Converting VIF {"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:8a:a8,bridge_name='br-int',has_traffic_filtering=True,id=8f1cca03-e1f6-44db-b8d3-d7a305fc1461,network=Network(a1278c28-de03-4929-8689-60655553da2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cca03-e1') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG os_vif [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:8a:a8,bridge_name='br-int',has_traffic_filtering=True,id=8f1cca03-e1f6-44db-b8d3-d7a305fc1461,network=Network(a1278c28-de03-4929-8689-60655553da2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cca03-e1') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f1cca03-e1, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8f1cca03-e1, col_values=(('external_ids', {'iface-id': '8f1cca03-e1f6-44db-b8d3-d7a305fc1461', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:8a:a8', 'vm-uuid': '5193c770-80ca-44c3-9950-cb25c65e94e8'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:37 user nova-compute[72504]: INFO os_vif [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:8a:a8,bridge_name='br-int',has_traffic_filtering=True,id=8f1cca03-e1f6-44db-b8d3-d7a305fc1461,network=Network(a1278c28-de03-4929-8689-60655553da2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cca03-e1')
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:49:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] No VIF found with MAC fa:16:3e:46:8a:a8, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.network.neutron [req-f2da1574-69a5-4dd3-903e-b3cad416f8d2 req-379e2e18-efad-4122-be87-d5ead15d7f17 service nova] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Updated VIF entry in instance network info cache for port 81de2627-8b32-47dc-ba79-56afa5d60500. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.network.neutron [req-f2da1574-69a5-4dd3-903e-b3cad416f8d2 req-379e2e18-efad-4122-be87-d5ead15d7f17 service nova] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Updating instance_info_cache with network_info: [{"id": "81de2627-8b32-47dc-ba79-56afa5d60500", "address": "fa:16:3e:8d:56:4a", "network": {"id": "e40d9428-7acd-446e-ae33-f0da22181354", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1238785586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2371740586fa42249a5299af53448e5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81de2627-8b", "ovs_interfaceid": "81de2627-8b32-47dc-ba79-56afa5d60500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f2da1574-69a5-4dd3-903e-b3cad416f8d2 req-379e2e18-efad-4122-be87-d5ead15d7f17 service nova] Releasing lock "refresh_cache-8eae5ffe-ab54-4dac-8169-69325448b92f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.network.neutron [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Successfully updated port: 5ecd0d2b-2f55-49b1-8858-3ab96e942b4f {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "refresh_cache-1de87977-532f-45f7-856b-84df41b2a567" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquired lock "refresh_cache-1de87977-532f-45f7-856b-84df41b2a567" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.network.neutron [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.network.neutron [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.compute.manager [req-7c64f37f-2de6-4b88-93b1-de17eead6246 req-2e0e720b-00d2-4cc6-bdd9-bf4a6c5cf032 service nova] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Received event network-changed-5ecd0d2b-2f55-49b1-8858-3ab96e942b4f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.compute.manager [req-7c64f37f-2de6-4b88-93b1-de17eead6246 req-2e0e720b-00d2-4cc6-bdd9-bf4a6c5cf032 service nova] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Refreshing instance network info cache due to event network-changed-5ecd0d2b-2f55-49b1-8858-3ab96e942b4f. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7c64f37f-2de6-4b88-93b1-de17eead6246 req-2e0e720b-00d2-4cc6-bdd9-bf4a6c5cf032 service nova] Acquiring lock "refresh_cache-1de87977-532f-45f7-856b-84df41b2a567" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.network.neutron [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Updating instance_info_cache with network_info: [{"id": "5ecd0d2b-2f55-49b1-8858-3ab96e942b4f", "address": "fa:16:3e:45:cb:79", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ecd0d2b-2f", "ovs_interfaceid": "5ecd0d2b-2f55-49b1-8858-3ab96e942b4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Releasing lock "refresh_cache-1de87977-532f-45f7-856b-84df41b2a567" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.compute.manager [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Instance network_info: |[{"id": "5ecd0d2b-2f55-49b1-8858-3ab96e942b4f", "address": "fa:16:3e:45:cb:79", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ecd0d2b-2f", "ovs_interfaceid": "5ecd0d2b-2f55-49b1-8858-3ab96e942b4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7c64f37f-2de6-4b88-93b1-de17eead6246 req-2e0e720b-00d2-4cc6-bdd9-bf4a6c5cf032 service nova] Acquired lock "refresh_cache-1de87977-532f-45f7-856b-84df41b2a567" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.network.neutron [req-7c64f37f-2de6-4b88-93b1-de17eead6246 req-2e0e720b-00d2-4cc6-bdd9-bf4a6c5cf032 service nova] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Refreshing network info cache for port 5ecd0d2b-2f55-49b1-8858-3ab96e942b4f {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Start _get_guest_xml network_info=[{"id": "5ecd0d2b-2f55-49b1-8858-3ab96e942b4f", "address": "fa:16:3e:45:cb:79", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ecd0d2b-2f", "ovs_interfaceid": "5ecd0d2b-2f55-49b1-8858-3ab96e942b4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:49:38 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:49:38 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:49:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-690282244',display_name='tempest-AttachVolumeNegativeTest-server-690282244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-690282244',id=5,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2gTw4nMcUFERkQeyvYHB/zROHS1gTh0rWtAAjIWTyZ98gQMEl9oC8xtKGmod4S57s4UuOmOGNs0bNy2FnwATXTxSjg3XUIWFm7EOBRqyeGI+iTq7xJOAPcSfqO+Qysnw==',key_name='tempest-keypair-1947884909',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15cc01820f324654b0959d5fb2adefc3',ramdisk_id='',reservation_id='r-4h1i4rx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2109955223',owner_user_name='tempest-AttachVolumeNegativeTest-2109955223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:49:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='451baacc96384f35bd8bbb87626ac52d',uuid=1de87977-532f-45f7-856b-84df41b2a567,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ecd0d2b-2f55-49b1-8858-3ab96e942b4f", "address": "fa:16:3e:45:cb:79", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ecd0d2b-2f", "ovs_interfaceid": "5ecd0d2b-2f55-49b1-8858-3ab96e942b4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Converting VIF {"id": "5ecd0d2b-2f55-49b1-8858-3ab96e942b4f", "address": "fa:16:3e:45:cb:79", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ecd0d2b-2f", "ovs_interfaceid": "5ecd0d2b-2f55-49b1-8858-3ab96e942b4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:cb:79,bridge_name='br-int',has_traffic_filtering=True,id=5ecd0d2b-2f55-49b1-8858-3ab96e942b4f,network=Network(67292f1d-2643-4cfa-aaf6-0a698d87bfd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ecd0d2b-2f') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.objects.instance [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lazy-loading 'pci_devices' on Instance uuid 1de87977-532f-45f7-856b-84df41b2a567 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:49:38 user nova-compute[72504]:   <uuid>1de87977-532f-45f7-856b-84df41b2a567</uuid>
Aug 01 19:49:38 user nova-compute[72504]:   <name>instance-00000005</name>
Aug 01 19:49:38 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:49:38 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:49:38 user nova-compute[72504]:   <metadata>
Aug 01 19:49:38 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:49:38 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:49:38 user nova-compute[72504]:       <nova:name>tempest-AttachVolumeNegativeTest-server-690282244</nova:name>
Aug 01 19:49:38 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:49:38</nova:creationTime>
Aug 01 19:49:38 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:49:38 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:49:38 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:49:38 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:49:38 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:49:38 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:49:38 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:49:38 user nova-compute[72504]:       <nova:owner>
Aug 01 19:49:38 user nova-compute[72504]:         <nova:user uuid="451baacc96384f35bd8bbb87626ac52d">tempest-AttachVolumeNegativeTest-2109955223-project-member</nova:user>
Aug 01 19:49:38 user nova-compute[72504]:         <nova:project uuid="15cc01820f324654b0959d5fb2adefc3">tempest-AttachVolumeNegativeTest-2109955223</nova:project>
Aug 01 19:49:38 user nova-compute[72504]:       </nova:owner>
Aug 01 19:49:38 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:49:38 user nova-compute[72504]:       <nova:ports>
Aug 01 19:49:38 user nova-compute[72504]:         <nova:port uuid="5ecd0d2b-2f55-49b1-8858-3ab96e942b4f">
Aug 01 19:49:38 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 19:49:38 user nova-compute[72504]:         </nova:port>
Aug 01 19:49:38 user nova-compute[72504]:       </nova:ports>
Aug 01 19:49:38 user nova-compute[72504]:     </nova:instance>
Aug 01 19:49:38 user nova-compute[72504]:   </metadata>
Aug 01 19:49:38 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:49:38 user nova-compute[72504]:     <system>
Aug 01 19:49:38 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:49:38 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:49:38 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:49:38 user nova-compute[72504]:       <entry name="serial">1de87977-532f-45f7-856b-84df41b2a567</entry>
Aug 01 19:49:38 user nova-compute[72504]:       <entry name="uuid">1de87977-532f-45f7-856b-84df41b2a567</entry>
Aug 01 19:49:38 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:49:38 user nova-compute[72504]:     </system>
Aug 01 19:49:38 user nova-compute[72504]:   </sysinfo>
Aug 01 19:49:38 user nova-compute[72504]:   <os>
Aug 01 19:49:38 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:49:38 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:49:38 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:49:38 user nova-compute[72504]:   </os>
Aug 01 19:49:38 user nova-compute[72504]:   <features>
Aug 01 19:49:38 user nova-compute[72504]:     <acpi/>
Aug 01 19:49:38 user nova-compute[72504]:     <apic/>
Aug 01 19:49:38 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:49:38 user nova-compute[72504]:   </features>
Aug 01 19:49:38 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:49:38 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:49:38 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:49:38 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:49:38 user nova-compute[72504]:   </clock>
Aug 01 19:49:38 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:49:38 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:49:38 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:49:38 user nova-compute[72504]:   </cpu>
Aug 01 19:49:38 user nova-compute[72504]:   <devices>
Aug 01 19:49:38 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:49:38 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:49:38 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk"/>
Aug 01 19:49:38 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:49:38 user nova-compute[72504]:     </disk>
Aug 01 19:49:38 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:49:38 user nova-compute[72504]:       <mac address="fa:16:3e:45:cb:79"/>
Aug 01 19:49:38 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:49:38 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:49:38 user nova-compute[72504]:       <target dev="tap5ecd0d2b-2f"/>
Aug 01 19:49:38 user nova-compute[72504]:     </interface>
Aug 01 19:49:38 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:49:38 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/console.log" append="off"/>
Aug 01 19:49:38 user nova-compute[72504]:     </serial>
Aug 01 19:49:38 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:49:38 user nova-compute[72504]:     <video>
Aug 01 19:49:38 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:49:38 user nova-compute[72504]:     </video>
Aug 01 19:49:38 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:49:38 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:49:38 user nova-compute[72504]:     </rng>
Aug 01 19:49:38 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:49:38 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:49:38 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:49:38 user nova-compute[72504]:     </memballoon>
Aug 01 19:49:38 user nova-compute[72504]:   </devices>
Aug 01 19:49:38 user nova-compute[72504]: </domain>
Aug 01 19:49:38 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:49:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-690282244',display_name='tempest-AttachVolumeNegativeTest-server-690282244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-690282244',id=5,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2gTw4nMcUFERkQeyvYHB/zROHS1gTh0rWtAAjIWTyZ98gQMEl9oC8xtKGmod4S57s4UuOmOGNs0bNy2FnwATXTxSjg3XUIWFm7EOBRqyeGI+iTq7xJOAPcSfqO+Qysnw==',key_name='tempest-keypair-1947884909',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15cc01820f324654b0959d5fb2adefc3',ramdisk_id='',reservation_id='r-4h1i4rx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2109955223',owner_user_name='tempest-AttachVolumeNegativeTest-2109955223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:49:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='451baacc96384f35bd8bbb87626ac52d',uuid=1de87977-532f-45f7-856b-84df41b2a567,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ecd0d2b-2f55-49b1-8858-3ab96e942b4f", "address": "fa:16:3e:45:cb:79", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ecd0d2b-2f", "ovs_interfaceid": "5ecd0d2b-2f55-49b1-8858-3ab96e942b4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Converting VIF {"id": "5ecd0d2b-2f55-49b1-8858-3ab96e942b4f", "address": "fa:16:3e:45:cb:79", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ecd0d2b-2f", "ovs_interfaceid": "5ecd0d2b-2f55-49b1-8858-3ab96e942b4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:cb:79,bridge_name='br-int',has_traffic_filtering=True,id=5ecd0d2b-2f55-49b1-8858-3ab96e942b4f,network=Network(67292f1d-2643-4cfa-aaf6-0a698d87bfd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ecd0d2b-2f') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG os_vif [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:cb:79,bridge_name='br-int',has_traffic_filtering=True,id=5ecd0d2b-2f55-49b1-8858-3ab96e942b4f,network=Network(67292f1d-2643-4cfa-aaf6-0a698d87bfd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ecd0d2b-2f') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ecd0d2b-2f, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5ecd0d2b-2f, col_values=(('external_ids', {'iface-id': '5ecd0d2b-2f55-49b1-8858-3ab96e942b4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:cb:79', 'vm-uuid': '1de87977-532f-45f7-856b-84df41b2a567'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:38 user nova-compute[72504]: INFO os_vif [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:cb:79,bridge_name='br-int',has_traffic_filtering=True,id=5ecd0d2b-2f55-49b1-8858-3ab96e942b4f,network=Network(67292f1d-2643-4cfa-aaf6-0a698d87bfd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ecd0d2b-2f')
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:49:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] No VIF found with MAC fa:16:3e:45:cb:79, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:49:39 user nova-compute[72504]: DEBUG nova.network.neutron [req-12890658-7cfb-4bdd-ad94-e819a69fd503 req-f2893b60-55c0-4860-a114-f489faf208ea service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Updated VIF entry in instance network info cache for port 8f1cca03-e1f6-44db-b8d3-d7a305fc1461. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:49:39 user nova-compute[72504]: DEBUG nova.network.neutron [req-12890658-7cfb-4bdd-ad94-e819a69fd503 req-f2893b60-55c0-4860-a114-f489faf208ea service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Updating instance_info_cache with network_info: [{"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:49:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-12890658-7cfb-4bdd-ad94-e819a69fd503 req-f2893b60-55c0-4860-a114-f489faf208ea service nova] Releasing lock "refresh_cache-5193c770-80ca-44c3-9950-cb25c65e94e8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:49:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:39 user nova-compute[72504]: DEBUG nova.network.neutron [req-7c64f37f-2de6-4b88-93b1-de17eead6246 req-2e0e720b-00d2-4cc6-bdd9-bf4a6c5cf032 service nova] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Updated VIF entry in instance network info cache for port 5ecd0d2b-2f55-49b1-8858-3ab96e942b4f. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:49:39 user nova-compute[72504]: DEBUG nova.network.neutron [req-7c64f37f-2de6-4b88-93b1-de17eead6246 req-2e0e720b-00d2-4cc6-bdd9-bf4a6c5cf032 service nova] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Updating instance_info_cache with network_info: [{"id": "5ecd0d2b-2f55-49b1-8858-3ab96e942b4f", "address": "fa:16:3e:45:cb:79", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ecd0d2b-2f", "ovs_interfaceid": "5ecd0d2b-2f55-49b1-8858-3ab96e942b4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:49:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7c64f37f-2de6-4b88-93b1-de17eead6246 req-2e0e720b-00d2-4cc6-bdd9-bf4a6c5cf032 service nova] Releasing lock "refresh_cache-1de87977-532f-45f7-856b-84df41b2a567" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:49:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:39 user nova-compute[72504]: DEBUG nova.compute.manager [req-60cd5bc6-b853-42c6-afde-ba173d6cd6cc req-29f1faac-478e-49ef-8021-e606ae4228bb service nova] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Received event network-vif-plugged-a4953c19-ef72-4bbe-b271-40cc5162842d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:49:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-60cd5bc6-b853-42c6-afde-ba173d6cd6cc req-29f1faac-478e-49ef-8021-e606ae4228bb service nova] Acquiring lock "39b3076d-ce59-4e7c-976f-9355bf2f6ff4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-60cd5bc6-b853-42c6-afde-ba173d6cd6cc req-29f1faac-478e-49ef-8021-e606ae4228bb service nova] Lock "39b3076d-ce59-4e7c-976f-9355bf2f6ff4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-60cd5bc6-b853-42c6-afde-ba173d6cd6cc req-29f1faac-478e-49ef-8021-e606ae4228bb service nova] Lock "39b3076d-ce59-4e7c-976f-9355bf2f6ff4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:39 user nova-compute[72504]: DEBUG nova.compute.manager [req-60cd5bc6-b853-42c6-afde-ba173d6cd6cc req-29f1faac-478e-49ef-8021-e606ae4228bb service nova] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] No waiting events found dispatching network-vif-plugged-a4953c19-ef72-4bbe-b271-40cc5162842d {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:49:39 user nova-compute[72504]: WARNING nova.compute.manager [req-60cd5bc6-b853-42c6-afde-ba173d6cd6cc req-29f1faac-478e-49ef-8021-e606ae4228bb service nova] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Received unexpected event network-vif-plugged-a4953c19-ef72-4bbe-b271-40cc5162842d for instance with vm_state building and task_state spawning.
Aug 01 19:49:39 user nova-compute[72504]: DEBUG nova.compute.manager [req-60cd5bc6-b853-42c6-afde-ba173d6cd6cc req-29f1faac-478e-49ef-8021-e606ae4228bb service nova] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Received event network-vif-plugged-a4953c19-ef72-4bbe-b271-40cc5162842d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:49:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-60cd5bc6-b853-42c6-afde-ba173d6cd6cc req-29f1faac-478e-49ef-8021-e606ae4228bb service nova] Acquiring lock "39b3076d-ce59-4e7c-976f-9355bf2f6ff4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-60cd5bc6-b853-42c6-afde-ba173d6cd6cc req-29f1faac-478e-49ef-8021-e606ae4228bb service nova] Lock "39b3076d-ce59-4e7c-976f-9355bf2f6ff4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-60cd5bc6-b853-42c6-afde-ba173d6cd6cc req-29f1faac-478e-49ef-8021-e606ae4228bb service nova] Lock "39b3076d-ce59-4e7c-976f-9355bf2f6ff4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:39 user nova-compute[72504]: DEBUG nova.compute.manager [req-60cd5bc6-b853-42c6-afde-ba173d6cd6cc req-29f1faac-478e-49ef-8021-e606ae4228bb service nova] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] No waiting events found dispatching network-vif-plugged-a4953c19-ef72-4bbe-b271-40cc5162842d {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:49:39 user nova-compute[72504]: WARNING nova.compute.manager [req-60cd5bc6-b853-42c6-afde-ba173d6cd6cc req-29f1faac-478e-49ef-8021-e606ae4228bb service nova] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Received unexpected event network-vif-plugged-a4953c19-ef72-4bbe-b271-40cc5162842d for instance with vm_state building and task_state spawning.
Aug 01 19:49:39 user nova-compute[72504]: DEBUG nova.network.neutron [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Successfully updated port: 2edbeaad-cd66-4a79-9fae-544f2a33e922 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:49:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "refresh_cache-76aa3861-0ca1-4e7f-9a15-9219037bc1ee" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:49:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquired lock "refresh_cache-76aa3861-0ca1-4e7f-9a15-9219037bc1ee" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:49:39 user nova-compute[72504]: DEBUG nova.network.neutron [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:49:39 user nova-compute[72504]: DEBUG nova.network.neutron [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:49:39 user nova-compute[72504]: DEBUG nova.compute.manager [req-4f6cc4e5-b976-41c8-9562-0bb4a74bc864 req-852f4b6c-50be-4c2e-b678-3cfa57cffa0a service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Received event network-changed-2edbeaad-cd66-4a79-9fae-544f2a33e922 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:49:39 user nova-compute[72504]: DEBUG nova.compute.manager [req-4f6cc4e5-b976-41c8-9562-0bb4a74bc864 req-852f4b6c-50be-4c2e-b678-3cfa57cffa0a service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Refreshing instance network info cache due to event network-changed-2edbeaad-cd66-4a79-9fae-544f2a33e922. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:49:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4f6cc4e5-b976-41c8-9562-0bb4a74bc864 req-852f4b6c-50be-4c2e-b678-3cfa57cffa0a service nova] Acquiring lock "refresh_cache-76aa3861-0ca1-4e7f-9a15-9219037bc1ee" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:49:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.network.neutron [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Updating instance_info_cache with network_info: [{"id": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "address": "fa:16:3e:a8:fa:27", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2edbeaad-cd", "ovs_interfaceid": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Releasing lock "refresh_cache-76aa3861-0ca1-4e7f-9a15-9219037bc1ee" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Instance network_info: |[{"id": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "address": "fa:16:3e:a8:fa:27", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2edbeaad-cd", "ovs_interfaceid": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4f6cc4e5-b976-41c8-9562-0bb4a74bc864 req-852f4b6c-50be-4c2e-b678-3cfa57cffa0a service nova] Acquired lock "refresh_cache-76aa3861-0ca1-4e7f-9a15-9219037bc1ee" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.network.neutron [req-4f6cc4e5-b976-41c8-9562-0bb4a74bc864 req-852f4b6c-50be-4c2e-b678-3cfa57cffa0a service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Refreshing network info cache for port 2edbeaad-cd66-4a79-9fae-544f2a33e922 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Start _get_guest_xml network_info=[{"id": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "address": "fa:16:3e:a8:fa:27", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2edbeaad-cd", "ovs_interfaceid": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:49:41 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:49:41 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1959455272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1959455272',id=4,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsHS4HasDUoe/iSAkXERl/kuVlkQf10MtX0I95kJDd3Cs0+i0zXsqFDo40azmo6oaI1FB+bIS0tTfcjcH/OnHpg7QjuwLDWmbTaGvKjolNfCML3G3Z8TuOgsM21xi2xRg==',key_name='tempest-keypair-1467874797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da04aaa8143b44d5aa21f59a89cd57ee',ramdisk_id='',reservation_id='r-5nw6f64r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-836718209',owner_user_name='tempest-AttachVolumeShelveTestJSON-836718209-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:49:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6260679430fa4828b07bc890c62878c3',uuid=76aa3861-0ca1-4e7f-9a15-9219037bc1ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "address": "fa:16:3e:a8:fa:27", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2edbeaad-cd", "ovs_interfaceid": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Converting VIF {"id": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "address": "fa:16:3e:a8:fa:27", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2edbeaad-cd", "ovs_interfaceid": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fa:27,bridge_name='br-int',has_traffic_filtering=True,id=2edbeaad-cd66-4a79-9fae-544f2a33e922,network=Network(40b3d49e-3592-411a-93d6-5a44019ef136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2edbeaad-cd') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.objects.instance [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lazy-loading 'pci_devices' on Instance uuid 76aa3861-0ca1-4e7f-9a15-9219037bc1ee {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:49:41 user nova-compute[72504]:   <uuid>76aa3861-0ca1-4e7f-9a15-9219037bc1ee</uuid>
Aug 01 19:49:41 user nova-compute[72504]:   <name>instance-00000004</name>
Aug 01 19:49:41 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:49:41 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:49:41 user nova-compute[72504]:   <metadata>
Aug 01 19:49:41 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:49:41 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:49:41 user nova-compute[72504]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1959455272</nova:name>
Aug 01 19:49:41 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:49:41</nova:creationTime>
Aug 01 19:49:41 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:49:41 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:49:41 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:49:41 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:49:41 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:49:41 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:49:41 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:49:41 user nova-compute[72504]:       <nova:owner>
Aug 01 19:49:41 user nova-compute[72504]:         <nova:user uuid="6260679430fa4828b07bc890c62878c3">tempest-AttachVolumeShelveTestJSON-836718209-project-member</nova:user>
Aug 01 19:49:41 user nova-compute[72504]:         <nova:project uuid="da04aaa8143b44d5aa21f59a89cd57ee">tempest-AttachVolumeShelveTestJSON-836718209</nova:project>
Aug 01 19:49:41 user nova-compute[72504]:       </nova:owner>
Aug 01 19:49:41 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:49:41 user nova-compute[72504]:       <nova:ports>
Aug 01 19:49:41 user nova-compute[72504]:         <nova:port uuid="2edbeaad-cd66-4a79-9fae-544f2a33e922">
Aug 01 19:49:41 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 19:49:41 user nova-compute[72504]:         </nova:port>
Aug 01 19:49:41 user nova-compute[72504]:       </nova:ports>
Aug 01 19:49:41 user nova-compute[72504]:     </nova:instance>
Aug 01 19:49:41 user nova-compute[72504]:   </metadata>
Aug 01 19:49:41 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:49:41 user nova-compute[72504]:     <system>
Aug 01 19:49:41 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:49:41 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:49:41 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:49:41 user nova-compute[72504]:       <entry name="serial">76aa3861-0ca1-4e7f-9a15-9219037bc1ee</entry>
Aug 01 19:49:41 user nova-compute[72504]:       <entry name="uuid">76aa3861-0ca1-4e7f-9a15-9219037bc1ee</entry>
Aug 01 19:49:41 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:49:41 user nova-compute[72504]:     </system>
Aug 01 19:49:41 user nova-compute[72504]:   </sysinfo>
Aug 01 19:49:41 user nova-compute[72504]:   <os>
Aug 01 19:49:41 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:49:41 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:49:41 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:49:41 user nova-compute[72504]:   </os>
Aug 01 19:49:41 user nova-compute[72504]:   <features>
Aug 01 19:49:41 user nova-compute[72504]:     <acpi/>
Aug 01 19:49:41 user nova-compute[72504]:     <apic/>
Aug 01 19:49:41 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:49:41 user nova-compute[72504]:   </features>
Aug 01 19:49:41 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:49:41 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:49:41 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:49:41 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:49:41 user nova-compute[72504]:   </clock>
Aug 01 19:49:41 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:49:41 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:49:41 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:49:41 user nova-compute[72504]:   </cpu>
Aug 01 19:49:41 user nova-compute[72504]:   <devices>
Aug 01 19:49:41 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:49:41 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:49:41 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk"/>
Aug 01 19:49:41 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:49:41 user nova-compute[72504]:     </disk>
Aug 01 19:49:41 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:49:41 user nova-compute[72504]:       <mac address="fa:16:3e:a8:fa:27"/>
Aug 01 19:49:41 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:49:41 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:49:41 user nova-compute[72504]:       <target dev="tap2edbeaad-cd"/>
Aug 01 19:49:41 user nova-compute[72504]:     </interface>
Aug 01 19:49:41 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:49:41 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/console.log" append="off"/>
Aug 01 19:49:41 user nova-compute[72504]:     </serial>
Aug 01 19:49:41 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:49:41 user nova-compute[72504]:     <video>
Aug 01 19:49:41 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:49:41 user nova-compute[72504]:     </video>
Aug 01 19:49:41 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:49:41 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:49:41 user nova-compute[72504]:     </rng>
Aug 01 19:49:41 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:49:41 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:49:41 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:49:41 user nova-compute[72504]:     </memballoon>
Aug 01 19:49:41 user nova-compute[72504]:   </devices>
Aug 01 19:49:41 user nova-compute[72504]: </domain>
Aug 01 19:49:41 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1959455272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1959455272',id=4,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsHS4HasDUoe/iSAkXERl/kuVlkQf10MtX0I95kJDd3Cs0+i0zXsqFDo40azmo6oaI1FB+bIS0tTfcjcH/OnHpg7QjuwLDWmbTaGvKjolNfCML3G3Z8TuOgsM21xi2xRg==',key_name='tempest-keypair-1467874797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da04aaa8143b44d5aa21f59a89cd57ee',ramdisk_id='',reservation_id='r-5nw6f64r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-836718209',owner_user_name='tempest-AttachVolumeShelveTestJSON-836718209-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:49:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6260679430fa4828b07bc890c62878c3',uuid=76aa3861-0ca1-4e7f-9a15-9219037bc1ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "address": "fa:16:3e:a8:fa:27", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2edbeaad-cd", "ovs_interfaceid": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Converting VIF {"id": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "address": "fa:16:3e:a8:fa:27", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2edbeaad-cd", "ovs_interfaceid": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fa:27,bridge_name='br-int',has_traffic_filtering=True,id=2edbeaad-cd66-4a79-9fae-544f2a33e922,network=Network(40b3d49e-3592-411a-93d6-5a44019ef136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2edbeaad-cd') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG os_vif [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fa:27,bridge_name='br-int',has_traffic_filtering=True,id=2edbeaad-cd66-4a79-9fae-544f2a33e922,network=Network(40b3d49e-3592-411a-93d6-5a44019ef136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2edbeaad-cd') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2edbeaad-cd, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2edbeaad-cd, col_values=(('external_ids', {'iface-id': '2edbeaad-cd66-4a79-9fae-544f2a33e922', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:fa:27', 'vm-uuid': '76aa3861-0ca1-4e7f-9a15-9219037bc1ee'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:41 user nova-compute[72504]: INFO os_vif [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fa:27,bridge_name='br-int',has_traffic_filtering=True,id=2edbeaad-cd66-4a79-9fae-544f2a33e922,network=Network(40b3d49e-3592-411a-93d6-5a44019ef136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2edbeaad-cd')
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919381.5123677, 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:49:41 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] VM Resumed (Lifecycle Event)
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.compute.manager [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:49:41 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Instance spawned successfully.
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] No VIF found with MAC fa:16:3e:a8:fa:27, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:41 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919381.5173447, 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:49:41 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] VM Started (Lifecycle Event)
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:49:41 user nova-compute[72504]: INFO nova.compute.manager [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Took 14.56 seconds to spawn the instance on the hypervisor.
Aug 01 19:49:41 user nova-compute[72504]: DEBUG nova.compute.manager [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:49:41 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:49:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:42 user nova-compute[72504]: INFO nova.compute.manager [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Took 15.37 seconds to build instance.
Aug 01 19:49:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-06f8adfe-7a06-47cc-8877-0bdbcfb93b41 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "39b3076d-ce59-4e7c-976f-9355bf2f6ff4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.642s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:42 user nova-compute[72504]: DEBUG nova.compute.manager [req-457c9325-6d62-4421-a6c9-4e31a19304f6 req-d968e775-1e5b-491b-a37b-77d62e25bea7 service nova] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Received event network-vif-plugged-5ecd0d2b-2f55-49b1-8858-3ab96e942b4f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:49:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-457c9325-6d62-4421-a6c9-4e31a19304f6 req-d968e775-1e5b-491b-a37b-77d62e25bea7 service nova] Acquiring lock "1de87977-532f-45f7-856b-84df41b2a567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-457c9325-6d62-4421-a6c9-4e31a19304f6 req-d968e775-1e5b-491b-a37b-77d62e25bea7 service nova] Lock "1de87977-532f-45f7-856b-84df41b2a567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-457c9325-6d62-4421-a6c9-4e31a19304f6 req-d968e775-1e5b-491b-a37b-77d62e25bea7 service nova] Lock "1de87977-532f-45f7-856b-84df41b2a567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:42 user nova-compute[72504]: DEBUG nova.compute.manager [req-457c9325-6d62-4421-a6c9-4e31a19304f6 req-d968e775-1e5b-491b-a37b-77d62e25bea7 service nova] [instance: 1de87977-532f-45f7-856b-84df41b2a567] No waiting events found dispatching network-vif-plugged-5ecd0d2b-2f55-49b1-8858-3ab96e942b4f {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:49:42 user nova-compute[72504]: WARNING nova.compute.manager [req-457c9325-6d62-4421-a6c9-4e31a19304f6 req-d968e775-1e5b-491b-a37b-77d62e25bea7 service nova] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Received unexpected event network-vif-plugged-5ecd0d2b-2f55-49b1-8858-3ab96e942b4f for instance with vm_state building and task_state spawning.
Aug 01 19:49:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:42 user nova-compute[72504]: DEBUG nova.compute.manager [req-2c98d868-7ee0-4ebe-a05f-35e6bd91f3c9 req-30d84671-aa9e-4605-a8b8-778d9f4f87b9 service nova] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Received event network-vif-plugged-81de2627-8b32-47dc-ba79-56afa5d60500 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:49:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2c98d868-7ee0-4ebe-a05f-35e6bd91f3c9 req-30d84671-aa9e-4605-a8b8-778d9f4f87b9 service nova] Acquiring lock "8eae5ffe-ab54-4dac-8169-69325448b92f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2c98d868-7ee0-4ebe-a05f-35e6bd91f3c9 req-30d84671-aa9e-4605-a8b8-778d9f4f87b9 service nova] Lock "8eae5ffe-ab54-4dac-8169-69325448b92f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2c98d868-7ee0-4ebe-a05f-35e6bd91f3c9 req-30d84671-aa9e-4605-a8b8-778d9f4f87b9 service nova] Lock "8eae5ffe-ab54-4dac-8169-69325448b92f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:42 user nova-compute[72504]: DEBUG nova.compute.manager [req-2c98d868-7ee0-4ebe-a05f-35e6bd91f3c9 req-30d84671-aa9e-4605-a8b8-778d9f4f87b9 service nova] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] No waiting events found dispatching network-vif-plugged-81de2627-8b32-47dc-ba79-56afa5d60500 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:49:42 user nova-compute[72504]: WARNING nova.compute.manager [req-2c98d868-7ee0-4ebe-a05f-35e6bd91f3c9 req-30d84671-aa9e-4605-a8b8-778d9f4f87b9 service nova] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Received unexpected event network-vif-plugged-81de2627-8b32-47dc-ba79-56afa5d60500 for instance with vm_state building and task_state spawning.
Aug 01 19:49:43 user nova-compute[72504]: DEBUG nova.network.neutron [req-4f6cc4e5-b976-41c8-9562-0bb4a74bc864 req-852f4b6c-50be-4c2e-b678-3cfa57cffa0a service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Updated VIF entry in instance network info cache for port 2edbeaad-cd66-4a79-9fae-544f2a33e922. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:49:43 user nova-compute[72504]: DEBUG nova.network.neutron [req-4f6cc4e5-b976-41c8-9562-0bb4a74bc864 req-852f4b6c-50be-4c2e-b678-3cfa57cffa0a service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Updating instance_info_cache with network_info: [{"id": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "address": "fa:16:3e:a8:fa:27", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2edbeaad-cd", "ovs_interfaceid": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:49:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4f6cc4e5-b976-41c8-9562-0bb4a74bc864 req-852f4b6c-50be-4c2e-b678-3cfa57cffa0a service nova] Releasing lock "refresh_cache-76aa3861-0ca1-4e7f-9a15-9219037bc1ee" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:49:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-54c3501f-e173-4571-adac-62ee0061fd95 req-5605a394-6933-42b7-a98a-8a58ffd68d87 service nova] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Received event network-vif-plugged-5ecd0d2b-2f55-49b1-8858-3ab96e942b4f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:49:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-54c3501f-e173-4571-adac-62ee0061fd95 req-5605a394-6933-42b7-a98a-8a58ffd68d87 service nova] Acquiring lock "1de87977-532f-45f7-856b-84df41b2a567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-54c3501f-e173-4571-adac-62ee0061fd95 req-5605a394-6933-42b7-a98a-8a58ffd68d87 service nova] Lock "1de87977-532f-45f7-856b-84df41b2a567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-54c3501f-e173-4571-adac-62ee0061fd95 req-5605a394-6933-42b7-a98a-8a58ffd68d87 service nova] Lock "1de87977-532f-45f7-856b-84df41b2a567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-54c3501f-e173-4571-adac-62ee0061fd95 req-5605a394-6933-42b7-a98a-8a58ffd68d87 service nova] [instance: 1de87977-532f-45f7-856b-84df41b2a567] No waiting events found dispatching network-vif-plugged-5ecd0d2b-2f55-49b1-8858-3ab96e942b4f {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:49:44 user nova-compute[72504]: WARNING nova.compute.manager [req-54c3501f-e173-4571-adac-62ee0061fd95 req-5605a394-6933-42b7-a98a-8a58ffd68d87 service nova] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Received unexpected event network-vif-plugged-5ecd0d2b-2f55-49b1-8858-3ab96e942b4f for instance with vm_state building and task_state spawning.
Aug 01 19:49:44 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919384.6440628, 8eae5ffe-ab54-4dac-8169-69325448b92f => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:49:44 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] VM Resumed (Lifecycle Event)
Aug 01 19:49:44 user nova-compute[72504]: DEBUG nova.compute.manager [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:49:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:49:44 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Instance spawned successfully.
Aug 01 19:49:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 19:49:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-67f04764-5678-413e-b732-4999825a2f50 req-dc35ca11-833e-4e35-a4a0-4ded50f1db2a service nova] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Received event network-vif-plugged-81de2627-8b32-47dc-ba79-56afa5d60500 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:49:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-67f04764-5678-413e-b732-4999825a2f50 req-dc35ca11-833e-4e35-a4a0-4ded50f1db2a service nova] Acquiring lock "8eae5ffe-ab54-4dac-8169-69325448b92f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-67f04764-5678-413e-b732-4999825a2f50 req-dc35ca11-833e-4e35-a4a0-4ded50f1db2a service nova] Lock "8eae5ffe-ab54-4dac-8169-69325448b92f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-67f04764-5678-413e-b732-4999825a2f50 req-dc35ca11-833e-4e35-a4a0-4ded50f1db2a service nova] Lock "8eae5ffe-ab54-4dac-8169-69325448b92f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-67f04764-5678-413e-b732-4999825a2f50 req-dc35ca11-833e-4e35-a4a0-4ded50f1db2a service nova] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] No waiting events found dispatching network-vif-plugged-81de2627-8b32-47dc-ba79-56afa5d60500 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:49:44 user nova-compute[72504]: WARNING nova.compute.manager [req-67f04764-5678-413e-b732-4999825a2f50 req-dc35ca11-833e-4e35-a4a0-4ded50f1db2a service nova] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Received unexpected event network-vif-plugged-81de2627-8b32-47dc-ba79-56afa5d60500 for instance with vm_state building and task_state spawning.
Aug 01 19:49:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-67f04764-5678-413e-b732-4999825a2f50 req-dc35ca11-833e-4e35-a4a0-4ded50f1db2a service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Received event network-vif-plugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:49:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-67f04764-5678-413e-b732-4999825a2f50 req-dc35ca11-833e-4e35-a4a0-4ded50f1db2a service nova] Acquiring lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-67f04764-5678-413e-b732-4999825a2f50 req-dc35ca11-833e-4e35-a4a0-4ded50f1db2a service nova] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-67f04764-5678-413e-b732-4999825a2f50 req-dc35ca11-833e-4e35-a4a0-4ded50f1db2a service nova] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-67f04764-5678-413e-b732-4999825a2f50 req-dc35ca11-833e-4e35-a4a0-4ded50f1db2a service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] No waiting events found dispatching network-vif-plugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:49:44 user nova-compute[72504]: WARNING nova.compute.manager [req-67f04764-5678-413e-b732-4999825a2f50 req-dc35ca11-833e-4e35-a4a0-4ded50f1db2a service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Received unexpected event network-vif-plugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 for instance with vm_state building and task_state spawning.
Aug 01 19:49:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-67f04764-5678-413e-b732-4999825a2f50 req-dc35ca11-833e-4e35-a4a0-4ded50f1db2a service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Received event network-vif-plugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:49:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-67f04764-5678-413e-b732-4999825a2f50 req-dc35ca11-833e-4e35-a4a0-4ded50f1db2a service nova] Acquiring lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-67f04764-5678-413e-b732-4999825a2f50 req-dc35ca11-833e-4e35-a4a0-4ded50f1db2a service nova] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-67f04764-5678-413e-b732-4999825a2f50 req-dc35ca11-833e-4e35-a4a0-4ded50f1db2a service nova] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-67f04764-5678-413e-b732-4999825a2f50 req-dc35ca11-833e-4e35-a4a0-4ded50f1db2a service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] No waiting events found dispatching network-vif-plugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:49:44 user nova-compute[72504]: WARNING nova.compute.manager [req-67f04764-5678-413e-b732-4999825a2f50 req-dc35ca11-833e-4e35-a4a0-4ded50f1db2a service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Received unexpected event network-vif-plugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 for instance with vm_state building and task_state spawning.
Aug 01 19:49:44 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:49:44 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:49:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:44 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:49:44 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919384.6559231, 8eae5ffe-ab54-4dac-8169-69325448b92f => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:49:44 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] VM Started (Lifecycle Event)
Aug 01 19:49:44 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:49:44 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:49:44 user nova-compute[72504]: INFO nova.compute.manager [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Took 19.38 seconds to spawn the instance on the hypervisor.
Aug 01 19:49:44 user nova-compute[72504]: DEBUG nova.compute.manager [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:49:44 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:49:45 user nova-compute[72504]: INFO nova.compute.manager [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Took 20.42 seconds to build instance.
Aug 01 19:49:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13146a38-8438-457f-9c36-d9cbbec7a685 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lock "8eae5ffe-ab54-4dac-8169-69325448b92f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.683s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.compute.manager [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919386.1004791, 5193c770-80ca-44c3-9950-cb25c65e94e8 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:49:46 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] VM Resumed (Lifecycle Event)
Aug 01 19:49:46 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Instance spawned successfully.
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:46 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919386.1006625, 5193c770-80ca-44c3-9950-cb25c65e94e8 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:49:46 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] VM Started (Lifecycle Event)
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:49:46 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:49:46 user nova-compute[72504]: INFO nova.compute.manager [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Took 18.62 seconds to spawn the instance on the hypervisor.
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.compute.manager [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919386.3280804, 1de87977-532f-45f7-856b-84df41b2a567 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:49:46 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1de87977-532f-45f7-856b-84df41b2a567] VM Resumed (Lifecycle Event)
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.compute.manager [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:49:46 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Instance spawned successfully.
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:46 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1de87977-532f-45f7-856b-84df41b2a567] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919386.3367903, 1de87977-532f-45f7-856b-84df41b2a567 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:49:46 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1de87977-532f-45f7-856b-84df41b2a567] VM Started (Lifecycle Event)
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:49:46 user nova-compute[72504]: INFO nova.compute.manager [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Took 19.63 seconds to build instance.
Aug 01 19:49:46 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1de87977-532f-45f7-856b-84df41b2a567] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:49:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6fe47656-3851-4916-b2bf-164c88683dfc tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.825s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:46 user nova-compute[72504]: INFO nova.compute.manager [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Took 12.91 seconds to spawn the instance on the hypervisor.
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.compute.manager [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.compute.manager [req-cc4782e2-b767-4343-ab1f-ce53d892c422 req-0b7e1539-0344-4c36-a42b-e25ad37a24a0 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Received event network-vif-plugged-2edbeaad-cd66-4a79-9fae-544f2a33e922 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cc4782e2-b767-4343-ab1f-ce53d892c422 req-0b7e1539-0344-4c36-a42b-e25ad37a24a0 service nova] Acquiring lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cc4782e2-b767-4343-ab1f-ce53d892c422 req-0b7e1539-0344-4c36-a42b-e25ad37a24a0 service nova] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cc4782e2-b767-4343-ab1f-ce53d892c422 req-0b7e1539-0344-4c36-a42b-e25ad37a24a0 service nova] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.compute.manager [req-cc4782e2-b767-4343-ab1f-ce53d892c422 req-0b7e1539-0344-4c36-a42b-e25ad37a24a0 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] No waiting events found dispatching network-vif-plugged-2edbeaad-cd66-4a79-9fae-544f2a33e922 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:49:46 user nova-compute[72504]: WARNING nova.compute.manager [req-cc4782e2-b767-4343-ab1f-ce53d892c422 req-0b7e1539-0344-4c36-a42b-e25ad37a24a0 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Received unexpected event network-vif-plugged-2edbeaad-cd66-4a79-9fae-544f2a33e922 for instance with vm_state building and task_state spawning.
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.compute.manager [req-cc4782e2-b767-4343-ab1f-ce53d892c422 req-0b7e1539-0344-4c36-a42b-e25ad37a24a0 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Received event network-vif-plugged-2edbeaad-cd66-4a79-9fae-544f2a33e922 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cc4782e2-b767-4343-ab1f-ce53d892c422 req-0b7e1539-0344-4c36-a42b-e25ad37a24a0 service nova] Acquiring lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cc4782e2-b767-4343-ab1f-ce53d892c422 req-0b7e1539-0344-4c36-a42b-e25ad37a24a0 service nova] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cc4782e2-b767-4343-ab1f-ce53d892c422 req-0b7e1539-0344-4c36-a42b-e25ad37a24a0 service nova] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:46 user nova-compute[72504]: DEBUG nova.compute.manager [req-cc4782e2-b767-4343-ab1f-ce53d892c422 req-0b7e1539-0344-4c36-a42b-e25ad37a24a0 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] No waiting events found dispatching network-vif-plugged-2edbeaad-cd66-4a79-9fae-544f2a33e922 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:49:46 user nova-compute[72504]: WARNING nova.compute.manager [req-cc4782e2-b767-4343-ab1f-ce53d892c422 req-0b7e1539-0344-4c36-a42b-e25ad37a24a0 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Received unexpected event network-vif-plugged-2edbeaad-cd66-4a79-9fae-544f2a33e922 for instance with vm_state building and task_state spawning.
Aug 01 19:49:46 user nova-compute[72504]: INFO nova.compute.manager [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Took 13.91 seconds to build instance.
Aug 01 19:49:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4c537468-cfe6-482e-978d-b6420fe9c850 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "1de87977-532f-45f7-856b-84df41b2a567" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.110s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:47 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919387.2747085, 76aa3861-0ca1-4e7f-9a15-9219037bc1ee => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:49:47 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] VM Resumed (Lifecycle Event)
Aug 01 19:49:47 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:49:47 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:49:47 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Instance spawned successfully.
Aug 01 19:49:47 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 19:49:47 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:49:47 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:49:47 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:47 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:47 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:47 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:47 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:47 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:49:47 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:49:47 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919387.2781374, 76aa3861-0ca1-4e7f-9a15-9219037bc1ee => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:49:47 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] VM Started (Lifecycle Event)
Aug 01 19:49:47 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:49:47 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:49:47 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:49:47 user nova-compute[72504]: INFO nova.compute.manager [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Took 14.69 seconds to spawn the instance on the hypervisor.
Aug 01 19:49:47 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:49:47 user nova-compute[72504]: INFO nova.compute.manager [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Took 15.64 seconds to build instance.
Aug 01 19:49:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a80e8c8-af2a-4da4-8e9b-a66200a8f9dc tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.812s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Acquiring lock "a8966321-946f-4988-83f5-c71cabb1c094" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "a8966321-946f-4988-83f5-c71cabb1c094" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:50 user nova-compute[72504]: DEBUG nova.compute.manager [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 19:49:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:50 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:49:50 user nova-compute[72504]: INFO nova.compute.claims [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Claim successful on node user
Aug 01 19:49:51 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:49:51 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:51 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:49:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.730s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:51 user nova-compute[72504]: DEBUG nova.compute.manager [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 19:49:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Acquiring lock "561928fb-3c41-4937-8050-9125614c0641" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lock "561928fb-3c41-4937-8050-9125614c0641" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:51 user nova-compute[72504]: DEBUG nova.compute.manager [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 19:49:51 user nova-compute[72504]: DEBUG nova.compute.manager [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 19:49:51 user nova-compute[72504]: DEBUG nova.network.neutron [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 19:49:51 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 01 19:49:51 user nova-compute[72504]: DEBUG nova.compute.manager [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 19:49:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:51 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:49:51 user nova-compute[72504]: INFO nova.compute.claims [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Claim successful on node user
Aug 01 19:49:51 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:52 user nova-compute[72504]: DEBUG nova.policy [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2fcce6ceaee4043a7aaac1d550884d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f8a671a5994b72a02f99185c5838cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 19:49:52 user nova-compute[72504]: DEBUG nova.compute.manager [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 19:49:52 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:49:52 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Creating image(s)
Aug 01 19:49:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8966321-946f-4988-83f5-c71cabb1c094/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "/opt/stack/data/nova/instances/a8966321-946f-4988-83f5-c71cabb1c094/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "/opt/stack/data/nova/instances/a8966321-946f-4988-83f5-c71cabb1c094/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Acquiring lock "7c053d76191c916636190b81df43fe972f1485b1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "7c053d76191c916636190b81df43fe972f1485b1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c053d76191c916636190b81df43fe972f1485b1.part --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c053d76191c916636190b81df43fe972f1485b1.part --force-share --output=json" returned: 0 in 0.314s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:52 user nova-compute[72504]: DEBUG nova.virt.images [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] 608990c8-07be-45f7-84d1-1ba4d0d390d6 was qcow2, converting to raw {{(pid=72504) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 19:49:52 user nova-compute[72504]: DEBUG nova.privsep.utils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72504) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 19:49:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7c053d76191c916636190b81df43fe972f1485b1.part /opt/stack/data/nova/instances/_base/7c053d76191c916636190b81df43fe972f1485b1.converted {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:53 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:49:53 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:49:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.329s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:53 user nova-compute[72504]: DEBUG nova.compute.manager [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 19:49:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7c053d76191c916636190b81df43fe972f1485b1.part /opt/stack/data/nova/instances/_base/7c053d76191c916636190b81df43fe972f1485b1.converted" returned: 0 in 0.310s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c053d76191c916636190b81df43fe972f1485b1.converted --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:53 user nova-compute[72504]: DEBUG nova.compute.manager [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 19:49:53 user nova-compute[72504]: DEBUG nova.network.neutron [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 19:49:53 user nova-compute[72504]: DEBUG nova.network.neutron [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Successfully created port: 6698435e-de04-4c41-8f14-356dd152aa0d {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:49:53 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 19:49:53 user nova-compute[72504]: DEBUG nova.compute.manager [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 19:49:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c053d76191c916636190b81df43fe972f1485b1.converted --force-share --output=json" returned: 0 in 0.252s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "7c053d76191c916636190b81df43fe972f1485b1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.416s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c053d76191c916636190b81df43fe972f1485b1 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:53 user nova-compute[72504]: DEBUG nova.policy [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dceab608a5664f638e7b0a3cdfac854a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50a77655071466db7143ff1850d3272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 19:49:53 user nova-compute[72504]: DEBUG nova.compute.manager [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 19:49:53 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:49:53 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Creating image(s)
Aug 01 19:49:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Acquiring lock "/opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lock "/opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lock "/opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c053d76191c916636190b81df43fe972f1485b1 --force-share --output=json" returned: 0 in 0.350s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Acquiring lock "7c053d76191c916636190b81df43fe972f1485b1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "7c053d76191c916636190b81df43fe972f1485b1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c053d76191c916636190b81df43fe972f1485b1 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.326s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c053d76191c916636190b81df43fe972f1485b1 --force-share --output=json" returned: 0 in 0.418s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c053d76191c916636190b81df43fe972f1485b1,backing_fmt=raw /opt/stack/data/nova/instances/a8966321-946f-4988-83f5-c71cabb1c094/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.318s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c053d76191c916636190b81df43fe972f1485b1,backing_fmt=raw /opt/stack/data/nova/instances/a8966321-946f-4988-83f5-c71cabb1c094/disk 1073741824" returned: 0 in 0.123s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "7c053d76191c916636190b81df43fe972f1485b1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.555s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c053d76191c916636190b81df43fe972f1485b1 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641/disk 1073741824" returned: 0 in 0.138s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.465s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.183s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:54 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Checking if we can resize image /opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 19:49:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c053d76191c916636190b81df43fe972f1485b1 --force-share --output=json" returned: 0 in 0.394s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:54 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8966321-946f-4988-83f5-c71cabb1c094/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 19:49:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8966321-946f-4988-83f5-c71cabb1c094/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:54 user nova-compute[72504]: DEBUG nova.network.neutron [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Successfully updated port: 6698435e-de04-4c41-8f14-356dd152aa0d {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Acquiring lock "refresh_cache-a8966321-946f-4988-83f5-c71cabb1c094" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Acquired lock "refresh_cache-a8966321-946f-4988-83f5-c71cabb1c094" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.network.neutron [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Cannot resize image /opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.objects.instance [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lazy-loading 'migration_context' on Instance uuid 561928fb-3c41-4937-8050-9125614c0641 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-14ca3a0b-1445-438f-a153-a8f41402d065 req-52934efa-a868-4721-90f9-6ecc1546924d service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Received event network-changed-6698435e-de04-4c41-8f14-356dd152aa0d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-14ca3a0b-1445-438f-a153-a8f41402d065 req-52934efa-a868-4721-90f9-6ecc1546924d service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Refreshing instance network info cache due to event network-changed-6698435e-de04-4c41-8f14-356dd152aa0d. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-14ca3a0b-1445-438f-a153-a8f41402d065 req-52934efa-a868-4721-90f9-6ecc1546924d service nova] Acquiring lock "refresh_cache-a8966321-946f-4988-83f5-c71cabb1c094" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Ensure instance console log exists: /opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8966321-946f-4988-83f5-c71cabb1c094/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Cannot resize image /opt/stack/data/nova/instances/a8966321-946f-4988-83f5-c71cabb1c094/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.objects.instance [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lazy-loading 'migration_context' on Instance uuid a8966321-946f-4988-83f5-c71cabb1c094 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Ensure instance console log exists: /opt/stack/data/nova/instances/a8966321-946f-4988-83f5-c71cabb1c094/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.network.neutron [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.network.neutron [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Successfully created port: f0a2194f-e3b8-48c4-9157-a35a3f66165b {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Acquiring lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.compute.manager [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.network.neutron [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Updating instance_info_cache with network_info: [{"id": "6698435e-de04-4c41-8f14-356dd152aa0d", "address": "fa:16:3e:bd:89:6b", "network": {"id": "4c56cdef-5441-46f2-abda-780f3573ccaf", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1603717847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4f8a671a5994b72a02f99185c5838cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6698435e-de", "ovs_interfaceid": "6698435e-de04-4c41-8f14-356dd152aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:49:55 user nova-compute[72504]: INFO nova.compute.claims [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Claim successful on node user
Aug 01 19:49:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Releasing lock "refresh_cache-a8966321-946f-4988-83f5-c71cabb1c094" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.compute.manager [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Instance network_info: |[{"id": "6698435e-de04-4c41-8f14-356dd152aa0d", "address": "fa:16:3e:bd:89:6b", "network": {"id": "4c56cdef-5441-46f2-abda-780f3573ccaf", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1603717847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4f8a671a5994b72a02f99185c5838cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6698435e-de", "ovs_interfaceid": "6698435e-de04-4c41-8f14-356dd152aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-14ca3a0b-1445-438f-a153-a8f41402d065 req-52934efa-a868-4721-90f9-6ecc1546924d service nova] Acquired lock "refresh_cache-a8966321-946f-4988-83f5-c71cabb1c094" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.network.neutron [req-14ca3a0b-1445-438f-a153-a8f41402d065 req-52934efa-a868-4721-90f9-6ecc1546924d service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Refreshing network info cache for port 6698435e-de04-4c41-8f14-356dd152aa0d {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Start _get_guest_xml network_info=[{"id": "6698435e-de04-4c41-8f14-356dd152aa0d", "address": "fa:16:3e:bd:89:6b", "network": {"id": "4c56cdef-5441-46f2-abda-780f3573ccaf", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1603717847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4f8a671a5994b72a02f99185c5838cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6698435e-de", "ovs_interfaceid": "6698435e-de04-4c41-8f14-356dd152aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:49:40Z,direct_url=<?>,disk_format='qcow2',id=608990c8-07be-45f7-84d1-1ba4d0d390d6,min_disk=0,min_ram=0,name='',owner='5a34685b76b843e9a8370ac2df021e18',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:49:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'boot_index': 0, 'device_name': '/dev/sda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'scsi', 'device_type': 'disk', 'image_id': '608990c8-07be-45f7-84d1-1ba4d0d390d6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:49:55 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:49:55 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:49:40Z,direct_url=<?>,disk_format='qcow2',id=608990c8-07be-45f7-84d1-1ba4d0d390d6,min_disk=0,min_ram=0,name='',owner='5a34685b76b843e9a8370ac2df021e18',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:49:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:49:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1681496768',display_name='tempest-AttachSCSIVolumeTestJSON-server-1681496768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1681496768',id=6,image_ref='608990c8-07be-45f7-84d1-1ba4d0d390d6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTafKCY44Fzr43KaPS96ziwv+rxw+O+c49opwupGkQLUaS3Hg0ovp6ybqVBUHcBDN365QGu/f5jDFSmp+B9ddflmSL8wop3loCxBBcDxSde3Ig9vk3+IP0Iu5Os/me4nQ==',key_name='tempest-keypair-636030287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4f8a671a5994b72a02f99185c5838cf',ramdisk_id='',reservation_id='r-tr8nwqwi',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='608990c8-07be-45f7-84d1-1ba4d0d390d6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2019072662',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2019072662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:49:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2fcce6ceaee4043a7aaac1d550884d6',uuid=a8966321-946f-4988-83f5-c71cabb1c094,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6698435e-de04-4c41-8f14-356dd152aa0d", "address": "fa:16:3e:bd:89:6b", "network": {"id": "4c56cdef-5441-46f2-abda-780f3573ccaf", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1603717847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4f8a671a5994b72a02f99185c5838cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6698435e-de", "ovs_interfaceid": "6698435e-de04-4c41-8f14-356dd152aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Converting VIF {"id": "6698435e-de04-4c41-8f14-356dd152aa0d", "address": "fa:16:3e:bd:89:6b", "network": {"id": "4c56cdef-5441-46f2-abda-780f3573ccaf", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1603717847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4f8a671a5994b72a02f99185c5838cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6698435e-de", "ovs_interfaceid": "6698435e-de04-4c41-8f14-356dd152aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:89:6b,bridge_name='br-int',has_traffic_filtering=True,id=6698435e-de04-4c41-8f14-356dd152aa0d,network=Network(4c56cdef-5441-46f2-abda-780f3573ccaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6698435e-de') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.objects.instance [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lazy-loading 'pci_devices' on Instance uuid a8966321-946f-4988-83f5-c71cabb1c094 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:49:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:49:55 user nova-compute[72504]:   <uuid>a8966321-946f-4988-83f5-c71cabb1c094</uuid>
Aug 01 19:49:55 user nova-compute[72504]:   <name>instance-00000006</name>
Aug 01 19:49:55 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:49:55 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:49:55 user nova-compute[72504]:   <metadata>
Aug 01 19:49:55 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:49:55 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:49:55 user nova-compute[72504]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1681496768</nova:name>
Aug 01 19:49:55 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:49:55</nova:creationTime>
Aug 01 19:49:55 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:49:55 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:49:55 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:49:55 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:49:55 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:49:55 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:49:55 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:49:55 user nova-compute[72504]:       <nova:owner>
Aug 01 19:49:55 user nova-compute[72504]:         <nova:user uuid="d2fcce6ceaee4043a7aaac1d550884d6">tempest-AttachSCSIVolumeTestJSON-2019072662-project-member</nova:user>
Aug 01 19:49:55 user nova-compute[72504]:         <nova:project uuid="f4f8a671a5994b72a02f99185c5838cf">tempest-AttachSCSIVolumeTestJSON-2019072662</nova:project>
Aug 01 19:49:55 user nova-compute[72504]:       </nova:owner>
Aug 01 19:49:55 user nova-compute[72504]:       <nova:root type="image" uuid="608990c8-07be-45f7-84d1-1ba4d0d390d6"/>
Aug 01 19:49:55 user nova-compute[72504]:       <nova:ports>
Aug 01 19:49:55 user nova-compute[72504]:         <nova:port uuid="6698435e-de04-4c41-8f14-356dd152aa0d">
Aug 01 19:49:55 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 19:49:55 user nova-compute[72504]:         </nova:port>
Aug 01 19:49:55 user nova-compute[72504]:       </nova:ports>
Aug 01 19:49:55 user nova-compute[72504]:     </nova:instance>
Aug 01 19:49:55 user nova-compute[72504]:   </metadata>
Aug 01 19:49:55 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:49:55 user nova-compute[72504]:     <system>
Aug 01 19:49:55 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:49:55 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:49:55 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:49:55 user nova-compute[72504]:       <entry name="serial">a8966321-946f-4988-83f5-c71cabb1c094</entry>
Aug 01 19:49:55 user nova-compute[72504]:       <entry name="uuid">a8966321-946f-4988-83f5-c71cabb1c094</entry>
Aug 01 19:49:55 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:49:55 user nova-compute[72504]:     </system>
Aug 01 19:49:55 user nova-compute[72504]:   </sysinfo>
Aug 01 19:49:55 user nova-compute[72504]:   <os>
Aug 01 19:49:55 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:49:55 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:49:55 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:49:55 user nova-compute[72504]:   </os>
Aug 01 19:49:55 user nova-compute[72504]:   <features>
Aug 01 19:49:55 user nova-compute[72504]:     <acpi/>
Aug 01 19:49:55 user nova-compute[72504]:     <apic/>
Aug 01 19:49:55 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:49:55 user nova-compute[72504]:   </features>
Aug 01 19:49:55 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:49:55 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:49:55 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:49:55 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:49:55 user nova-compute[72504]:   </clock>
Aug 01 19:49:55 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:49:55 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:49:55 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:49:55 user nova-compute[72504]:   </cpu>
Aug 01 19:49:55 user nova-compute[72504]:   <devices>
Aug 01 19:49:55 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:49:55 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:49:55 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/a8966321-946f-4988-83f5-c71cabb1c094/disk"/>
Aug 01 19:49:55 user nova-compute[72504]:       <target dev="sda" bus="scsi"/>
Aug 01 19:49:55 user nova-compute[72504]:       <address type="drive" controller="0" unit="0"/>
Aug 01 19:49:55 user nova-compute[72504]:     </disk>
Aug 01 19:49:55 user nova-compute[72504]:     <disk type="file" device="cdrom">
Aug 01 19:49:55 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 19:49:55 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/a8966321-946f-4988-83f5-c71cabb1c094/disk.config"/>
Aug 01 19:49:55 user nova-compute[72504]:       <target dev="sdb" bus="scsi"/>
Aug 01 19:49:55 user nova-compute[72504]:       <address type="drive" controller="0" unit="1"/>
Aug 01 19:49:55 user nova-compute[72504]:     </disk>
Aug 01 19:49:55 user nova-compute[72504]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 01 19:49:55 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:49:55 user nova-compute[72504]:       <mac address="fa:16:3e:bd:89:6b"/>
Aug 01 19:49:55 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:49:55 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:49:55 user nova-compute[72504]:       <target dev="tap6698435e-de"/>
Aug 01 19:49:55 user nova-compute[72504]:     </interface>
Aug 01 19:49:55 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:49:55 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/a8966321-946f-4988-83f5-c71cabb1c094/console.log" append="off"/>
Aug 01 19:49:55 user nova-compute[72504]:     </serial>
Aug 01 19:49:55 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:49:55 user nova-compute[72504]:     <video>
Aug 01 19:49:55 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:49:55 user nova-compute[72504]:     </video>
Aug 01 19:49:55 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:49:55 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:49:55 user nova-compute[72504]:     </rng>
Aug 01 19:49:55 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:49:55 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:49:55 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:49:55 user nova-compute[72504]:     </memballoon>
Aug 01 19:49:55 user nova-compute[72504]:   </devices>
Aug 01 19:49:55 user nova-compute[72504]: </domain>
Aug 01 19:49:55 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:49:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1681496768',display_name='tempest-AttachSCSIVolumeTestJSON-server-1681496768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1681496768',id=6,image_ref='608990c8-07be-45f7-84d1-1ba4d0d390d6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTafKCY44Fzr43KaPS96ziwv+rxw+O+c49opwupGkQLUaS3Hg0ovp6ybqVBUHcBDN365QGu/f5jDFSmp+B9ddflmSL8wop3loCxBBcDxSde3Ig9vk3+IP0Iu5Os/me4nQ==',key_name='tempest-keypair-636030287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4f8a671a5994b72a02f99185c5838cf',ramdisk_id='',reservation_id='r-tr8nwqwi',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='608990c8-07be-45f7-84d1-1ba4d0d390d6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2019072662',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2019072662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:49:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2fcce6ceaee4043a7aaac1d550884d6',uuid=a8966321-946f-4988-83f5-c71cabb1c094,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6698435e-de04-4c41-8f14-356dd152aa0d", "address": "fa:16:3e:bd:89:6b", "network": {"id": "4c56cdef-5441-46f2-abda-780f3573ccaf", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1603717847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4f8a671a5994b72a02f99185c5838cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6698435e-de", "ovs_interfaceid": "6698435e-de04-4c41-8f14-356dd152aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Converting VIF {"id": "6698435e-de04-4c41-8f14-356dd152aa0d", "address": "fa:16:3e:bd:89:6b", "network": {"id": "4c56cdef-5441-46f2-abda-780f3573ccaf", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1603717847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4f8a671a5994b72a02f99185c5838cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6698435e-de", "ovs_interfaceid": "6698435e-de04-4c41-8f14-356dd152aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:89:6b,bridge_name='br-int',has_traffic_filtering=True,id=6698435e-de04-4c41-8f14-356dd152aa0d,network=Network(4c56cdef-5441-46f2-abda-780f3573ccaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6698435e-de') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG os_vif [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:89:6b,bridge_name='br-int',has_traffic_filtering=True,id=6698435e-de04-4c41-8f14-356dd152aa0d,network=Network(4c56cdef-5441-46f2-abda-780f3573ccaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6698435e-de') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6698435e-de, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6698435e-de, col_values=(('external_ids', {'iface-id': '6698435e-de04-4c41-8f14-356dd152aa0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:89:6b', 'vm-uuid': 'a8966321-946f-4988-83f5-c71cabb1c094'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:56 user nova-compute[72504]: INFO os_vif [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:89:6b,bridge_name='br-int',has_traffic_filtering=True,id=6698435e-de04-4c41-8f14-356dd152aa0d,network=Network(4c56cdef-5441-46f2-abda-780f3573ccaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6698435e-de')
Aug 01 19:49:56 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] No BDM found with device name sda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] No VIF found with MAC fa:16:3e:bd:89:6b, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:49:56 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Using config drive
Aug 01 19:49:56 user nova-compute[72504]: DEBUG nova.network.neutron [req-14ca3a0b-1445-438f-a153-a8f41402d065 req-52934efa-a868-4721-90f9-6ecc1546924d service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Updated VIF entry in instance network info cache for port 6698435e-de04-4c41-8f14-356dd152aa0d. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG nova.network.neutron [req-14ca3a0b-1445-438f-a153-a8f41402d065 req-52934efa-a868-4721-90f9-6ecc1546924d service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Updating instance_info_cache with network_info: [{"id": "6698435e-de04-4c41-8f14-356dd152aa0d", "address": "fa:16:3e:bd:89:6b", "network": {"id": "4c56cdef-5441-46f2-abda-780f3573ccaf", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1603717847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4f8a671a5994b72a02f99185c5838cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6698435e-de", "ovs_interfaceid": "6698435e-de04-4c41-8f14-356dd152aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-14ca3a0b-1445-438f-a153-a8f41402d065 req-52934efa-a868-4721-90f9-6ecc1546924d service nova] Releasing lock "refresh_cache-a8966321-946f-4988-83f5-c71cabb1c094" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG nova.network.neutron [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Successfully updated port: f0a2194f-e3b8-48c4-9157-a35a3f66165b {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:49:56 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Creating config drive at /opt/stack/data/nova/instances/a8966321-946f-4988-83f5-c71cabb1c094/disk.config
Aug 01 19:49:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a8966321-946f-4988-83f5-c71cabb1c094/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz6sa2iu0 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Acquiring lock "refresh_cache-561928fb-3c41-4937-8050-9125614c0641" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Acquired lock "refresh_cache-561928fb-3c41-4937-8050-9125614c0641" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG nova.network.neutron [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a8966321-946f-4988-83f5-c71cabb1c094/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz6sa2iu0" returned: 0 in 0.062s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG nova.compute.manager [req-14f64474-2f15-437d-bc1f-7233983b10ba req-e562a7d3-9cc7-4b2d-a8d2-6c2ab5e4da01 service nova] [instance: 561928fb-3c41-4937-8050-9125614c0641] Received event network-changed-f0a2194f-e3b8-48c4-9157-a35a3f66165b {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG nova.compute.manager [req-14f64474-2f15-437d-bc1f-7233983b10ba req-e562a7d3-9cc7-4b2d-a8d2-6c2ab5e4da01 service nova] [instance: 561928fb-3c41-4937-8050-9125614c0641] Refreshing instance network info cache due to event network-changed-f0a2194f-e3b8-48c4-9157-a35a3f66165b. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-14f64474-2f15-437d-bc1f-7233983b10ba req-e562a7d3-9cc7-4b2d-a8d2-6c2ab5e4da01 service nova] Acquiring lock "refresh_cache-561928fb-3c41-4937-8050-9125614c0641" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.246s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:56 user nova-compute[72504]: DEBUG nova.compute.manager [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.network.neutron [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.network.neutron [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 19:49:57 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.policy [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0602032d5a34a83a13a4888436b689e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd6112c6db747f297455ca969783d11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.network.neutron [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Updating instance_info_cache with network_info: [{"id": "f0a2194f-e3b8-48c4-9157-a35a3f66165b", "address": "fa:16:3e:dc:6f:47", "network": {"id": "40216131-7be3-423d-84ca-9d603526db4b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1648510237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50a77655071466db7143ff1850d3272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a2194f-e3", "ovs_interfaceid": "f0a2194f-e3b8-48c4-9157-a35a3f66165b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Releasing lock "refresh_cache-561928fb-3c41-4937-8050-9125614c0641" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Instance network_info: |[{"id": "f0a2194f-e3b8-48c4-9157-a35a3f66165b", "address": "fa:16:3e:dc:6f:47", "network": {"id": "40216131-7be3-423d-84ca-9d603526db4b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1648510237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50a77655071466db7143ff1850d3272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a2194f-e3", "ovs_interfaceid": "f0a2194f-e3b8-48c4-9157-a35a3f66165b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-14f64474-2f15-437d-bc1f-7233983b10ba req-e562a7d3-9cc7-4b2d-a8d2-6c2ab5e4da01 service nova] Acquired lock "refresh_cache-561928fb-3c41-4937-8050-9125614c0641" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.network.neutron [req-14f64474-2f15-437d-bc1f-7233983b10ba req-e562a7d3-9cc7-4b2d-a8d2-6c2ab5e4da01 service nova] [instance: 561928fb-3c41-4937-8050-9125614c0641] Refreshing network info cache for port f0a2194f-e3b8-48c4-9157-a35a3f66165b {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Start _get_guest_xml network_info=[{"id": "f0a2194f-e3b8-48c4-9157-a35a3f66165b", "address": "fa:16:3e:dc:6f:47", "network": {"id": "40216131-7be3-423d-84ca-9d603526db4b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1648510237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50a77655071466db7143ff1850d3272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a2194f-e3", "ovs_interfaceid": "f0a2194f-e3b8-48c4-9157-a35a3f66165b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:49:57 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:49:57 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:49:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-170433704',display_name='tempest-TestVolumeSwap-server-170433704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-170433704',id=7,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdArI2BI+w4OIKAh15lONV9nLC241WS/+xg+KkRdU3FJ6JUxowpmCmivlbwXNGHqYkx1nd2zKGUUnS6kTTXrhL4FLCki3F9ONJWjaVBs6IE2lcRsMdiiJg0Dj/uGvGGWA==',key_name='tempest-keypair-601182215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d50a77655071466db7143ff1850d3272',ramdisk_id='',reservation_id='r-61l3jvmf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1100350241',owner_user_name='tempest-TestVolumeSwap-1100350241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:49:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dceab608a5664f638e7b0a3cdfac854a',uuid=561928fb-3c41-4937-8050-9125614c0641,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0a2194f-e3b8-48c4-9157-a35a3f66165b", "address": "fa:16:3e:dc:6f:47", "network": {"id": "40216131-7be3-423d-84ca-9d603526db4b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1648510237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50a77655071466db7143ff1850d3272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a2194f-e3", "ovs_interfaceid": "f0a2194f-e3b8-48c4-9157-a35a3f66165b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Converting VIF {"id": "f0a2194f-e3b8-48c4-9157-a35a3f66165b", "address": "fa:16:3e:dc:6f:47", "network": {"id": "40216131-7be3-423d-84ca-9d603526db4b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1648510237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50a77655071466db7143ff1850d3272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a2194f-e3", "ovs_interfaceid": "f0a2194f-e3b8-48c4-9157-a35a3f66165b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:6f:47,bridge_name='br-int',has_traffic_filtering=True,id=f0a2194f-e3b8-48c4-9157-a35a3f66165b,network=Network(40216131-7be3-423d-84ca-9d603526db4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0a2194f-e3') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.objects.instance [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lazy-loading 'pci_devices' on Instance uuid 561928fb-3c41-4937-8050-9125614c0641 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:49:57 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Creating image(s)
Aug 01 19:49:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "/opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "/opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:49:57 user nova-compute[72504]:   <uuid>561928fb-3c41-4937-8050-9125614c0641</uuid>
Aug 01 19:49:57 user nova-compute[72504]:   <name>instance-00000007</name>
Aug 01 19:49:57 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:49:57 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:49:57 user nova-compute[72504]:   <metadata>
Aug 01 19:49:57 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:49:57 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:49:57 user nova-compute[72504]:       <nova:name>tempest-TestVolumeSwap-server-170433704</nova:name>
Aug 01 19:49:57 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:49:57</nova:creationTime>
Aug 01 19:49:57 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:49:57 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:49:57 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:49:57 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:49:57 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:49:57 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:49:57 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:49:57 user nova-compute[72504]:       <nova:owner>
Aug 01 19:49:57 user nova-compute[72504]:         <nova:user uuid="dceab608a5664f638e7b0a3cdfac854a">tempest-TestVolumeSwap-1100350241-project-member</nova:user>
Aug 01 19:49:57 user nova-compute[72504]:         <nova:project uuid="d50a77655071466db7143ff1850d3272">tempest-TestVolumeSwap-1100350241</nova:project>
Aug 01 19:49:57 user nova-compute[72504]:       </nova:owner>
Aug 01 19:49:57 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:49:57 user nova-compute[72504]:       <nova:ports>
Aug 01 19:49:57 user nova-compute[72504]:         <nova:port uuid="f0a2194f-e3b8-48c4-9157-a35a3f66165b">
Aug 01 19:49:57 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 19:49:57 user nova-compute[72504]:         </nova:port>
Aug 01 19:49:57 user nova-compute[72504]:       </nova:ports>
Aug 01 19:49:57 user nova-compute[72504]:     </nova:instance>
Aug 01 19:49:57 user nova-compute[72504]:   </metadata>
Aug 01 19:49:57 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:49:57 user nova-compute[72504]:     <system>
Aug 01 19:49:57 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:49:57 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:49:57 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:49:57 user nova-compute[72504]:       <entry name="serial">561928fb-3c41-4937-8050-9125614c0641</entry>
Aug 01 19:49:57 user nova-compute[72504]:       <entry name="uuid">561928fb-3c41-4937-8050-9125614c0641</entry>
Aug 01 19:49:57 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:49:57 user nova-compute[72504]:     </system>
Aug 01 19:49:57 user nova-compute[72504]:   </sysinfo>
Aug 01 19:49:57 user nova-compute[72504]:   <os>
Aug 01 19:49:57 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:49:57 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:49:57 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:49:57 user nova-compute[72504]:   </os>
Aug 01 19:49:57 user nova-compute[72504]:   <features>
Aug 01 19:49:57 user nova-compute[72504]:     <acpi/>
Aug 01 19:49:57 user nova-compute[72504]:     <apic/>
Aug 01 19:49:57 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:49:57 user nova-compute[72504]:   </features>
Aug 01 19:49:57 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:49:57 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:49:57 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:49:57 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:49:57 user nova-compute[72504]:   </clock>
Aug 01 19:49:57 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:49:57 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:49:57 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:49:57 user nova-compute[72504]:   </cpu>
Aug 01 19:49:57 user nova-compute[72504]:   <devices>
Aug 01 19:49:57 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:49:57 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:49:57 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641/disk"/>
Aug 01 19:49:57 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:49:57 user nova-compute[72504]:     </disk>
Aug 01 19:49:57 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:49:57 user nova-compute[72504]:       <mac address="fa:16:3e:dc:6f:47"/>
Aug 01 19:49:57 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:49:57 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:49:57 user nova-compute[72504]:       <target dev="tapf0a2194f-e3"/>
Aug 01 19:49:57 user nova-compute[72504]:     </interface>
Aug 01 19:49:57 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:49:57 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641/console.log" append="off"/>
Aug 01 19:49:57 user nova-compute[72504]:     </serial>
Aug 01 19:49:57 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:49:57 user nova-compute[72504]:     <video>
Aug 01 19:49:57 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:49:57 user nova-compute[72504]:     </video>
Aug 01 19:49:57 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:49:57 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:49:57 user nova-compute[72504]:     </rng>
Aug 01 19:49:57 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:49:57 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:49:57 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:49:57 user nova-compute[72504]:     </memballoon>
Aug 01 19:49:57 user nova-compute[72504]:   </devices>
Aug 01 19:49:57 user nova-compute[72504]: </domain>
Aug 01 19:49:57 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:49:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-170433704',display_name='tempest-TestVolumeSwap-server-170433704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-170433704',id=7,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdArI2BI+w4OIKAh15lONV9nLC241WS/+xg+KkRdU3FJ6JUxowpmCmivlbwXNGHqYkx1nd2zKGUUnS6kTTXrhL4FLCki3F9ONJWjaVBs6IE2lcRsMdiiJg0Dj/uGvGGWA==',key_name='tempest-keypair-601182215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d50a77655071466db7143ff1850d3272',ramdisk_id='',reservation_id='r-61l3jvmf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1100350241',owner_user_name='tempest-TestVolumeSwap-1100350241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:49:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dceab608a5664f638e7b0a3cdfac854a',uuid=561928fb-3c41-4937-8050-9125614c0641,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0a2194f-e3b8-48c4-9157-a35a3f66165b", "address": "fa:16:3e:dc:6f:47", "network": {"id": "40216131-7be3-423d-84ca-9d603526db4b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1648510237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50a77655071466db7143ff1850d3272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a2194f-e3", "ovs_interfaceid": "f0a2194f-e3b8-48c4-9157-a35a3f66165b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Converting VIF {"id": "f0a2194f-e3b8-48c4-9157-a35a3f66165b", "address": "fa:16:3e:dc:6f:47", "network": {"id": "40216131-7be3-423d-84ca-9d603526db4b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1648510237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50a77655071466db7143ff1850d3272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a2194f-e3", "ovs_interfaceid": "f0a2194f-e3b8-48c4-9157-a35a3f66165b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:6f:47,bridge_name='br-int',has_traffic_filtering=True,id=f0a2194f-e3b8-48c4-9157-a35a3f66165b,network=Network(40216131-7be3-423d-84ca-9d603526db4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0a2194f-e3') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG os_vif [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:6f:47,bridge_name='br-int',has_traffic_filtering=True,id=f0a2194f-e3b8-48c4-9157-a35a3f66165b,network=Network(40216131-7be3-423d-84ca-9d603526db4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0a2194f-e3') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0a2194f-e3, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf0a2194f-e3, col_values=(('external_ids', {'iface-id': 'f0a2194f-e3b8-48c4-9157-a35a3f66165b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:6f:47', 'vm-uuid': '561928fb-3c41-4937-8050-9125614c0641'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:57 user nova-compute[72504]: INFO os_vif [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:6f:47,bridge_name='br-int',has_traffic_filtering=True,id=f0a2194f-e3b8-48c4-9157-a35a3f66165b,network=Network(40216131-7be3-423d-84ca-9d603526db4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0a2194f-e3')
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] No VIF found with MAC fa:16:3e:dc:6f:47, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.263s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.209s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk 1073741824" returned: 0 in 0.080s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:58 user nova-compute[72504]: DEBUG nova.network.neutron [req-14f64474-2f15-437d-bc1f-7233983b10ba req-e562a7d3-9cc7-4b2d-a8d2-6c2ab5e4da01 service nova] [instance: 561928fb-3c41-4937-8050-9125614c0641] Updated VIF entry in instance network info cache for port f0a2194f-e3b8-48c4-9157-a35a3f66165b. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:49:58 user nova-compute[72504]: DEBUG nova.network.neutron [req-14f64474-2f15-437d-bc1f-7233983b10ba req-e562a7d3-9cc7-4b2d-a8d2-6c2ab5e4da01 service nova] [instance: 561928fb-3c41-4937-8050-9125614c0641] Updating instance_info_cache with network_info: [{"id": "f0a2194f-e3b8-48c4-9157-a35a3f66165b", "address": "fa:16:3e:dc:6f:47", "network": {"id": "40216131-7be3-423d-84ca-9d603526db4b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1648510237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50a77655071466db7143ff1850d3272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a2194f-e3", "ovs_interfaceid": "f0a2194f-e3b8-48c4-9157-a35a3f66165b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:49:58 user nova-compute[72504]: DEBUG nova.network.neutron [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Successfully created port: 381103b0-a255-4d2a-b20e-8dc4b15028e9 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:49:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-14f64474-2f15-437d-bc1f-7233983b10ba req-e562a7d3-9cc7-4b2d-a8d2-6c2ab5e4da01 service nova] Releasing lock "refresh_cache-561928fb-3c41-4937-8050-9125614c0641" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:49:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.176s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:58 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 19:49:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:49:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:49:58 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Cannot resize image /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 19:49:58 user nova-compute[72504]: DEBUG nova.objects.instance [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lazy-loading 'migration_context' on Instance uuid c9fd391d-51c0-4ef9-86cc-5ce2c76c177a {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:49:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 19:49:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Ensure instance console log exists: /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:49:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:49:59 user nova-compute[72504]: DEBUG nova.network.neutron [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Successfully updated port: 381103b0-a255-4d2a-b20e-8dc4b15028e9 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:49:59 user nova-compute[72504]: DEBUG nova.compute.manager [req-4198c2b3-5de7-41aa-bde1-880146776a12 req-e544a245-4e65-4eb0-9bb3-123040875266 service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Received event network-vif-plugged-6698435e-de04-4c41-8f14-356dd152aa0d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:49:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4198c2b3-5de7-41aa-bde1-880146776a12 req-e544a245-4e65-4eb0-9bb3-123040875266 service nova] Acquiring lock "a8966321-946f-4988-83f5-c71cabb1c094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:49:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4198c2b3-5de7-41aa-bde1-880146776a12 req-e544a245-4e65-4eb0-9bb3-123040875266 service nova] Lock "a8966321-946f-4988-83f5-c71cabb1c094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:49:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4198c2b3-5de7-41aa-bde1-880146776a12 req-e544a245-4e65-4eb0-9bb3-123040875266 service nova] Lock "a8966321-946f-4988-83f5-c71cabb1c094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:49:59 user nova-compute[72504]: DEBUG nova.compute.manager [req-4198c2b3-5de7-41aa-bde1-880146776a12 req-e544a245-4e65-4eb0-9bb3-123040875266 service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] No waiting events found dispatching network-vif-plugged-6698435e-de04-4c41-8f14-356dd152aa0d {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:49:59 user nova-compute[72504]: WARNING nova.compute.manager [req-4198c2b3-5de7-41aa-bde1-880146776a12 req-e544a245-4e65-4eb0-9bb3-123040875266 service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Received unexpected event network-vif-plugged-6698435e-de04-4c41-8f14-356dd152aa0d for instance with vm_state building and task_state spawning.
Aug 01 19:49:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Acquiring lock "refresh_cache-c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:49:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Acquired lock "refresh_cache-c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:49:59 user nova-compute[72504]: DEBUG nova.network.neutron [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:49:59 user nova-compute[72504]: DEBUG nova.compute.manager [req-aca4c0dc-4fc9-429c-8285-7abcdc4ed65c req-0368b7a1-3b44-4cad-b194-f25ce3e458b0 service nova] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Received event network-changed-381103b0-a255-4d2a-b20e-8dc4b15028e9 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:49:59 user nova-compute[72504]: DEBUG nova.compute.manager [req-aca4c0dc-4fc9-429c-8285-7abcdc4ed65c req-0368b7a1-3b44-4cad-b194-f25ce3e458b0 service nova] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Refreshing instance network info cache due to event network-changed-381103b0-a255-4d2a-b20e-8dc4b15028e9. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:49:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-aca4c0dc-4fc9-429c-8285-7abcdc4ed65c req-0368b7a1-3b44-4cad-b194-f25ce3e458b0 service nova] Acquiring lock "refresh_cache-c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:49:59 user nova-compute[72504]: DEBUG nova.network.neutron [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:49:59 user nova-compute[72504]: DEBUG nova.network.neutron [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Updating instance_info_cache with network_info: [{"id": "381103b0-a255-4d2a-b20e-8dc4b15028e9", "address": "fa:16:3e:45:86:19", "network": {"id": "b2c62156-50c6-4f54-b857-961843d14579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-554746486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd6112c6db747f297455ca969783d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381103b0-a2", "ovs_interfaceid": "381103b0-a255-4d2a-b20e-8dc4b15028e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Releasing lock "refresh_cache-c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.compute.manager [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Instance network_info: |[{"id": "381103b0-a255-4d2a-b20e-8dc4b15028e9", "address": "fa:16:3e:45:86:19", "network": {"id": "b2c62156-50c6-4f54-b857-961843d14579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-554746486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd6112c6db747f297455ca969783d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381103b0-a2", "ovs_interfaceid": "381103b0-a255-4d2a-b20e-8dc4b15028e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-aca4c0dc-4fc9-429c-8285-7abcdc4ed65c req-0368b7a1-3b44-4cad-b194-f25ce3e458b0 service nova] Acquired lock "refresh_cache-c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.network.neutron [req-aca4c0dc-4fc9-429c-8285-7abcdc4ed65c req-0368b7a1-3b44-4cad-b194-f25ce3e458b0 service nova] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Refreshing network info cache for port 381103b0-a255-4d2a-b20e-8dc4b15028e9 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Start _get_guest_xml network_info=[{"id": "381103b0-a255-4d2a-b20e-8dc4b15028e9", "address": "fa:16:3e:45:86:19", "network": {"id": "b2c62156-50c6-4f54-b857-961843d14579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-554746486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd6112c6db747f297455ca969783d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381103b0-a2", "ovs_interfaceid": "381103b0-a255-4d2a-b20e-8dc4b15028e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:50:00 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:50:00 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:49:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-908512508',display_name='tempest-VolumesAdminNegativeTest-server-908512508',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-908512508',id=8,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCk7TpUmVRM2lmn7tJzfWortxYyXW44Sed676LjnmBKUTRKstRWrja7p5I0Sk7y9Or/uFmAWV2bnbIpB1eJU/jykNbsJYeBm1icL5nD9s57fLURgdyJbTctrx8tqdDBR0A==',key_name='tempest-keypair-674067401',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4bd6112c6db747f297455ca969783d11',ramdisk_id='',reservation_id='r-bvj0pk1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1986244634',owner_user_name='tempest-VolumesAdminNegativeTest-1986244634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:49:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0602032d5a34a83a13a4888436b689e',uuid=c9fd391d-51c0-4ef9-86cc-5ce2c76c177a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "381103b0-a255-4d2a-b20e-8dc4b15028e9", "address": "fa:16:3e:45:86:19", "network": {"id": "b2c62156-50c6-4f54-b857-961843d14579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-554746486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd6112c6db747f297455ca969783d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381103b0-a2", "ovs_interfaceid": "381103b0-a255-4d2a-b20e-8dc4b15028e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Converting VIF {"id": "381103b0-a255-4d2a-b20e-8dc4b15028e9", "address": "fa:16:3e:45:86:19", "network": {"id": "b2c62156-50c6-4f54-b857-961843d14579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-554746486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd6112c6db747f297455ca969783d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381103b0-a2", "ovs_interfaceid": "381103b0-a255-4d2a-b20e-8dc4b15028e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:86:19,bridge_name='br-int',has_traffic_filtering=True,id=381103b0-a255-4d2a-b20e-8dc4b15028e9,network=Network(b2c62156-50c6-4f54-b857-961843d14579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap381103b0-a2') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.objects.instance [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lazy-loading 'pci_devices' on Instance uuid c9fd391d-51c0-4ef9-86cc-5ce2c76c177a {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:50:00 user nova-compute[72504]:   <uuid>c9fd391d-51c0-4ef9-86cc-5ce2c76c177a</uuid>
Aug 01 19:50:00 user nova-compute[72504]:   <name>instance-00000008</name>
Aug 01 19:50:00 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:50:00 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:50:00 user nova-compute[72504]:   <metadata>
Aug 01 19:50:00 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:50:00 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:50:00 user nova-compute[72504]:       <nova:name>tempest-VolumesAdminNegativeTest-server-908512508</nova:name>
Aug 01 19:50:00 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:50:00</nova:creationTime>
Aug 01 19:50:00 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:50:00 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:50:00 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:50:00 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:50:00 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:50:00 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:50:00 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:50:00 user nova-compute[72504]:       <nova:owner>
Aug 01 19:50:00 user nova-compute[72504]:         <nova:user uuid="d0602032d5a34a83a13a4888436b689e">tempest-VolumesAdminNegativeTest-1986244634-project-member</nova:user>
Aug 01 19:50:00 user nova-compute[72504]:         <nova:project uuid="4bd6112c6db747f297455ca969783d11">tempest-VolumesAdminNegativeTest-1986244634</nova:project>
Aug 01 19:50:00 user nova-compute[72504]:       </nova:owner>
Aug 01 19:50:00 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:50:00 user nova-compute[72504]:       <nova:ports>
Aug 01 19:50:00 user nova-compute[72504]:         <nova:port uuid="381103b0-a255-4d2a-b20e-8dc4b15028e9">
Aug 01 19:50:00 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 19:50:00 user nova-compute[72504]:         </nova:port>
Aug 01 19:50:00 user nova-compute[72504]:       </nova:ports>
Aug 01 19:50:00 user nova-compute[72504]:     </nova:instance>
Aug 01 19:50:00 user nova-compute[72504]:   </metadata>
Aug 01 19:50:00 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:50:00 user nova-compute[72504]:     <system>
Aug 01 19:50:00 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:50:00 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:50:00 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:50:00 user nova-compute[72504]:       <entry name="serial">c9fd391d-51c0-4ef9-86cc-5ce2c76c177a</entry>
Aug 01 19:50:00 user nova-compute[72504]:       <entry name="uuid">c9fd391d-51c0-4ef9-86cc-5ce2c76c177a</entry>
Aug 01 19:50:00 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:50:00 user nova-compute[72504]:     </system>
Aug 01 19:50:00 user nova-compute[72504]:   </sysinfo>
Aug 01 19:50:00 user nova-compute[72504]:   <os>
Aug 01 19:50:00 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:50:00 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:50:00 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:50:00 user nova-compute[72504]:   </os>
Aug 01 19:50:00 user nova-compute[72504]:   <features>
Aug 01 19:50:00 user nova-compute[72504]:     <acpi/>
Aug 01 19:50:00 user nova-compute[72504]:     <apic/>
Aug 01 19:50:00 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:50:00 user nova-compute[72504]:   </features>
Aug 01 19:50:00 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:50:00 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:50:00 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:50:00 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:50:00 user nova-compute[72504]:   </clock>
Aug 01 19:50:00 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:50:00 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:50:00 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:50:00 user nova-compute[72504]:   </cpu>
Aug 01 19:50:00 user nova-compute[72504]:   <devices>
Aug 01 19:50:00 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:50:00 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:50:00 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk"/>
Aug 01 19:50:00 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:50:00 user nova-compute[72504]:     </disk>
Aug 01 19:50:00 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:50:00 user nova-compute[72504]:       <mac address="fa:16:3e:45:86:19"/>
Aug 01 19:50:00 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:50:00 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:50:00 user nova-compute[72504]:       <target dev="tap381103b0-a2"/>
Aug 01 19:50:00 user nova-compute[72504]:     </interface>
Aug 01 19:50:00 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:50:00 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/console.log" append="off"/>
Aug 01 19:50:00 user nova-compute[72504]:     </serial>
Aug 01 19:50:00 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:50:00 user nova-compute[72504]:     <video>
Aug 01 19:50:00 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:50:00 user nova-compute[72504]:     </video>
Aug 01 19:50:00 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:50:00 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:50:00 user nova-compute[72504]:     </rng>
Aug 01 19:50:00 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:50:00 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:50:00 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:50:00 user nova-compute[72504]:     </memballoon>
Aug 01 19:50:00 user nova-compute[72504]:   </devices>
Aug 01 19:50:00 user nova-compute[72504]: </domain>
Aug 01 19:50:00 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:49:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-908512508',display_name='tempest-VolumesAdminNegativeTest-server-908512508',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-908512508',id=8,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCk7TpUmVRM2lmn7tJzfWortxYyXW44Sed676LjnmBKUTRKstRWrja7p5I0Sk7y9Or/uFmAWV2bnbIpB1eJU/jykNbsJYeBm1icL5nD9s57fLURgdyJbTctrx8tqdDBR0A==',key_name='tempest-keypair-674067401',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4bd6112c6db747f297455ca969783d11',ramdisk_id='',reservation_id='r-bvj0pk1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1986244634',owner_user_name='tempest-VolumesAdminNegativeTest-1986244634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:49:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0602032d5a34a83a13a4888436b689e',uuid=c9fd391d-51c0-4ef9-86cc-5ce2c76c177a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "381103b0-a255-4d2a-b20e-8dc4b15028e9", "address": "fa:16:3e:45:86:19", "network": {"id": "b2c62156-50c6-4f54-b857-961843d14579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-554746486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd6112c6db747f297455ca969783d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381103b0-a2", "ovs_interfaceid": "381103b0-a255-4d2a-b20e-8dc4b15028e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Converting VIF {"id": "381103b0-a255-4d2a-b20e-8dc4b15028e9", "address": "fa:16:3e:45:86:19", "network": {"id": "b2c62156-50c6-4f54-b857-961843d14579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-554746486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd6112c6db747f297455ca969783d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381103b0-a2", "ovs_interfaceid": "381103b0-a255-4d2a-b20e-8dc4b15028e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:86:19,bridge_name='br-int',has_traffic_filtering=True,id=381103b0-a255-4d2a-b20e-8dc4b15028e9,network=Network(b2c62156-50c6-4f54-b857-961843d14579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap381103b0-a2') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG os_vif [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:86:19,bridge_name='br-int',has_traffic_filtering=True,id=381103b0-a255-4d2a-b20e-8dc4b15028e9,network=Network(b2c62156-50c6-4f54-b857-961843d14579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap381103b0-a2') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap381103b0-a2, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap381103b0-a2, col_values=(('external_ids', {'iface-id': '381103b0-a255-4d2a-b20e-8dc4b15028e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:86:19', 'vm-uuid': 'c9fd391d-51c0-4ef9-86cc-5ce2c76c177a'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:00 user nova-compute[72504]: INFO os_vif [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:86:19,bridge_name='br-int',has_traffic_filtering=True,id=381103b0-a255-4d2a-b20e-8dc4b15028e9,network=Network(b2c62156-50c6-4f54-b857-961843d14579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap381103b0-a2')
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] No VIF found with MAC fa:16:3e:45:86:19, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.network.neutron [req-aca4c0dc-4fc9-429c-8285-7abcdc4ed65c req-0368b7a1-3b44-4cad-b194-f25ce3e458b0 service nova] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Updated VIF entry in instance network info cache for port 381103b0-a255-4d2a-b20e-8dc4b15028e9. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG nova.network.neutron [req-aca4c0dc-4fc9-429c-8285-7abcdc4ed65c req-0368b7a1-3b44-4cad-b194-f25ce3e458b0 service nova] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Updating instance_info_cache with network_info: [{"id": "381103b0-a255-4d2a-b20e-8dc4b15028e9", "address": "fa:16:3e:45:86:19", "network": {"id": "b2c62156-50c6-4f54-b857-961843d14579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-554746486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd6112c6db747f297455ca969783d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381103b0-a2", "ovs_interfaceid": "381103b0-a255-4d2a-b20e-8dc4b15028e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:50:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-aca4c0dc-4fc9-429c-8285-7abcdc4ed65c req-0368b7a1-3b44-4cad-b194-f25ce3e458b0 service nova] Releasing lock "refresh_cache-c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:50:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:01 user nova-compute[72504]: DEBUG nova.compute.manager [req-eacc9a43-d9ed-4859-9f4d-ca60ef871369 req-8458e298-6ec9-4d1b-ba3e-4913123216f0 service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Received event network-vif-plugged-6698435e-de04-4c41-8f14-356dd152aa0d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:50:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-eacc9a43-d9ed-4859-9f4d-ca60ef871369 req-8458e298-6ec9-4d1b-ba3e-4913123216f0 service nova] Acquiring lock "a8966321-946f-4988-83f5-c71cabb1c094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:50:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-eacc9a43-d9ed-4859-9f4d-ca60ef871369 req-8458e298-6ec9-4d1b-ba3e-4913123216f0 service nova] Lock "a8966321-946f-4988-83f5-c71cabb1c094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:50:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-eacc9a43-d9ed-4859-9f4d-ca60ef871369 req-8458e298-6ec9-4d1b-ba3e-4913123216f0 service nova] Lock "a8966321-946f-4988-83f5-c71cabb1c094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:50:01 user nova-compute[72504]: DEBUG nova.compute.manager [req-eacc9a43-d9ed-4859-9f4d-ca60ef871369 req-8458e298-6ec9-4d1b-ba3e-4913123216f0 service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] No waiting events found dispatching network-vif-plugged-6698435e-de04-4c41-8f14-356dd152aa0d {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:50:01 user nova-compute[72504]: WARNING nova.compute.manager [req-eacc9a43-d9ed-4859-9f4d-ca60ef871369 req-8458e298-6ec9-4d1b-ba3e-4913123216f0 service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Received unexpected event network-vif-plugged-6698435e-de04-4c41-8f14-356dd152aa0d for instance with vm_state building and task_state spawning.
Aug 01 19:50:01 user nova-compute[72504]: DEBUG nova.compute.manager [req-eacc9a43-d9ed-4859-9f4d-ca60ef871369 req-8458e298-6ec9-4d1b-ba3e-4913123216f0 service nova] [instance: 561928fb-3c41-4937-8050-9125614c0641] Received event network-vif-plugged-f0a2194f-e3b8-48c4-9157-a35a3f66165b {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:50:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-eacc9a43-d9ed-4859-9f4d-ca60ef871369 req-8458e298-6ec9-4d1b-ba3e-4913123216f0 service nova] Acquiring lock "561928fb-3c41-4937-8050-9125614c0641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:50:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-eacc9a43-d9ed-4859-9f4d-ca60ef871369 req-8458e298-6ec9-4d1b-ba3e-4913123216f0 service nova] Lock "561928fb-3c41-4937-8050-9125614c0641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:50:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-eacc9a43-d9ed-4859-9f4d-ca60ef871369 req-8458e298-6ec9-4d1b-ba3e-4913123216f0 service nova] Lock "561928fb-3c41-4937-8050-9125614c0641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:50:01 user nova-compute[72504]: DEBUG nova.compute.manager [req-eacc9a43-d9ed-4859-9f4d-ca60ef871369 req-8458e298-6ec9-4d1b-ba3e-4913123216f0 service nova] [instance: 561928fb-3c41-4937-8050-9125614c0641] No waiting events found dispatching network-vif-plugged-f0a2194f-e3b8-48c4-9157-a35a3f66165b {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:50:01 user nova-compute[72504]: WARNING nova.compute.manager [req-eacc9a43-d9ed-4859-9f4d-ca60ef871369 req-8458e298-6ec9-4d1b-ba3e-4913123216f0 service nova] [instance: 561928fb-3c41-4937-8050-9125614c0641] Received unexpected event network-vif-plugged-f0a2194f-e3b8-48c4-9157-a35a3f66165b for instance with vm_state building and task_state spawning.
Aug 01 19:50:01 user nova-compute[72504]: DEBUG nova.compute.manager [req-eacc9a43-d9ed-4859-9f4d-ca60ef871369 req-8458e298-6ec9-4d1b-ba3e-4913123216f0 service nova] [instance: 561928fb-3c41-4937-8050-9125614c0641] Received event network-vif-plugged-f0a2194f-e3b8-48c4-9157-a35a3f66165b {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:50:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-eacc9a43-d9ed-4859-9f4d-ca60ef871369 req-8458e298-6ec9-4d1b-ba3e-4913123216f0 service nova] Acquiring lock "561928fb-3c41-4937-8050-9125614c0641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:50:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-eacc9a43-d9ed-4859-9f4d-ca60ef871369 req-8458e298-6ec9-4d1b-ba3e-4913123216f0 service nova] Lock "561928fb-3c41-4937-8050-9125614c0641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:50:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-eacc9a43-d9ed-4859-9f4d-ca60ef871369 req-8458e298-6ec9-4d1b-ba3e-4913123216f0 service nova] Lock "561928fb-3c41-4937-8050-9125614c0641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:50:01 user nova-compute[72504]: DEBUG nova.compute.manager [req-eacc9a43-d9ed-4859-9f4d-ca60ef871369 req-8458e298-6ec9-4d1b-ba3e-4913123216f0 service nova] [instance: 561928fb-3c41-4937-8050-9125614c0641] No waiting events found dispatching network-vif-plugged-f0a2194f-e3b8-48c4-9157-a35a3f66165b {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:50:01 user nova-compute[72504]: WARNING nova.compute.manager [req-eacc9a43-d9ed-4859-9f4d-ca60ef871369 req-8458e298-6ec9-4d1b-ba3e-4913123216f0 service nova] [instance: 561928fb-3c41-4937-8050-9125614c0641] Received unexpected event network-vif-plugged-f0a2194f-e3b8-48c4-9157-a35a3f66165b for instance with vm_state building and task_state spawning.
Aug 01 19:50:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-fa139c0b-a679-4eb2-8326-8c4e39af109b req-6af7cc51-4041-4b90-883a-c1e89dab84ed service nova] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Received event network-vif-plugged-381103b0-a255-4d2a-b20e-8dc4b15028e9 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:50:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-fa139c0b-a679-4eb2-8326-8c4e39af109b req-6af7cc51-4041-4b90-883a-c1e89dab84ed service nova] Acquiring lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:50:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-fa139c0b-a679-4eb2-8326-8c4e39af109b req-6af7cc51-4041-4b90-883a-c1e89dab84ed service nova] Lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:50:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-fa139c0b-a679-4eb2-8326-8c4e39af109b req-6af7cc51-4041-4b90-883a-c1e89dab84ed service nova] Lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:50:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-fa139c0b-a679-4eb2-8326-8c4e39af109b req-6af7cc51-4041-4b90-883a-c1e89dab84ed service nova] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] No waiting events found dispatching network-vif-plugged-381103b0-a255-4d2a-b20e-8dc4b15028e9 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:50:03 user nova-compute[72504]: WARNING nova.compute.manager [req-fa139c0b-a679-4eb2-8326-8c4e39af109b req-6af7cc51-4041-4b90-883a-c1e89dab84ed service nova] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Received unexpected event network-vif-plugged-381103b0-a255-4d2a-b20e-8dc4b15028e9 for instance with vm_state building and task_state spawning.
Aug 01 19:50:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:04 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919404.6663816, a8966321-946f-4988-83f5-c71cabb1c094 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:50:04 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a8966321-946f-4988-83f5-c71cabb1c094] VM Resumed (Lifecycle Event)
Aug 01 19:50:04 user nova-compute[72504]: DEBUG nova.compute.manager [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:50:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:50:04 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Instance spawned successfully.
Aug 01 19:50:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 19:50:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:50:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:50:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:50:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:50:04 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:50:04 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:50:04 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a8966321-946f-4988-83f5-c71cabb1c094] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:50:04 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919404.6731267, a8966321-946f-4988-83f5-c71cabb1c094 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:50:04 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a8966321-946f-4988-83f5-c71cabb1c094] VM Started (Lifecycle Event)
Aug 01 19:50:04 user nova-compute[72504]: INFO nova.compute.manager [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Took 12.69 seconds to spawn the instance on the hypervisor.
Aug 01 19:50:04 user nova-compute[72504]: DEBUG nova.compute.manager [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:50:04 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:50:04 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:50:04 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a8966321-946f-4988-83f5-c71cabb1c094] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:50:04 user nova-compute[72504]: INFO nova.compute.manager [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Took 14.00 seconds to build instance.
Aug 01 19:50:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-80eaa0d7-2a3e-4b2f-bc1f-4bac79a507d7 tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "a8966321-946f-4988-83f5-c71cabb1c094" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.354s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:50:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.compute.manager [req-01d7bb11-1168-4479-a30a-0324fab41b15 req-2d484cc2-6af7-4b0d-97cc-a72f2a0d1487 service nova] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Received event network-vif-plugged-381103b0-a255-4d2a-b20e-8dc4b15028e9 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:50:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-01d7bb11-1168-4479-a30a-0324fab41b15 req-2d484cc2-6af7-4b0d-97cc-a72f2a0d1487 service nova] Acquiring lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:50:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-01d7bb11-1168-4479-a30a-0324fab41b15 req-2d484cc2-6af7-4b0d-97cc-a72f2a0d1487 service nova] Lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:50:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-01d7bb11-1168-4479-a30a-0324fab41b15 req-2d484cc2-6af7-4b0d-97cc-a72f2a0d1487 service nova] Lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.compute.manager [req-01d7bb11-1168-4479-a30a-0324fab41b15 req-2d484cc2-6af7-4b0d-97cc-a72f2a0d1487 service nova] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] No waiting events found dispatching network-vif-plugged-381103b0-a255-4d2a-b20e-8dc4b15028e9 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:50:05 user nova-compute[72504]: WARNING nova.compute.manager [req-01d7bb11-1168-4479-a30a-0324fab41b15 req-2d484cc2-6af7-4b0d-97cc-a72f2a0d1487 service nova] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Received unexpected event network-vif-plugged-381103b0-a255-4d2a-b20e-8dc4b15028e9 for instance with vm_state building and task_state spawning.
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919405.4988124, 561928fb-3c41-4937-8050-9125614c0641 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:50:05 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 561928fb-3c41-4937-8050-9125614c0641] VM Resumed (Lifecycle Event)
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:50:05 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 561928fb-3c41-4937-8050-9125614c0641] Instance spawned successfully.
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 561928fb-3c41-4937-8050-9125614c0641] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:50:05 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Instance spawned successfully.
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 561928fb-3c41-4937-8050-9125614c0641] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:50:05 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 561928fb-3c41-4937-8050-9125614c0641] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919405.5022497, 561928fb-3c41-4937-8050-9125614c0641 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:50:05 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 561928fb-3c41-4937-8050-9125614c0641] VM Started (Lifecycle Event)
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 561928fb-3c41-4937-8050-9125614c0641] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 561928fb-3c41-4937-8050-9125614c0641] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:50:05 user nova-compute[72504]: INFO nova.compute.manager [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Took 11.93 seconds to spawn the instance on the hypervisor.
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:50:05 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 561928fb-3c41-4937-8050-9125614c0641] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919405.5102935, c9fd391d-51c0-4ef9-86cc-5ce2c76c177a => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:50:05 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] VM Resumed (Lifecycle Event)
Aug 01 19:50:05 user nova-compute[72504]: INFO nova.compute.manager [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Took 8.06 seconds to spawn the instance on the hypervisor.
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:50:05 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919405.51297, c9fd391d-51c0-4ef9-86cc-5ce2c76c177a => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:50:05 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] VM Started (Lifecycle Event)
Aug 01 19:50:05 user nova-compute[72504]: INFO nova.compute.manager [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Took 13.93 seconds to build instance.
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:50:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:50:05 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:50:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-117dac8e-cb41-4559-98d2-377a37a4c0af tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lock "561928fb-3c41-4937-8050-9125614c0641" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.110s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:50:05 user nova-compute[72504]: INFO nova.compute.manager [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Took 10.20 seconds to build instance.
Aug 01 19:50:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5d695a31-6428-4e56-89ea-080585e5ea6d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.405s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:50:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:07 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:50:07 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Cleaning up deleted instances {{(pid=72504) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 19:50:07 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] There are 0 instances to clean {{(pid=72504) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 19:50:07 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:50:07 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72504) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 19:50:07 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:50:08 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:50:09 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:50:09 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:50:09 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:50:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:50:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:50:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:50:09 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:50:10 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:50:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:50:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8966321-946f-4988-83f5-c71cabb1c094/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8966321-946f-4988-83f5-c71cabb1c094/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:50:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8966321-946f-4988-83f5-c71cabb1c094/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8966321-946f-4988-83f5-c71cabb1c094/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:50:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:50:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:50:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:50:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:50:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eae5ffe-ab54-4dac-8169-69325448b92f/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eae5ffe-ab54-4dac-8169-69325448b92f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:50:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eae5ffe-ab54-4dac-8169-69325448b92f/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eae5ffe-ab54-4dac-8169-69325448b92f/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:50:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:50:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:50:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:50:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:50:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:50:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:50:13 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:50:13 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:50:13 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=7675MB free_disk=25.67718505859375GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:50:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:50:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:50:14 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 8eae5ffe-ab54-4dac-8169-69325448b92f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:50:14 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:50:14 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 5193c770-80ca-44c3-9950-cb25c65e94e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:50:14 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 76aa3861-0ca1-4e7f-9a15-9219037bc1ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:50:14 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1de87977-532f-45f7-856b-84df41b2a567 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:50:14 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance a8966321-946f-4988-83f5-c71cabb1c094 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:50:14 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 561928fb-3c41-4937-8050-9125614c0641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:50:14 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance c9fd391d-51c0-4ef9-86cc-5ce2c76c177a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:50:14 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:50:14 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:50:14 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:50:14 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:50:14 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:50:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.644s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:50:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:16 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:50:16 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:50:16 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:50:16 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 19:50:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-8eae5ffe-ab54-4dac-8169-69325448b92f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:50:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-8eae5ffe-ab54-4dac-8169-69325448b92f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:50:16 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 19:50:16 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lazy-loading 'info_cache' on Instance uuid 8eae5ffe-ab54-4dac-8169-69325448b92f {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:50:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:17 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Updating instance_info_cache with network_info: [{"id": "81de2627-8b32-47dc-ba79-56afa5d60500", "address": "fa:16:3e:8d:56:4a", "network": {"id": "e40d9428-7acd-446e-ae33-f0da22181354", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1238785586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2371740586fa42249a5299af53448e5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81de2627-8b", "ovs_interfaceid": "81de2627-8b32-47dc-ba79-56afa5d60500", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:50:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-8eae5ffe-ab54-4dac-8169-69325448b92f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:50:17 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 19:50:17 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:50:17 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:50:17 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:50:17 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:50:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:50:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:50:44 user nova-compute[72504]: DEBUG nova.compute.manager [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 19:50:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:50:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:50:44 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:50:44 user nova-compute[72504]: INFO nova.compute.claims [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Claim successful on node user
Aug 01 19:50:44 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Refreshing inventories for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 19:50:44 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Updating ProviderTree inventory for provider b951a798-e88c-472c-8347-2c5f6a05d47c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 19:50:44 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Updating inventory in ProviderTree for provider b951a798-e88c-472c-8347-2c5f6a05d47c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 19:50:44 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Refreshing aggregate associations for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c, aggregates: None {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 19:50:44 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Refreshing trait associations for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c, traits: HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 19:50:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:50:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:50:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:50:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:50:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:50:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:45 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:50:45 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:50:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.672s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:50:45 user nova-compute[72504]: DEBUG nova.compute.manager [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 19:50:45 user nova-compute[72504]: DEBUG nova.compute.manager [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 19:50:45 user nova-compute[72504]: DEBUG nova.network.neutron [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 19:50:45 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 19:50:45 user nova-compute[72504]: DEBUG nova.compute.manager [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 19:50:45 user nova-compute[72504]: INFO nova.virt.block_device [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Booting with volume e233d7c5-9e36-461b-850b-774fcad75f65 at /dev/vda
Aug 01 19:50:45 user nova-compute[72504]: DEBUG nova.policy [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82b31b1cbe344ff587c86d89c57b9325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f84d6702f394a86be93c8b569d31698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 19:50:45 user nova-compute[72504]: DEBUG os_brick.utils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:50:45 user nova-compute[72504]: INFO oslo.privsep.daemon [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmphs7mmdma/privsep.sock']
Aug 01 19:50:45 user sudo[83376]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmphs7mmdma/privsep.sock
Aug 01 19:50:45 user sudo[83376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 01 19:50:46 user nova-compute[72504]: DEBUG nova.network.neutron [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Successfully created port: 5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:50:46 user nova-compute[72504]: DEBUG nova.network.neutron [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Successfully created port: 97484d3b-3fdd-4ad3-8125-12117341441c {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:50:47 user nova-compute[72504]: DEBUG nova.network.neutron [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Successfully created port: 69b8504c-b89b-44af-9324-d6d096960909 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:50:47 user sudo[83376]: pam_unix(sudo:session): session closed for user root
Aug 01 19:50:47 user nova-compute[72504]: INFO oslo.privsep.daemon [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Spawned new privsep daemon via rootwrap
Aug 01 19:50:47 user nova-compute[72504]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 01 19:50:47 user nova-compute[72504]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 01 19:50:47 user nova-compute[72504]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 01 19:50:47 user nova-compute[72504]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83379
Aug 01 19:50:47 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d280b0a4-a8b0-45ad-b7e0-6485abf2807e]: (2,) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:50:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:50:47 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b9a7ba-8c51-4d6f-84b7-945fe52f64c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:50:47 user nova-compute[72504]: WARNING os_brick.initiator.connectors.nvmeof [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 01 19:50:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:50:47 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2dd635-dea9-4dfb-9801-03a8c1e24729]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:50:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:50:47 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c697e09-1291-44d7-a909-3a9f50cb3778]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:50:47 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93ff581-0ee4-4bfa-b25d-af7118d1c93d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:50:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:50:47 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:50:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:50:47 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:50:47 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ee5174-5990-4790-bb12-efff20415c17]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:50:47 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:50:47 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:50:47 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:50:47 user nova-compute[72504]: DEBUG os_brick.utils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] <== get_connector_properties: return (2147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:50:47 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Updating existing volume attachment record: 8dd33790-6101-4dfa-a1c5-b5d95921dfcb {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:50:48 user nova-compute[72504]: DEBUG nova.network.neutron [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Successfully created port: 462a6ab8-f964-4dda-9286-2fca0955907b {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:50:48 user nova-compute[72504]: DEBUG nova.network.neutron [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Successfully created port: f8fdda48-16be-4318-a84d-79d50154eec0 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:50:49 user nova-compute[72504]: DEBUG nova.network.neutron [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Successfully updated port: 5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:50:49 user nova-compute[72504]: DEBUG nova.compute.manager [req-95a7faa4-a09b-4aad-b9d8-82386d6b88ca req-da7ca3cc-d5da-41c5-99c1-5f118f6b4420 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-changed-5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:50:49 user nova-compute[72504]: DEBUG nova.compute.manager [req-95a7faa4-a09b-4aad-b9d8-82386d6b88ca req-da7ca3cc-d5da-41c5-99c1-5f118f6b4420 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Refreshing instance network info cache due to event network-changed-5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:50:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-95a7faa4-a09b-4aad-b9d8-82386d6b88ca req-da7ca3cc-d5da-41c5-99c1-5f118f6b4420 service nova] Acquiring lock "refresh_cache-6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:50:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-95a7faa4-a09b-4aad-b9d8-82386d6b88ca req-da7ca3cc-d5da-41c5-99c1-5f118f6b4420 service nova] Acquired lock "refresh_cache-6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:50:49 user nova-compute[72504]: DEBUG nova.network.neutron [req-95a7faa4-a09b-4aad-b9d8-82386d6b88ca req-da7ca3cc-d5da-41c5-99c1-5f118f6b4420 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Refreshing network info cache for port 5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:50:49 user nova-compute[72504]: DEBUG nova.network.neutron [req-95a7faa4-a09b-4aad-b9d8-82386d6b88ca req-da7ca3cc-d5da-41c5-99c1-5f118f6b4420 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:50:49 user nova-compute[72504]: DEBUG nova.network.neutron [req-95a7faa4-a09b-4aad-b9d8-82386d6b88ca req-da7ca3cc-d5da-41c5-99c1-5f118f6b4420 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:50:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-95a7faa4-a09b-4aad-b9d8-82386d6b88ca req-da7ca3cc-d5da-41c5-99c1-5f118f6b4420 service nova] Releasing lock "refresh_cache-6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:50:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:50 user nova-compute[72504]: DEBUG nova.network.neutron [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Successfully updated port: 423f358a-b722-4561-8f80-0c53f295e565 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:50:51 user nova-compute[72504]: DEBUG nova.network.neutron [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Successfully updated port: 16a739aa-8e59-4e49-9d81-2242527d12ab {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:50:51 user nova-compute[72504]: DEBUG nova.compute.manager [req-e45f2cea-9e3a-4d6a-847f-cbebeb2e7d88 req-7da9b470-e2f0-4dfa-9176-3a979ddea4df service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-changed-423f358a-b722-4561-8f80-0c53f295e565 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:50:51 user nova-compute[72504]: DEBUG nova.compute.manager [req-e45f2cea-9e3a-4d6a-847f-cbebeb2e7d88 req-7da9b470-e2f0-4dfa-9176-3a979ddea4df service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Refreshing instance network info cache due to event network-changed-423f358a-b722-4561-8f80-0c53f295e565. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:50:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e45f2cea-9e3a-4d6a-847f-cbebeb2e7d88 req-7da9b470-e2f0-4dfa-9176-3a979ddea4df service nova] Acquiring lock "refresh_cache-6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:50:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e45f2cea-9e3a-4d6a-847f-cbebeb2e7d88 req-7da9b470-e2f0-4dfa-9176-3a979ddea4df service nova] Acquired lock "refresh_cache-6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:50:51 user nova-compute[72504]: DEBUG nova.network.neutron [req-e45f2cea-9e3a-4d6a-847f-cbebeb2e7d88 req-7da9b470-e2f0-4dfa-9176-3a979ddea4df service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Refreshing network info cache for port 423f358a-b722-4561-8f80-0c53f295e565 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:50:51 user nova-compute[72504]: DEBUG nova.network.neutron [req-e45f2cea-9e3a-4d6a-847f-cbebeb2e7d88 req-7da9b470-e2f0-4dfa-9176-3a979ddea4df service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:50:51 user nova-compute[72504]: DEBUG nova.network.neutron [req-e45f2cea-9e3a-4d6a-847f-cbebeb2e7d88 req-7da9b470-e2f0-4dfa-9176-3a979ddea4df service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:50:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e45f2cea-9e3a-4d6a-847f-cbebeb2e7d88 req-7da9b470-e2f0-4dfa-9176-3a979ddea4df service nova] Releasing lock "refresh_cache-6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:50:51 user nova-compute[72504]: DEBUG nova.compute.manager [req-e45f2cea-9e3a-4d6a-847f-cbebeb2e7d88 req-7da9b470-e2f0-4dfa-9176-3a979ddea4df service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-changed-16a739aa-8e59-4e49-9d81-2242527d12ab {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:50:51 user nova-compute[72504]: DEBUG nova.compute.manager [req-e45f2cea-9e3a-4d6a-847f-cbebeb2e7d88 req-7da9b470-e2f0-4dfa-9176-3a979ddea4df service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Refreshing instance network info cache due to event network-changed-16a739aa-8e59-4e49-9d81-2242527d12ab. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:50:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e45f2cea-9e3a-4d6a-847f-cbebeb2e7d88 req-7da9b470-e2f0-4dfa-9176-3a979ddea4df service nova] Acquiring lock "refresh_cache-6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:50:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e45f2cea-9e3a-4d6a-847f-cbebeb2e7d88 req-7da9b470-e2f0-4dfa-9176-3a979ddea4df service nova] Acquired lock "refresh_cache-6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:50:51 user nova-compute[72504]: DEBUG nova.network.neutron [req-e45f2cea-9e3a-4d6a-847f-cbebeb2e7d88 req-7da9b470-e2f0-4dfa-9176-3a979ddea4df service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Refreshing network info cache for port 16a739aa-8e59-4e49-9d81-2242527d12ab {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:50:51 user nova-compute[72504]: DEBUG nova.network.neutron [req-e45f2cea-9e3a-4d6a-847f-cbebeb2e7d88 req-7da9b470-e2f0-4dfa-9176-3a979ddea4df service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:50:52 user nova-compute[72504]: DEBUG nova.network.neutron [req-e45f2cea-9e3a-4d6a-847f-cbebeb2e7d88 req-7da9b470-e2f0-4dfa-9176-3a979ddea4df service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:50:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e45f2cea-9e3a-4d6a-847f-cbebeb2e7d88 req-7da9b470-e2f0-4dfa-9176-3a979ddea4df service nova] Releasing lock "refresh_cache-6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:50:52 user nova-compute[72504]: DEBUG nova.network.neutron [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Successfully updated port: 97484d3b-3fdd-4ad3-8125-12117341441c {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:50:53 user nova-compute[72504]: DEBUG nova.network.neutron [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Successfully updated port: 69b8504c-b89b-44af-9324-d6d096960909 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:50:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:50:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "85816260-b37b-4b9e-9b52-f823120645aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:50:53 user nova-compute[72504]: DEBUG nova.compute.manager [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 19:50:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:50:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:50:53 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:50:53 user nova-compute[72504]: INFO nova.compute.claims [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Claim successful on node user
Aug 01 19:50:53 user nova-compute[72504]: DEBUG nova.compute.manager [req-4bb781e3-0040-495c-9582-8481b146cbab req-cf987076-5ca7-4532-b6ae-88063badc5aa service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-changed-97484d3b-3fdd-4ad3-8125-12117341441c {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:50:53 user nova-compute[72504]: DEBUG nova.compute.manager [req-4bb781e3-0040-495c-9582-8481b146cbab req-cf987076-5ca7-4532-b6ae-88063badc5aa service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Refreshing instance network info cache due to event network-changed-97484d3b-3fdd-4ad3-8125-12117341441c. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:50:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4bb781e3-0040-495c-9582-8481b146cbab req-cf987076-5ca7-4532-b6ae-88063badc5aa service nova] Acquiring lock "refresh_cache-6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:50:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4bb781e3-0040-495c-9582-8481b146cbab req-cf987076-5ca7-4532-b6ae-88063badc5aa service nova] Acquired lock "refresh_cache-6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:50:53 user nova-compute[72504]: DEBUG nova.network.neutron [req-4bb781e3-0040-495c-9582-8481b146cbab req-cf987076-5ca7-4532-b6ae-88063badc5aa service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Refreshing network info cache for port 97484d3b-3fdd-4ad3-8125-12117341441c {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:50:53 user nova-compute[72504]: DEBUG nova.network.neutron [req-4bb781e3-0040-495c-9582-8481b146cbab req-cf987076-5ca7-4532-b6ae-88063badc5aa service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:50:53 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:50:53 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:50:53 user nova-compute[72504]: DEBUG nova.network.neutron [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Successfully updated port: 462a6ab8-f964-4dda-9286-2fca0955907b {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:50:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:50:53 user nova-compute[72504]: DEBUG nova.compute.manager [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 19:50:53 user nova-compute[72504]: DEBUG nova.network.neutron [req-4bb781e3-0040-495c-9582-8481b146cbab req-cf987076-5ca7-4532-b6ae-88063badc5aa service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:50:53 user nova-compute[72504]: DEBUG nova.compute.manager [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 19:50:53 user nova-compute[72504]: DEBUG nova.network.neutron [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 19:50:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4bb781e3-0040-495c-9582-8481b146cbab req-cf987076-5ca7-4532-b6ae-88063badc5aa service nova] Releasing lock "refresh_cache-6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:50:53 user nova-compute[72504]: DEBUG nova.compute.manager [req-4bb781e3-0040-495c-9582-8481b146cbab req-cf987076-5ca7-4532-b6ae-88063badc5aa service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-changed-69b8504c-b89b-44af-9324-d6d096960909 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:50:53 user nova-compute[72504]: DEBUG nova.compute.manager [req-4bb781e3-0040-495c-9582-8481b146cbab req-cf987076-5ca7-4532-b6ae-88063badc5aa service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Refreshing instance network info cache due to event network-changed-69b8504c-b89b-44af-9324-d6d096960909. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:50:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4bb781e3-0040-495c-9582-8481b146cbab req-cf987076-5ca7-4532-b6ae-88063badc5aa service nova] Acquiring lock "refresh_cache-6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:50:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4bb781e3-0040-495c-9582-8481b146cbab req-cf987076-5ca7-4532-b6ae-88063badc5aa service nova] Acquired lock "refresh_cache-6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:50:53 user nova-compute[72504]: DEBUG nova.network.neutron [req-4bb781e3-0040-495c-9582-8481b146cbab req-cf987076-5ca7-4532-b6ae-88063badc5aa service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Refreshing network info cache for port 69b8504c-b89b-44af-9324-d6d096960909 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:50:53 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 19:50:53 user nova-compute[72504]: DEBUG nova.compute.manager [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 19:50:53 user nova-compute[72504]: DEBUG nova.network.neutron [req-4bb781e3-0040-495c-9582-8481b146cbab req-cf987076-5ca7-4532-b6ae-88063badc5aa service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:50:54 user nova-compute[72504]: INFO nova.virt.block_device [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Booting with volume f573b520-1dce-4ba8-b09f-7234510e28f4 at /dev/vda
Aug 01 19:50:54 user nova-compute[72504]: DEBUG os_brick.utils [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG nova.policy [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2947163cbc44c7b8e0d1a251ec2c906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a15b5dc83241d9a0bfd3df652e08a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3493f29d-9254-4d08-b2b6-cb5e364880b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4dc2eb-3c55-4106-bf95-1a0a8d62eecb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[52976050-5116-4a96-88a0-7ccf78f068bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92d005c-9ab0-47a7-839c-ee730f3433db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:50:54 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:50:54 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0279fc-572a-4cd4-ada2-3c938b95c22f]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG os_brick.utils [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Updating existing volume attachment record: 2ee5cc62-77cf-4499-83f0-d599f8cf392a {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG nova.network.neutron [req-4bb781e3-0040-495c-9582-8481b146cbab req-cf987076-5ca7-4532-b6ae-88063badc5aa service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4bb781e3-0040-495c-9582-8481b146cbab req-cf987076-5ca7-4532-b6ae-88063badc5aa service nova] Releasing lock "refresh_cache-6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG nova.network.neutron [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Successfully updated port: f8fdda48-16be-4318-a84d-79d50154eec0 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Acquiring lock "refresh_cache-6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Acquired lock "refresh_cache-6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG nova.network.neutron [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG nova.network.neutron [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:50:54 user nova-compute[72504]: DEBUG nova.network.neutron [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Successfully created port: 1898db0f-13d0-443c-a15f-bcb85039ecdd {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:50:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:50:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:50:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 19:50:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:50:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 19:50:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:50:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-3519d239-b945-4d63-8f89-f0d31546adfd req-15b51f38-2aa1-4770-b019-6ec2eefe401b service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-changed-462a6ab8-f964-4dda-9286-2fca0955907b {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:50:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-3519d239-b945-4d63-8f89-f0d31546adfd req-15b51f38-2aa1-4770-b019-6ec2eefe401b service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Refreshing instance network info cache due to event network-changed-462a6ab8-f964-4dda-9286-2fca0955907b. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:50:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3519d239-b945-4d63-8f89-f0d31546adfd req-15b51f38-2aa1-4770-b019-6ec2eefe401b service nova] Acquiring lock "refresh_cache-6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:50:55 user nova-compute[72504]: DEBUG nova.network.neutron [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Successfully created port: 4a5b6139-7885-46c7-9210-676227003327 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:50:56 user nova-compute[72504]: INFO nova.virt.block_device [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Booting with volume 84390bb0-1665-494a-88a9-0e106017df25 at /dev/vdb
Aug 01 19:50:56 user nova-compute[72504]: DEBUG nova.network.neutron [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Successfully created port: 4fc53eb7-bc35-49cd-af26-52ec96aa2008 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:50:56 user nova-compute[72504]: DEBUG os_brick.utils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:50:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:50:56 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68886b9-5046-4348-a77b-0a5a81937a1b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:50:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:50:56 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[55eed054-2b87-425c-ae94-36043a0ea3a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:50:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:50:56 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d39ff4-5456-4276-b46a-0f5b95a19093]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:50:56 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f750a3b0-6932-4788-9972-e4d14818f038]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:50:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:50:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:50:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:50:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:50:56 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:50:56 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[190b9d39-2444-4c85-a09f-950072699dad]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:50:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:50:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:50:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:50:56 user nova-compute[72504]: DEBUG os_brick.utils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:50:56 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Updating existing volume attachment record: 22645202-a64a-4422-ad76-afe45f9be37c {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:50:57 user nova-compute[72504]: DEBUG nova.network.neutron [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Successfully created port: 022ea9fb-47cd-4a25-8217-4dd5f379b522 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:50:57 user nova-compute[72504]: DEBUG nova.network.neutron [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Updating instance_info_cache with network_info: [{"id": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "address": "fa:16:3e:b5:fc:7c", "network": {"id": "8ac53e2b-6d51-4d2e-b457-6b26a63bf383", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1111786338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d16fa4f-b0", "ovs_interfaceid": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "423f358a-b722-4561-8f80-0c53f295e565", "address": "fa:16:3e:9a:f0:25", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423f358a-b7", "ovs_interfaceid": "423f358a-b722-4561-8f80-0c53f295e565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16a739aa-8e59-4e49-9d81-2242527d12ab", "address": "fa:16:3e:6e:4f:3e", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a739aa-8e", "ovs_interfaceid": "16a739aa-8e59-4e49-9d81-2242527d12ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "97484d3b-3fdd-4ad3-8125-12117341441c", "address": "fa:16:3e:32:75:5c", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97484d3b-3f", "ovs_interfaceid": "97484d3b-3fdd-4ad3-8125-12117341441c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69b8504c-b89b-44af-9324-d6d096960909", "address": "fa:16:3e:5a:c6:3d", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8504c-b8", "ovs_interfaceid": "69b8504c-b89b-44af-9324-d6d096960909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "462a6ab8-f964-4dda-9286-2fca0955907b", "address": "fa:16:3e:10:19:52", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462a6ab8-f9", "ovs_interfaceid": "462a6ab8-f964-4dda-9286-2fca0955907b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f8fdda48-16be-4318-a84d-79d50154eec0", "address": "fa:16:3e:e0:ce:00", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8fdda48-16", "ovs_interfaceid": "f8fdda48-16be-4318-a84d-79d50154eec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:50:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Releasing lock "refresh_cache-6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:50:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Instance network_info: |[{"id": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "address": "fa:16:3e:b5:fc:7c", "network": {"id": "8ac53e2b-6d51-4d2e-b457-6b26a63bf383", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1111786338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d16fa4f-b0", "ovs_interfaceid": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "423f358a-b722-4561-8f80-0c53f295e565", "address": "fa:16:3e:9a:f0:25", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423f358a-b7", "ovs_interfaceid": "423f358a-b722-4561-8f80-0c53f295e565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16a739aa-8e59-4e49-9d81-2242527d12ab", "address": "fa:16:3e:6e:4f:3e", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a739aa-8e", "ovs_interfaceid": "16a739aa-8e59-4e49-9d81-2242527d12ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "97484d3b-3fdd-4ad3-8125-12117341441c", "address": "fa:16:3e:32:75:5c", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97484d3b-3f", "ovs_interfaceid": "97484d3b-3fdd-4ad3-8125-12117341441c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69b8504c-b89b-44af-9324-d6d096960909", "address": "fa:16:3e:5a:c6:3d", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8504c-b8", "ovs_interfaceid": "69b8504c-b89b-44af-9324-d6d096960909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "462a6ab8-f964-4dda-9286-2fca0955907b", "address": "fa:16:3e:10:19:52", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462a6ab8-f9", "ovs_interfaceid": "462a6ab8-f964-4dda-9286-2fca0955907b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f8fdda48-16be-4318-a84d-79d50154eec0", "address": "fa:16:3e:e0:ce:00", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8fdda48-16", "ovs_interfaceid": "f8fdda48-16be-4318-a84d-79d50154eec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 19:50:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3519d239-b945-4d63-8f89-f0d31546adfd req-15b51f38-2aa1-4770-b019-6ec2eefe401b service nova] Acquired lock "refresh_cache-6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:50:57 user nova-compute[72504]: DEBUG nova.network.neutron [req-3519d239-b945-4d63-8f89-f0d31546adfd req-15b51f38-2aa1-4770-b019-6ec2eefe401b service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Refreshing network info cache for port 462a6ab8-f964-4dda-9286-2fca0955907b {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:50:57 user nova-compute[72504]: DEBUG nova.network.neutron [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Successfully created port: fd0b585f-558c-44a1-a5a3-24f825aa19e0 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:50:57 user nova-compute[72504]: DEBUG nova.network.neutron [req-3519d239-b945-4d63-8f89-f0d31546adfd req-15b51f38-2aa1-4770-b019-6ec2eefe401b service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Updated VIF entry in instance network info cache for port 462a6ab8-f964-4dda-9286-2fca0955907b. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:50:57 user nova-compute[72504]: DEBUG nova.network.neutron [req-3519d239-b945-4d63-8f89-f0d31546adfd req-15b51f38-2aa1-4770-b019-6ec2eefe401b service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Updating instance_info_cache with network_info: [{"id": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "address": "fa:16:3e:b5:fc:7c", "network": {"id": "8ac53e2b-6d51-4d2e-b457-6b26a63bf383", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1111786338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d16fa4f-b0", "ovs_interfaceid": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "423f358a-b722-4561-8f80-0c53f295e565", "address": "fa:16:3e:9a:f0:25", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423f358a-b7", "ovs_interfaceid": "423f358a-b722-4561-8f80-0c53f295e565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16a739aa-8e59-4e49-9d81-2242527d12ab", "address": "fa:16:3e:6e:4f:3e", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a739aa-8e", "ovs_interfaceid": "16a739aa-8e59-4e49-9d81-2242527d12ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "97484d3b-3fdd-4ad3-8125-12117341441c", "address": "fa:16:3e:32:75:5c", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97484d3b-3f", "ovs_interfaceid": "97484d3b-3fdd-4ad3-8125-12117341441c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69b8504c-b89b-44af-9324-d6d096960909", "address": "fa:16:3e:5a:c6:3d", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8504c-b8", "ovs_interfaceid": "69b8504c-b89b-44af-9324-d6d096960909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "462a6ab8-f964-4dda-9286-2fca0955907b", "address": "fa:16:3e:10:19:52", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462a6ab8-f9", "ovs_interfaceid": "462a6ab8-f964-4dda-9286-2fca0955907b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f8fdda48-16be-4318-a84d-79d50154eec0", "address": "fa:16:3e:e0:ce:00", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8fdda48-16", "ovs_interfaceid": "f8fdda48-16be-4318-a84d-79d50154eec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:50:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3519d239-b945-4d63-8f89-f0d31546adfd req-15b51f38-2aa1-4770-b019-6ec2eefe401b service nova] Releasing lock "refresh_cache-6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:50:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-3519d239-b945-4d63-8f89-f0d31546adfd req-15b51f38-2aa1-4770-b019-6ec2eefe401b service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-changed-f8fdda48-16be-4318-a84d-79d50154eec0 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:50:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-3519d239-b945-4d63-8f89-f0d31546adfd req-15b51f38-2aa1-4770-b019-6ec2eefe401b service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Refreshing instance network info cache due to event network-changed-f8fdda48-16be-4318-a84d-79d50154eec0. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:50:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3519d239-b945-4d63-8f89-f0d31546adfd req-15b51f38-2aa1-4770-b019-6ec2eefe401b service nova] Acquiring lock "refresh_cache-6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:50:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3519d239-b945-4d63-8f89-f0d31546adfd req-15b51f38-2aa1-4770-b019-6ec2eefe401b service nova] Acquired lock "refresh_cache-6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:50:57 user nova-compute[72504]: DEBUG nova.network.neutron [req-3519d239-b945-4d63-8f89-f0d31546adfd req-15b51f38-2aa1-4770-b019-6ec2eefe401b service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Refreshing network info cache for port f8fdda48-16be-4318-a84d-79d50154eec0 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:50:58 user nova-compute[72504]: DEBUG nova.network.neutron [req-3519d239-b945-4d63-8f89-f0d31546adfd req-15b51f38-2aa1-4770-b019-6ec2eefe401b service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Updated VIF entry in instance network info cache for port f8fdda48-16be-4318-a84d-79d50154eec0. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:50:58 user nova-compute[72504]: DEBUG nova.network.neutron [req-3519d239-b945-4d63-8f89-f0d31546adfd req-15b51f38-2aa1-4770-b019-6ec2eefe401b service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Updating instance_info_cache with network_info: [{"id": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "address": "fa:16:3e:b5:fc:7c", "network": {"id": "8ac53e2b-6d51-4d2e-b457-6b26a63bf383", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1111786338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d16fa4f-b0", "ovs_interfaceid": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "423f358a-b722-4561-8f80-0c53f295e565", "address": "fa:16:3e:9a:f0:25", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423f358a-b7", "ovs_interfaceid": "423f358a-b722-4561-8f80-0c53f295e565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16a739aa-8e59-4e49-9d81-2242527d12ab", "address": "fa:16:3e:6e:4f:3e", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a739aa-8e", "ovs_interfaceid": "16a739aa-8e59-4e49-9d81-2242527d12ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "97484d3b-3fdd-4ad3-8125-12117341441c", "address": "fa:16:3e:32:75:5c", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97484d3b-3f", "ovs_interfaceid": "97484d3b-3fdd-4ad3-8125-12117341441c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69b8504c-b89b-44af-9324-d6d096960909", "address": "fa:16:3e:5a:c6:3d", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8504c-b8", "ovs_interfaceid": "69b8504c-b89b-44af-9324-d6d096960909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "462a6ab8-f964-4dda-9286-2fca0955907b", "address": "fa:16:3e:10:19:52", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462a6ab8-f9", "ovs_interfaceid": "462a6ab8-f964-4dda-9286-2fca0955907b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f8fdda48-16be-4318-a84d-79d50154eec0", "address": "fa:16:3e:e0:ce:00", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8fdda48-16", "ovs_interfaceid": "f8fdda48-16be-4318-a84d-79d50154eec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:50:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3519d239-b945-4d63-8f89-f0d31546adfd req-15b51f38-2aa1-4770-b019-6ec2eefe401b service nova] Releasing lock "refresh_cache-6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:50:58 user nova-compute[72504]: DEBUG nova.network.neutron [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Successfully updated port: 1898db0f-13d0-443c-a15f-bcb85039ecdd {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:50:58 user nova-compute[72504]: DEBUG nova.compute.manager [req-47d53bfb-fa9b-4687-8806-8f8115ccce8e req-4ab47e91-1587-46df-af42-0497fc48909a service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-changed-1898db0f-13d0-443c-a15f-bcb85039ecdd {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:50:58 user nova-compute[72504]: DEBUG nova.compute.manager [req-47d53bfb-fa9b-4687-8806-8f8115ccce8e req-4ab47e91-1587-46df-af42-0497fc48909a service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Refreshing instance network info cache due to event network-changed-1898db0f-13d0-443c-a15f-bcb85039ecdd. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:50:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-47d53bfb-fa9b-4687-8806-8f8115ccce8e req-4ab47e91-1587-46df-af42-0497fc48909a service nova] Acquiring lock "refresh_cache-85816260-b37b-4b9e-9b52-f823120645aa" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:50:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-47d53bfb-fa9b-4687-8806-8f8115ccce8e req-4ab47e91-1587-46df-af42-0497fc48909a service nova] Acquired lock "refresh_cache-85816260-b37b-4b9e-9b52-f823120645aa" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:50:58 user nova-compute[72504]: DEBUG nova.network.neutron [req-47d53bfb-fa9b-4687-8806-8f8115ccce8e req-4ab47e91-1587-46df-af42-0497fc48909a service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Refreshing network info cache for port 1898db0f-13d0-443c-a15f-bcb85039ecdd {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:50:58 user nova-compute[72504]: DEBUG nova.network.neutron [req-47d53bfb-fa9b-4687-8806-8f8115ccce8e req-4ab47e91-1587-46df-af42-0497fc48909a service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:50:59 user nova-compute[72504]: DEBUG nova.network.neutron [req-47d53bfb-fa9b-4687-8806-8f8115ccce8e req-4ab47e91-1587-46df-af42-0497fc48909a service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:50:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-47d53bfb-fa9b-4687-8806-8f8115ccce8e req-4ab47e91-1587-46df-af42-0497fc48909a service nova] Releasing lock "refresh_cache-85816260-b37b-4b9e-9b52-f823120645aa" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:50:59 user nova-compute[72504]: DEBUG nova.network.neutron [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Successfully updated port: 4d17a5cc-0fda-4d09-9121-baab1fed85e8 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:51:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:51:00 user nova-compute[72504]: DEBUG nova.network.neutron [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Successfully updated port: 769dacee-ebe9-47f8-994f-1d59b15e2a1b {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:51:00 user nova-compute[72504]: DEBUG nova.compute.manager [req-66a8e486-95bd-4f56-98f8-2013126f612e req-0a75fce5-37c0-491e-aa6e-a74643fec9a6 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-changed-4d17a5cc-0fda-4d09-9121-baab1fed85e8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:00 user nova-compute[72504]: DEBUG nova.compute.manager [req-66a8e486-95bd-4f56-98f8-2013126f612e req-0a75fce5-37c0-491e-aa6e-a74643fec9a6 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Refreshing instance network info cache due to event network-changed-4d17a5cc-0fda-4d09-9121-baab1fed85e8. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:51:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-66a8e486-95bd-4f56-98f8-2013126f612e req-0a75fce5-37c0-491e-aa6e-a74643fec9a6 service nova] Acquiring lock "refresh_cache-85816260-b37b-4b9e-9b52-f823120645aa" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:51:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-66a8e486-95bd-4f56-98f8-2013126f612e req-0a75fce5-37c0-491e-aa6e-a74643fec9a6 service nova] Acquired lock "refresh_cache-85816260-b37b-4b9e-9b52-f823120645aa" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:51:00 user nova-compute[72504]: DEBUG nova.network.neutron [req-66a8e486-95bd-4f56-98f8-2013126f612e req-0a75fce5-37c0-491e-aa6e-a74643fec9a6 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Refreshing network info cache for port 4d17a5cc-0fda-4d09-9121-baab1fed85e8 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:51:00 user nova-compute[72504]: DEBUG nova.network.neutron [req-66a8e486-95bd-4f56-98f8-2013126f612e req-0a75fce5-37c0-491e-aa6e-a74643fec9a6 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:51:01 user nova-compute[72504]: DEBUG nova.network.neutron [req-66a8e486-95bd-4f56-98f8-2013126f612e req-0a75fce5-37c0-491e-aa6e-a74643fec9a6 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:51:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-66a8e486-95bd-4f56-98f8-2013126f612e req-0a75fce5-37c0-491e-aa6e-a74643fec9a6 service nova] Releasing lock "refresh_cache-85816260-b37b-4b9e-9b52-f823120645aa" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:51:01 user nova-compute[72504]: DEBUG nova.compute.manager [req-66a8e486-95bd-4f56-98f8-2013126f612e req-0a75fce5-37c0-491e-aa6e-a74643fec9a6 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-changed-769dacee-ebe9-47f8-994f-1d59b15e2a1b {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:01 user nova-compute[72504]: DEBUG nova.compute.manager [req-66a8e486-95bd-4f56-98f8-2013126f612e req-0a75fce5-37c0-491e-aa6e-a74643fec9a6 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Refreshing instance network info cache due to event network-changed-769dacee-ebe9-47f8-994f-1d59b15e2a1b. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:51:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-66a8e486-95bd-4f56-98f8-2013126f612e req-0a75fce5-37c0-491e-aa6e-a74643fec9a6 service nova] Acquiring lock "refresh_cache-85816260-b37b-4b9e-9b52-f823120645aa" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:51:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-66a8e486-95bd-4f56-98f8-2013126f612e req-0a75fce5-37c0-491e-aa6e-a74643fec9a6 service nova] Acquired lock "refresh_cache-85816260-b37b-4b9e-9b52-f823120645aa" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:51:01 user nova-compute[72504]: DEBUG nova.network.neutron [req-66a8e486-95bd-4f56-98f8-2013126f612e req-0a75fce5-37c0-491e-aa6e-a74643fec9a6 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Refreshing network info cache for port 769dacee-ebe9-47f8-994f-1d59b15e2a1b {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:51:01 user nova-compute[72504]: DEBUG nova.network.neutron [req-66a8e486-95bd-4f56-98f8-2013126f612e req-0a75fce5-37c0-491e-aa6e-a74643fec9a6 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:51:01 user nova-compute[72504]: DEBUG nova.network.neutron [req-66a8e486-95bd-4f56-98f8-2013126f612e req-0a75fce5-37c0-491e-aa6e-a74643fec9a6 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:51:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-66a8e486-95bd-4f56-98f8-2013126f612e req-0a75fce5-37c0-491e-aa6e-a74643fec9a6 service nova] Releasing lock "refresh_cache-85816260-b37b-4b9e-9b52-f823120645aa" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:51:01 user nova-compute[72504]: DEBUG nova.network.neutron [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Successfully updated port: 4a5b6139-7885-46c7-9210-676227003327 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:51:02 user nova-compute[72504]: DEBUG nova.network.neutron [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Successfully updated port: 4fc53eb7-bc35-49cd-af26-52ec96aa2008 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-4458a82a-d8bf-4827-95a0-d07a2436f245 req-3e7a04a3-9c82-4ff4-96e6-e272300f52e7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-changed-4a5b6139-7885-46c7-9210-676227003327 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-4458a82a-d8bf-4827-95a0-d07a2436f245 req-3e7a04a3-9c82-4ff4-96e6-e272300f52e7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Refreshing instance network info cache due to event network-changed-4a5b6139-7885-46c7-9210-676227003327. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4458a82a-d8bf-4827-95a0-d07a2436f245 req-3e7a04a3-9c82-4ff4-96e6-e272300f52e7 service nova] Acquiring lock "refresh_cache-85816260-b37b-4b9e-9b52-f823120645aa" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4458a82a-d8bf-4827-95a0-d07a2436f245 req-3e7a04a3-9c82-4ff4-96e6-e272300f52e7 service nova] Acquired lock "refresh_cache-85816260-b37b-4b9e-9b52-f823120645aa" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG nova.network.neutron [req-4458a82a-d8bf-4827-95a0-d07a2436f245 req-3e7a04a3-9c82-4ff4-96e6-e272300f52e7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Refreshing network info cache for port 4a5b6139-7885-46c7-9210-676227003327 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG nova.network.neutron [req-4458a82a-d8bf-4827-95a0-d07a2436f245 req-3e7a04a3-9c82-4ff4-96e6-e272300f52e7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:51:03 user nova-compute[72504]: INFO nova.virt.block_device [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Booting with volume 2593357d-b560-4929-b260-d3ae1c633315 at /dev/vdb
Aug 01 19:51:03 user nova-compute[72504]: DEBUG os_brick.utils [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3001185-def8-466f-a8df-e963f4c8524f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[69de01d0-a34d-48ee-ad76-a42847e5e57d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b593e56c-9177-4fbb-bded-eb3efbafd133]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed31f75-2304-4a1c-9834-beac4e7dc67e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:51:03 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:51:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[118d37b8-1237-49cb-8179-6e966f78fb25]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG os_brick.utils [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Updating existing volume attachment record: 16891e21-7ad4-4aee-9ec7-6ef5c569cf66 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG nova.network.neutron [req-4458a82a-d8bf-4827-95a0-d07a2436f245 req-3e7a04a3-9c82-4ff4-96e6-e272300f52e7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4458a82a-d8bf-4827-95a0-d07a2436f245 req-3e7a04a3-9c82-4ff4-96e6-e272300f52e7 service nova] Releasing lock "refresh_cache-85816260-b37b-4b9e-9b52-f823120645aa" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-4458a82a-d8bf-4827-95a0-d07a2436f245 req-3e7a04a3-9c82-4ff4-96e6-e272300f52e7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-changed-4fc53eb7-bc35-49cd-af26-52ec96aa2008 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-4458a82a-d8bf-4827-95a0-d07a2436f245 req-3e7a04a3-9c82-4ff4-96e6-e272300f52e7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Refreshing instance network info cache due to event network-changed-4fc53eb7-bc35-49cd-af26-52ec96aa2008. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4458a82a-d8bf-4827-95a0-d07a2436f245 req-3e7a04a3-9c82-4ff4-96e6-e272300f52e7 service nova] Acquiring lock "refresh_cache-85816260-b37b-4b9e-9b52-f823120645aa" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4458a82a-d8bf-4827-95a0-d07a2436f245 req-3e7a04a3-9c82-4ff4-96e6-e272300f52e7 service nova] Acquired lock "refresh_cache-85816260-b37b-4b9e-9b52-f823120645aa" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG nova.network.neutron [req-4458a82a-d8bf-4827-95a0-d07a2436f245 req-3e7a04a3-9c82-4ff4-96e6-e272300f52e7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Refreshing network info cache for port 4fc53eb7-bc35-49cd-af26-52ec96aa2008 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG nova.network.neutron [req-4458a82a-d8bf-4827-95a0-d07a2436f245 req-3e7a04a3-9c82-4ff4-96e6-e272300f52e7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG nova.network.neutron [req-4458a82a-d8bf-4827-95a0-d07a2436f245 req-3e7a04a3-9c82-4ff4-96e6-e272300f52e7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4458a82a-d8bf-4827-95a0-d07a2436f245 req-3e7a04a3-9c82-4ff4-96e6-e272300f52e7 service nova] Releasing lock "refresh_cache-85816260-b37b-4b9e-9b52-f823120645aa" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:51:03 user nova-compute[72504]: DEBUG nova.network.neutron [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Successfully updated port: 022ea9fb-47cd-4a25-8217-4dd5f379b522 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:51:04 user nova-compute[72504]: DEBUG nova.network.neutron [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Successfully updated port: fd0b585f-558c-44a1-a5a3-24f825aa19e0 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:51:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Acquiring lock "refresh_cache-85816260-b37b-4b9e-9b52-f823120645aa" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:51:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Acquired lock "refresh_cache-85816260-b37b-4b9e-9b52-f823120645aa" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:51:04 user nova-compute[72504]: DEBUG nova.network.neutron [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:51:04 user nova-compute[72504]: DEBUG nova.network.neutron [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:51:05 user nova-compute[72504]: DEBUG nova.compute.manager [req-74c88c39-3efe-4e03-bace-fc3c1b49a6b0 req-ddade972-ff94-4f96-bff1-09f63033fc1e service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-changed-022ea9fb-47cd-4a25-8217-4dd5f379b522 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:05 user nova-compute[72504]: DEBUG nova.compute.manager [req-74c88c39-3efe-4e03-bace-fc3c1b49a6b0 req-ddade972-ff94-4f96-bff1-09f63033fc1e service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Refreshing instance network info cache due to event network-changed-022ea9fb-47cd-4a25-8217-4dd5f379b522. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:51:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-74c88c39-3efe-4e03-bace-fc3c1b49a6b0 req-ddade972-ff94-4f96-bff1-09f63033fc1e service nova] Acquiring lock "refresh_cache-85816260-b37b-4b9e-9b52-f823120645aa" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:51:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:51:05 user nova-compute[72504]: INFO nova.virt.block_device [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Booting with volume 6d7f593f-5ffb-4c62-bfc3-51cb2c24977b at /dev/vdc
Aug 01 19:51:05 user nova-compute[72504]: DEBUG os_brick.utils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:51:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:05 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab05b85-c201-4fcf-b43d-54ce4018071e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:05 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[57902994-2b00-4949-ae39-bda46a0e2b06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:05 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a810f16-5b48-46ac-aa60-cb4edc7501bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:05 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5248c9-5f8b-4fdd-8835-455bb22f7435]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:51:05 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:51:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:51:05 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:51:05 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0a0539-d165-4b8f-b3cd-d6c590924995]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:05 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:51:05 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:51:05 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:51:05 user nova-compute[72504]: DEBUG os_brick.utils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:51:05 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Updating existing volume attachment record: d7adfdcb-3db9-4e72-9102-e42fcc95e896 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:51:06 user nova-compute[72504]: DEBUG nova.network.neutron [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Updating instance_info_cache with network_info: [{"id": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "address": "fa:16:3e:c2:7b:99", "network": {"id": "9ccd7c4b-5d10-4ec8-9f00-f4b269b82d04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1560588778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1898db0f-13", "ovs_interfaceid": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "address": "fa:16:3e:71:06:4f", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d17a5cc-0f", "ovs_interfaceid": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "address": "fa:16:3e:52:80:5a", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769dacee-eb", "ovs_interfaceid": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a5b6139-7885-46c7-9210-676227003327", "address": "fa:16:3e:84:ab:7b", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a5b6139-78", "ovs_interfaceid": "4a5b6139-7885-46c7-9210-676227003327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4fc53eb7-bc35-49cd-af26-52ec96aa2008", "address": "fa:16:3e:ee:80:d5", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc53eb7-bc", "ovs_interfaceid": "4fc53eb7-bc35-49cd-af26-52ec96aa2008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "022ea9fb-47cd-4a25-8217-4dd5f379b522", "address": "fa:16:3e:79:55:d8", "network": {"id": "749ff417-d2f9-4311-b2f7-bbdf0cfd37a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-178411316", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022ea9fb-47", "ovs_interfaceid": "022ea9fb-47cd-4a25-8217-4dd5f379b522", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "address": "fa:16:3e:2a:6f:04", "network": {"id": "749ff417-d2f9-4311-b2f7-bbdf0cfd37a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-178411316", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd0b585f-55", "ovs_interfaceid": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:51:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Releasing lock "refresh_cache-85816260-b37b-4b9e-9b52-f823120645aa" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:51:06 user nova-compute[72504]: DEBUG nova.compute.manager [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Instance network_info: |[{"id": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "address": "fa:16:3e:c2:7b:99", "network": {"id": "9ccd7c4b-5d10-4ec8-9f00-f4b269b82d04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1560588778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1898db0f-13", "ovs_interfaceid": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "address": "fa:16:3e:71:06:4f", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d17a5cc-0f", "ovs_interfaceid": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "address": "fa:16:3e:52:80:5a", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769dacee-eb", "ovs_interfaceid": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a5b6139-7885-46c7-9210-676227003327", "address": "fa:16:3e:84:ab:7b", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a5b6139-78", "ovs_interfaceid": "4a5b6139-7885-46c7-9210-676227003327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4fc53eb7-bc35-49cd-af26-52ec96aa2008", "address": "fa:16:3e:ee:80:d5", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc53eb7-bc", "ovs_interfaceid": "4fc53eb7-bc35-49cd-af26-52ec96aa2008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "022ea9fb-47cd-4a25-8217-4dd5f379b522", "address": "fa:16:3e:79:55:d8", "network": {"id": "749ff417-d2f9-4311-b2f7-bbdf0cfd37a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-178411316", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022ea9fb-47", "ovs_interfaceid": "022ea9fb-47cd-4a25-8217-4dd5f379b522", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "address": "fa:16:3e:2a:6f:04", "network": {"id": "749ff417-d2f9-4311-b2f7-bbdf0cfd37a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-178411316", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd0b585f-55", "ovs_interfaceid": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 19:51:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-74c88c39-3efe-4e03-bace-fc3c1b49a6b0 req-ddade972-ff94-4f96-bff1-09f63033fc1e service nova] Acquired lock "refresh_cache-85816260-b37b-4b9e-9b52-f823120645aa" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:51:06 user nova-compute[72504]: DEBUG nova.network.neutron [req-74c88c39-3efe-4e03-bace-fc3c1b49a6b0 req-ddade972-ff94-4f96-bff1-09f63033fc1e service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Refreshing network info cache for port 022ea9fb-47cd-4a25-8217-4dd5f379b522 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:51:07 user nova-compute[72504]: DEBUG nova.network.neutron [req-74c88c39-3efe-4e03-bace-fc3c1b49a6b0 req-ddade972-ff94-4f96-bff1-09f63033fc1e service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Updated VIF entry in instance network info cache for port 022ea9fb-47cd-4a25-8217-4dd5f379b522. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:51:07 user nova-compute[72504]: DEBUG nova.network.neutron [req-74c88c39-3efe-4e03-bace-fc3c1b49a6b0 req-ddade972-ff94-4f96-bff1-09f63033fc1e service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Updating instance_info_cache with network_info: [{"id": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "address": "fa:16:3e:c2:7b:99", "network": {"id": "9ccd7c4b-5d10-4ec8-9f00-f4b269b82d04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1560588778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1898db0f-13", "ovs_interfaceid": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "address": "fa:16:3e:71:06:4f", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d17a5cc-0f", "ovs_interfaceid": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "address": "fa:16:3e:52:80:5a", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769dacee-eb", "ovs_interfaceid": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a5b6139-7885-46c7-9210-676227003327", "address": "fa:16:3e:84:ab:7b", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a5b6139-78", "ovs_interfaceid": "4a5b6139-7885-46c7-9210-676227003327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4fc53eb7-bc35-49cd-af26-52ec96aa2008", "address": "fa:16:3e:ee:80:d5", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc53eb7-bc", "ovs_interfaceid": "4fc53eb7-bc35-49cd-af26-52ec96aa2008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "022ea9fb-47cd-4a25-8217-4dd5f379b522", "address": "fa:16:3e:79:55:d8", "network": {"id": "749ff417-d2f9-4311-b2f7-bbdf0cfd37a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-178411316", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022ea9fb-47", "ovs_interfaceid": "022ea9fb-47cd-4a25-8217-4dd5f379b522", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "address": "fa:16:3e:2a:6f:04", "network": {"id": "749ff417-d2f9-4311-b2f7-bbdf0cfd37a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-178411316", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd0b585f-55", "ovs_interfaceid": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:51:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-74c88c39-3efe-4e03-bace-fc3c1b49a6b0 req-ddade972-ff94-4f96-bff1-09f63033fc1e service nova] Releasing lock "refresh_cache-85816260-b37b-4b9e-9b52-f823120645aa" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:51:07 user nova-compute[72504]: DEBUG nova.compute.manager [req-74c88c39-3efe-4e03-bace-fc3c1b49a6b0 req-ddade972-ff94-4f96-bff1-09f63033fc1e service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-changed-fd0b585f-558c-44a1-a5a3-24f825aa19e0 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:07 user nova-compute[72504]: DEBUG nova.compute.manager [req-74c88c39-3efe-4e03-bace-fc3c1b49a6b0 req-ddade972-ff94-4f96-bff1-09f63033fc1e service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Refreshing instance network info cache due to event network-changed-fd0b585f-558c-44a1-a5a3-24f825aa19e0. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:51:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-74c88c39-3efe-4e03-bace-fc3c1b49a6b0 req-ddade972-ff94-4f96-bff1-09f63033fc1e service nova] Acquiring lock "refresh_cache-85816260-b37b-4b9e-9b52-f823120645aa" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:51:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-74c88c39-3efe-4e03-bace-fc3c1b49a6b0 req-ddade972-ff94-4f96-bff1-09f63033fc1e service nova] Acquired lock "refresh_cache-85816260-b37b-4b9e-9b52-f823120645aa" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:51:07 user nova-compute[72504]: DEBUG nova.network.neutron [req-74c88c39-3efe-4e03-bace-fc3c1b49a6b0 req-ddade972-ff94-4f96-bff1-09f63033fc1e service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Refreshing network info cache for port fd0b585f-558c-44a1-a5a3-24f825aa19e0 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:51:07 user nova-compute[72504]: DEBUG nova.network.neutron [req-74c88c39-3efe-4e03-bace-fc3c1b49a6b0 req-ddade972-ff94-4f96-bff1-09f63033fc1e service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Updated VIF entry in instance network info cache for port fd0b585f-558c-44a1-a5a3-24f825aa19e0. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:51:07 user nova-compute[72504]: DEBUG nova.network.neutron [req-74c88c39-3efe-4e03-bace-fc3c1b49a6b0 req-ddade972-ff94-4f96-bff1-09f63033fc1e service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Updating instance_info_cache with network_info: [{"id": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "address": "fa:16:3e:c2:7b:99", "network": {"id": "9ccd7c4b-5d10-4ec8-9f00-f4b269b82d04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1560588778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1898db0f-13", "ovs_interfaceid": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "address": "fa:16:3e:71:06:4f", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d17a5cc-0f", "ovs_interfaceid": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "address": "fa:16:3e:52:80:5a", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769dacee-eb", "ovs_interfaceid": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a5b6139-7885-46c7-9210-676227003327", "address": "fa:16:3e:84:ab:7b", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a5b6139-78", "ovs_interfaceid": "4a5b6139-7885-46c7-9210-676227003327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4fc53eb7-bc35-49cd-af26-52ec96aa2008", "address": "fa:16:3e:ee:80:d5", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc53eb7-bc", "ovs_interfaceid": "4fc53eb7-bc35-49cd-af26-52ec96aa2008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "022ea9fb-47cd-4a25-8217-4dd5f379b522", "address": "fa:16:3e:79:55:d8", "network": {"id": "749ff417-d2f9-4311-b2f7-bbdf0cfd37a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-178411316", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022ea9fb-47", "ovs_interfaceid": "022ea9fb-47cd-4a25-8217-4dd5f379b522", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "address": "fa:16:3e:2a:6f:04", "network": {"id": "749ff417-d2f9-4311-b2f7-bbdf0cfd37a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-178411316", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd0b585f-55", "ovs_interfaceid": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:51:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-74c88c39-3efe-4e03-bace-fc3c1b49a6b0 req-ddade972-ff94-4f96-bff1-09f63033fc1e service nova] Releasing lock "refresh_cache-85816260-b37b-4b9e-9b52-f823120645aa" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:51:08 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:51:10 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:51:10 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:51:10 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:51:11 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:51:11 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:51:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:11 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:51:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8966321-946f-4988-83f5-c71cabb1c094/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8966321-946f-4988-83f5-c71cabb1c094/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8966321-946f-4988-83f5-c71cabb1c094/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8966321-946f-4988-83f5-c71cabb1c094/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eae5ffe-ab54-4dac-8169-69325448b92f/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eae5ffe-ab54-4dac-8169-69325448b92f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eae5ffe-ab54-4dac-8169-69325448b92f/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eae5ffe-ab54-4dac-8169-69325448b92f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG nova.compute.manager [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:51:13 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Creating image(s)
Aug 01 19:51:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Did not create local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Ensure instance console log exists: /opt/stack/data/nova/instances/6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Start _get_guest_xml network_info=[{"id": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "address": "fa:16:3e:b5:fc:7c", "network": {"id": "8ac53e2b-6d51-4d2e-b457-6b26a63bf383", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1111786338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d16fa4f-b0", "ovs_interfaceid": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "423f358a-b722-4561-8f80-0c53f295e565", "address": "fa:16:3e:9a:f0:25", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423f358a-b7", "ovs_interfaceid": "423f358a-b722-4561-8f80-0c53f295e565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16a739aa-8e59-4e49-9d81-2242527d12ab", "address": "fa:16:3e:6e:4f:3e", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a739aa-8e", "ovs_interfaceid": "16a739aa-8e59-4e49-9d81-2242527d12ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "97484d3b-3fdd-4ad3-8125-12117341441c", "address": "fa:16:3e:32:75:5c", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97484d3b-3f", "ovs_interfaceid": "97484d3b-3fdd-4ad3-8125-12117341441c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69b8504c-b89b-44af-9324-d6d096960909", "address": "fa:16:3e:5a:c6:3d", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8504c-b8", "ovs_interfaceid": "69b8504c-b89b-44af-9324-d6d096960909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "462a6ab8-f964-4dda-9286-2fca0955907b", "address": "fa:16:3e:10:19:52", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462a6ab8-f9", "ovs_interfaceid": "462a6ab8-f964-4dda-9286-2fca0955907b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f8fdda48-16be-4318-a84d-79d50154eec0", "address": "fa:16:3e:e0:ce:00", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8fdda48-16", "ovs_interfaceid": "f8fdda48-16be-4318-a84d-79d50154eec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMwHWqfN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f', 'attached_at': '', 'detached_at': '', 'volume_id': 'e233d7c5-9e36-461b-850b-774fcad75f65', 'serial': 'e233d7c5-9e36-461b-850b-774fcad75f65'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': '8dd33790-6101-4dfa-a1c5-b5d95921dfcb', 'volume_type': None}, {'device_type': 'disk', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JVcNuqHZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f', 'attached_at': '', 'detached_at': '', 'volume_id': '84390bb0-1665-494a-88a9-0e106017df25', 'serial': '84390bb0-1665-494a-88a9-0e106017df25'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': '22645202-a64a-4422-ad76-afe45f9be37c', 'volume_type': None}, {'device_type': 'disk', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hCHkDiuf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f', 'attached_at': '', 'detached_at': '', 'volume_id': '6d7f593f-5ffb-4c62-bfc3-51cb2c24977b', 'serial': '6d7f593f-5ffb-4c62-bfc3-51cb2c24977b'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'attachment_id': 'd7adfdcb-3db9-4e72-9102-e42fcc95e896', 'volume_type': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:51:13 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:51:13 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:51:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG os_brick.initiator.connector [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Factory for ISCSI on None {{(pid=72504) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMwHWqfN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:51:13 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:51:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:51:13 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:51:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:51:13 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:51:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e319963e-853c-4559-ac1b-6393cae548a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:51:13 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4022aae6-8624-46a6-ba63-339b284af854]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65] added
Aug 01 19:51:13 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[de88be32-100d-475a-b7c1-72fcce4c9f57]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfe2dba-c0c8-4af8-be11-d825470e8353]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zMwHWqfN {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zMwHWqfN" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f87d81-1fa3-4ba2-939e-ef4ca55cbdbc]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zMwHWqfN'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0ec01a-6a51-4a94-8b26-f1687daf267a]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffedfea6-0192-4ac6-bdd0-b69103590bb7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 19:51:14 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 19:51:14 user nova-compute[72504]:  {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:51:14 user nova-compute[72504]: WARNING os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 19:51:14 user nova-compute[72504]: 
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20940df-ba8c-4070-8655-b7a5f835d09c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65, portal: 172.16.0.220,3260]
Aug 01 19:51:14 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65, portal: 172.16.0.220,3260] successful.
Aug 01 19:51:14 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1a5896-4432-4c77-9868-122aef987cc3]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[699fe830-e743-476a-ab47-a9d2f900e6c7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:14 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:14 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35713c1-5acf-45a1-a648-0a6b65b4cb7a]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMwHWqfN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:15 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:51:15 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:51:15 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=7202MB free_disk=25.582355499267578GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '26232326431376635', 'path': '/dev/sdb'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232326431376635', 'path': '/dev/sdb'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JVcNuqHZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:51:15 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:51:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:51:15 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:51:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:51:15 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 8eae5ffe-ab54-4dac-8169-69325448b92f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 5193c770-80ca-44c3-9950-cb25c65e94e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 76aa3861-0ca1-4e7f-9a15-9219037bc1ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1de87977-532f-45f7-856b-84df41b2a567 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance a8966321-946f-4988-83f5-c71cabb1c094 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 561928fb-3c41-4937-8050-9125614c0641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance c9fd391d-51c0-4ef9-86cc-5ce2c76c177a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 85816260-b37b-4b9e-9b52-f823120645aa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1807a51-5afe-4584-a035-55af62b8e630]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:51:15 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea103cd0-3049-41f5-8983-cc7c658448ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25] added
Aug 01 19:51:15 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b15278-7dc2-4783-b1c3-bf46b25cc119]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6521557-77b6-49b3-a5e2-e97f3ee38c1a]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JVcNuqHZ {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JVcNuqHZ" returned: 0 in 0.029s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d75e2e6-5d5e-4324-8c1f-0079d169a252]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JVcNuqHZ'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[044488e9-a221-4e6a-84c4-65cd90bc38c7]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0402d107-76c8-44ea-8ac2-9ca5236650f3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:15 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:15 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[57427a4b-bcfd-4245-b573-6b40c70b96b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25, portal: 172.16.0.220,3260]
Aug 01 19:51:15 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25, portal: 172.16.0.220,3260] successful.
Aug 01 19:51:15 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9b9c96-733f-44d4-95a0-69c61490d6e3]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df15159-6d13-4033-bd58-c25097c53247]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:15 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:15 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:15 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:15 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d1145a-d4b9-4282-bd00-259b31a5d30d]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JVcNuqHZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:51:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.568s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23661653665653034', 'path': '/dev/sdc'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661653665653034', 'path': '/dev/sdc'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hCHkDiuf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:51:16 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:51:16 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:51:16 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:51:16 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:51:16 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:51:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe14374-ff04-4dce-a524-6b644ca907c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:51:16 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4711ec9-4bb8-43fd-823e-f19773006ec3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b] added
Aug 01 19:51:16 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG nova.compute.manager [None req-01105cab-0c06-4797-99bb-d77725c56946 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6798db-eb87-4996-9f92-6fa9158571f3]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-39b3076d-ce59-4e7c-976f-9355bf2f6ff4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-39b3076d-ce59-4e7c-976f-9355bf2f6ff4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f71d395-b3fa-4344-9970-1487d5243e54]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hCHkDiuf {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hCHkDiuf" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48e7763-cb45-4bf2-a0cf-7916c994f35d]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hCHkDiuf'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e2ff56-e4e7-4209-ba8b-c4f8daeb7ad8]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:16 user nova-compute[72504]: INFO nova.compute.manager [None req-01105cab-0c06-4797-99bb-d77725c56946 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] instance snapshotting
Aug 01 19:51:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a813a5e-db9b-4924-a574-738a3d415622]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:16 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:16 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:16 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:16 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:51:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:16 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-01105cab-0c06-4797-99bb-d77725c56946 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Beginning live snapshot process
Aug 01 19:51:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b937b1-abf6-4048-80e2-fecf0a0daaca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b, portal: 172.16.0.220,3260]
Aug 01 19:51:17 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b, portal: 172.16.0.220,3260] successful.
Aug 01 19:51:17 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3d68ec-4c7a-49c1-863e-da7aa756455d]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f3717f-d3ef-4d8b-ae28-ee86deaf9c8f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:17 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:17 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:17 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:51:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:17 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:17 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:17 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:51:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:51:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:51:17 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:51:17 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:51:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fd2d71-4094-4456-8be7-e5ceb159717a]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:17 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:51:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hCHkDiuf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:51:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-01105cab-0c06-4797-99bb-d77725c56946 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json -f qcow2 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-01105cab-0c06-4797-99bb-d77725c56946 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json -f qcow2" returned: 0 in 0.133s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-01105cab-0c06-4797-99bb-d77725c56946 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json -f qcow2 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-01105cab-0c06-4797-99bb-d77725c56946 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json -f qcow2" returned: 0 in 0.132s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-01105cab-0c06-4797-99bb-d77725c56946 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-01105cab-0c06-4797-99bb-d77725c56946 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-01105cab-0c06-4797-99bb-d77725c56946 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpedz33hzu/9ddbc838f48b4bb98ab2aaf29f7d7572.delta 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-01105cab-0c06-4797-99bb-d77725c56946 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpedz33hzu/9ddbc838f48b4bb98ab2aaf29f7d7572.delta 1073741824" returned: 0 in 0.075s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:17 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-01105cab-0c06-4797-99bb-d77725c56946 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 19:51:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-01105cab-0c06-4797-99bb-d77725c56946 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72504) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 01 19:51:17 user nova-compute[72504]: INFO nova.virt.libvirt.host [None req-01105cab-0c06-4797-99bb-d77725c56946 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] UEFI support detected
Aug 01 19:51:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23163663836623837', 'path': '/dev/sdd'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163663836623837', 'path': '/dev/sdd'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1242188617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1242188617',id=9,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeFvsHYdJBNEbcxV4XXAiRnx+5sL87PKC5LnKhGGASCKmKVu4R47G5S+DRgHjKuQT8IHEwuFJNtLjOfV+3XJegm5cY0CWqKT4tpTvGrm284xrF0t3PnSDzim3EkK6piIQ==',key_name='tempest-keypair-1162904154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f84d6702f394a86be93c8b569d31698',ramdisk_id='',reservation_id='r-k1hnrgis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1761881347',owner_user_name='tempest-TaggedBootDevicesTest-1761881347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82b31b1cbe344ff587c86d89c57b9325',uuid=6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "address": "fa:16:3e:b5:fc:7c", "network": {"id": "8ac53e2b-6d51-4d2e-b457-6b26a63bf383", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1111786338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d16fa4f-b0", "ovs_interfaceid": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converting VIF {"id": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "address": "fa:16:3e:b5:fc:7c", "network": {"id": "8ac53e2b-6d51-4d2e-b457-6b26a63bf383", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1111786338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d16fa4f-b0", "ovs_interfaceid": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:fc:7c,bridge_name='br-int',has_traffic_filtering=True,id=5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828,network=Network(8ac53e2b-6d51-4d2e-b457-6b26a63bf383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d16fa4f-b0') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1242188617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1242188617',id=9,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeFvsHYdJBNEbcxV4XXAiRnx+5sL87PKC5LnKhGGASCKmKVu4R47G5S+DRgHjKuQT8IHEwuFJNtLjOfV+3XJegm5cY0CWqKT4tpTvGrm284xrF0t3PnSDzim3EkK6piIQ==',key_name='tempest-keypair-1162904154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f84d6702f394a86be93c8b569d31698',ramdisk_id='',reservation_id='r-k1hnrgis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1761881347',owner_user_name='tempest-TaggedBootDevicesTest-1761881347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82b31b1cbe344ff587c86d89c57b9325',uuid=6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "423f358a-b722-4561-8f80-0c53f295e565", "address": "fa:16:3e:9a:f0:25", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423f358a-b7", "ovs_interfaceid": "423f358a-b722-4561-8f80-0c53f295e565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converting VIF {"id": "423f358a-b722-4561-8f80-0c53f295e565", "address": "fa:16:3e:9a:f0:25", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423f358a-b7", "ovs_interfaceid": "423f358a-b722-4561-8f80-0c53f295e565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:f0:25,bridge_name='br-int',has_traffic_filtering=True,id=423f358a-b722-4561-8f80-0c53f295e565,network=Network(a7129b01-9ed6-480f-972a-f95db79263ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap423f358a-b7') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1242188617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1242188617',id=9,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeFvsHYdJBNEbcxV4XXAiRnx+5sL87PKC5LnKhGGASCKmKVu4R47G5S+DRgHjKuQT8IHEwuFJNtLjOfV+3XJegm5cY0CWqKT4tpTvGrm284xrF0t3PnSDzim3EkK6piIQ==',key_name='tempest-keypair-1162904154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f84d6702f394a86be93c8b569d31698',ramdisk_id='',reservation_id='r-k1hnrgis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1761881347',owner_user_name='tempest-TaggedBootDevicesTest-1761881347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82b31b1cbe344ff587c86d89c57b9325',uuid=6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16a739aa-8e59-4e49-9d81-2242527d12ab", "address": "fa:16:3e:6e:4f:3e", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a739aa-8e", "ovs_interfaceid": "16a739aa-8e59-4e49-9d81-2242527d12ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converting VIF {"id": "16a739aa-8e59-4e49-9d81-2242527d12ab", "address": "fa:16:3e:6e:4f:3e", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a739aa-8e", "ovs_interfaceid": "16a739aa-8e59-4e49-9d81-2242527d12ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:4f:3e,bridge_name='br-int',has_traffic_filtering=True,id=16a739aa-8e59-4e49-9d81-2242527d12ab,network=Network(a7129b01-9ed6-480f-972a-f95db79263ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap16a739aa-8e') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1242188617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1242188617',id=9,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeFvsHYdJBNEbcxV4XXAiRnx+5sL87PKC5LnKhGGASCKmKVu4R47G5S+DRgHjKuQT8IHEwuFJNtLjOfV+3XJegm5cY0CWqKT4tpTvGrm284xrF0t3PnSDzim3EkK6piIQ==',key_name='tempest-keypair-1162904154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f84d6702f394a86be93c8b569d31698',ramdisk_id='',reservation_id='r-k1hnrgis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1761881347',owner_user_name='tempest-TaggedBootDevicesTest-1761881347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82b31b1cbe344ff587c86d89c57b9325',uuid=6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97484d3b-3fdd-4ad3-8125-12117341441c", "address": "fa:16:3e:32:75:5c", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97484d3b-3f", "ovs_interfaceid": "97484d3b-3fdd-4ad3-8125-12117341441c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converting VIF {"id": "97484d3b-3fdd-4ad3-8125-12117341441c", "address": "fa:16:3e:32:75:5c", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97484d3b-3f", "ovs_interfaceid": "97484d3b-3fdd-4ad3-8125-12117341441c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:75:5c,bridge_name='br-int',has_traffic_filtering=True,id=97484d3b-3fdd-4ad3-8125-12117341441c,network=Network(a7129b01-9ed6-480f-972a-f95db79263ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97484d3b-3f') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1242188617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1242188617',id=9,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeFvsHYdJBNEbcxV4XXAiRnx+5sL87PKC5LnKhGGASCKmKVu4R47G5S+DRgHjKuQT8IHEwuFJNtLjOfV+3XJegm5cY0CWqKT4tpTvGrm284xrF0t3PnSDzim3EkK6piIQ==',key_name='tempest-keypair-1162904154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f84d6702f394a86be93c8b569d31698',ramdisk_id='',reservation_id='r-k1hnrgis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1761881347',owner_user_name='tempest-TaggedBootDevicesTest-1761881347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82b31b1cbe344ff587c86d89c57b9325',uuid=6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69b8504c-b89b-44af-9324-d6d096960909", "address": "fa:16:3e:5a:c6:3d", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8504c-b8", "ovs_interfaceid": "69b8504c-b89b-44af-9324-d6d096960909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converting VIF {"id": "69b8504c-b89b-44af-9324-d6d096960909", "address": "fa:16:3e:5a:c6:3d", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8504c-b8", "ovs_interfaceid": "69b8504c-b89b-44af-9324-d6d096960909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:c6:3d,bridge_name='br-int',has_traffic_filtering=True,id=69b8504c-b89b-44af-9324-d6d096960909,network=Network(a7129b01-9ed6-480f-972a-f95db79263ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b8504c-b8') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1242188617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1242188617',id=9,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeFvsHYdJBNEbcxV4XXAiRnx+5sL87PKC5LnKhGGASCKmKVu4R47G5S+DRgHjKuQT8IHEwuFJNtLjOfV+3XJegm5cY0CWqKT4tpTvGrm284xrF0t3PnSDzim3EkK6piIQ==',key_name='tempest-keypair-1162904154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f84d6702f394a86be93c8b569d31698',ramdisk_id='',reservation_id='r-k1hnrgis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1761881347',owner_user_name='tempest-TaggedBootDevicesTest-1761881347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82b31b1cbe344ff587c86d89c57b9325',uuid=6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "462a6ab8-f964-4dda-9286-2fca0955907b", "address": "fa:16:3e:10:19:52", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462a6ab8-f9", "ovs_interfaceid": "462a6ab8-f964-4dda-9286-2fca0955907b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converting VIF {"id": "462a6ab8-f964-4dda-9286-2fca0955907b", "address": "fa:16:3e:10:19:52", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462a6ab8-f9", "ovs_interfaceid": "462a6ab8-f964-4dda-9286-2fca0955907b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:19:52,bridge_name='br-int',has_traffic_filtering=True,id=462a6ab8-f964-4dda-9286-2fca0955907b,network=Network(65137d48-c682-48b0-9317-84ee3d9bc51d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462a6ab8-f9') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1242188617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1242188617',id=9,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeFvsHYdJBNEbcxV4XXAiRnx+5sL87PKC5LnKhGGASCKmKVu4R47G5S+DRgHjKuQT8IHEwuFJNtLjOfV+3XJegm5cY0CWqKT4tpTvGrm284xrF0t3PnSDzim3EkK6piIQ==',key_name='tempest-keypair-1162904154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f84d6702f394a86be93c8b569d31698',ramdisk_id='',reservation_id='r-k1hnrgis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1761881347',owner_user_name='tempest-TaggedBootDevicesTest-1761881347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82b31b1cbe344ff587c86d89c57b9325',uuid=6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8fdda48-16be-4318-a84d-79d50154eec0", "address": "fa:16:3e:e0:ce:00", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8fdda48-16", "ovs_interfaceid": "f8fdda48-16be-4318-a84d-79d50154eec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converting VIF {"id": "f8fdda48-16be-4318-a84d-79d50154eec0", "address": "fa:16:3e:e0:ce:00", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8fdda48-16", "ovs_interfaceid": "f8fdda48-16be-4318-a84d-79d50154eec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ce:00,bridge_name='br-int',has_traffic_filtering=True,id=f8fdda48-16be-4318-a84d-79d50154eec0,network=Network(65137d48-c682-48b0-9317-84ee3d9bc51d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8fdda48-16') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.objects.instance [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:51:18 user nova-compute[72504]:   <uuid>6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f</uuid>
Aug 01 19:51:18 user nova-compute[72504]:   <name>instance-00000009</name>
Aug 01 19:51:18 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:51:18 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:51:18 user nova-compute[72504]:   <metadata>
Aug 01 19:51:18 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:51:18 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:51:18 user nova-compute[72504]:       <nova:name>tempest-device-tagging-server-1242188617</nova:name>
Aug 01 19:51:18 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:51:13</nova:creationTime>
Aug 01 19:51:18 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:51:18 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:51:18 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:51:18 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:51:18 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:51:18 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:51:18 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:51:18 user nova-compute[72504]:       <nova:owner>
Aug 01 19:51:18 user nova-compute[72504]:         <nova:user uuid="82b31b1cbe344ff587c86d89c57b9325">tempest-TaggedBootDevicesTest-1761881347-project-member</nova:user>
Aug 01 19:51:18 user nova-compute[72504]:         <nova:project uuid="4f84d6702f394a86be93c8b569d31698">tempest-TaggedBootDevicesTest-1761881347</nova:project>
Aug 01 19:51:18 user nova-compute[72504]:       </nova:owner>
Aug 01 19:51:18 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:51:18 user nova-compute[72504]:       <nova:ports>
Aug 01 19:51:18 user nova-compute[72504]:         <nova:port uuid="5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828">
Aug 01 19:51:18 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 19:51:18 user nova-compute[72504]:         </nova:port>
Aug 01 19:51:18 user nova-compute[72504]:         <nova:port uuid="423f358a-b722-4561-8f80-0c53f295e565">
Aug 01 19:51:18 user nova-compute[72504]:           <nova:ip type="fixed" address="10.1.1.81" ipVersion="4"/>
Aug 01 19:51:18 user nova-compute[72504]:         </nova:port>
Aug 01 19:51:18 user nova-compute[72504]:         <nova:port uuid="16a739aa-8e59-4e49-9d81-2242527d12ab">
Aug 01 19:51:18 user nova-compute[72504]:           <nova:ip type="fixed" address="10.1.1.205" ipVersion="4"/>
Aug 01 19:51:18 user nova-compute[72504]:         </nova:port>
Aug 01 19:51:18 user nova-compute[72504]:         <nova:port uuid="97484d3b-3fdd-4ad3-8125-12117341441c">
Aug 01 19:51:18 user nova-compute[72504]:           <nova:ip type="fixed" address="10.1.1.228" ipVersion="4"/>
Aug 01 19:51:18 user nova-compute[72504]:         </nova:port>
Aug 01 19:51:18 user nova-compute[72504]:         <nova:port uuid="69b8504c-b89b-44af-9324-d6d096960909">
Aug 01 19:51:18 user nova-compute[72504]:           <nova:ip type="fixed" address="10.1.1.136" ipVersion="4"/>
Aug 01 19:51:18 user nova-compute[72504]:         </nova:port>
Aug 01 19:51:18 user nova-compute[72504]:         <nova:port uuid="462a6ab8-f964-4dda-9286-2fca0955907b">
Aug 01 19:51:18 user nova-compute[72504]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 01 19:51:18 user nova-compute[72504]:         </nova:port>
Aug 01 19:51:18 user nova-compute[72504]:         <nova:port uuid="f8fdda48-16be-4318-a84d-79d50154eec0">
Aug 01 19:51:18 user nova-compute[72504]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 01 19:51:18 user nova-compute[72504]:         </nova:port>
Aug 01 19:51:18 user nova-compute[72504]:       </nova:ports>
Aug 01 19:51:18 user nova-compute[72504]:     </nova:instance>
Aug 01 19:51:18 user nova-compute[72504]:   </metadata>
Aug 01 19:51:18 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:51:18 user nova-compute[72504]:     <system>
Aug 01 19:51:18 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:51:18 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:51:18 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:51:18 user nova-compute[72504]:       <entry name="serial">6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f</entry>
Aug 01 19:51:18 user nova-compute[72504]:       <entry name="uuid">6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f</entry>
Aug 01 19:51:18 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:51:18 user nova-compute[72504]:     </system>
Aug 01 19:51:18 user nova-compute[72504]:   </sysinfo>
Aug 01 19:51:18 user nova-compute[72504]:   <os>
Aug 01 19:51:18 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:51:18 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:51:18 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:51:18 user nova-compute[72504]:   </os>
Aug 01 19:51:18 user nova-compute[72504]:   <features>
Aug 01 19:51:18 user nova-compute[72504]:     <acpi/>
Aug 01 19:51:18 user nova-compute[72504]:     <apic/>
Aug 01 19:51:18 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:51:18 user nova-compute[72504]:   </features>
Aug 01 19:51:18 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:51:18 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:51:18 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:51:18 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:51:18 user nova-compute[72504]:   </clock>
Aug 01 19:51:18 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:51:18 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:51:18 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:51:18 user nova-compute[72504]:   </cpu>
Aug 01 19:51:18 user nova-compute[72504]:   <devices>
Aug 01 19:51:18 user nova-compute[72504]:     <disk type="file" device="cdrom">
Aug 01 19:51:18 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 19:51:18 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f/disk.config"/>
Aug 01 19:51:18 user nova-compute[72504]:       <target dev="hda" bus="ide"/>
Aug 01 19:51:18 user nova-compute[72504]:     </disk>
Aug 01 19:51:18 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 19:51:18 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:51:18 user nova-compute[72504]:       <source dev="/dev/sdb"/>
Aug 01 19:51:18 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:51:18 user nova-compute[72504]:       <serial>e233d7c5-9e36-461b-850b-774fcad75f65</serial>
Aug 01 19:51:18 user nova-compute[72504]:     </disk>
Aug 01 19:51:18 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 19:51:18 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:51:18 user nova-compute[72504]:       <source dev="/dev/sdc"/>
Aug 01 19:51:18 user nova-compute[72504]:       <target dev="vdb" bus="virtio"/>
Aug 01 19:51:18 user nova-compute[72504]:       <serial>84390bb0-1665-494a-88a9-0e106017df25</serial>
Aug 01 19:51:18 user nova-compute[72504]:     </disk>
Aug 01 19:51:18 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 19:51:18 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:51:18 user nova-compute[72504]:       <source dev="/dev/sdd"/>
Aug 01 19:51:18 user nova-compute[72504]:       <target dev="vdc" bus="virtio"/>
Aug 01 19:51:18 user nova-compute[72504]:       <serial>6d7f593f-5ffb-4c62-bfc3-51cb2c24977b</serial>
Aug 01 19:51:18 user nova-compute[72504]:     </disk>
Aug 01 19:51:18 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:51:18 user nova-compute[72504]:       <mac address="fa:16:3e:b5:fc:7c"/>
Aug 01 19:51:18 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:51:18 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:51:18 user nova-compute[72504]:       <target dev="tap5d16fa4f-b0"/>
Aug 01 19:51:18 user nova-compute[72504]:     </interface>
Aug 01 19:51:18 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:51:18 user nova-compute[72504]:       <mac address="fa:16:3e:9a:f0:25"/>
Aug 01 19:51:18 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:51:18 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:51:18 user nova-compute[72504]:       <target dev="tap423f358a-b7"/>
Aug 01 19:51:18 user nova-compute[72504]:     </interface>
Aug 01 19:51:18 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:51:18 user nova-compute[72504]:       <mac address="fa:16:3e:6e:4f:3e"/>
Aug 01 19:51:18 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:51:18 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:51:18 user nova-compute[72504]:       <target dev="tap16a739aa-8e"/>
Aug 01 19:51:18 user nova-compute[72504]:     </interface>
Aug 01 19:51:18 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:51:18 user nova-compute[72504]:       <mac address="fa:16:3e:32:75:5c"/>
Aug 01 19:51:18 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:51:18 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:51:18 user nova-compute[72504]:       <target dev="tap97484d3b-3f"/>
Aug 01 19:51:18 user nova-compute[72504]:     </interface>
Aug 01 19:51:18 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:51:18 user nova-compute[72504]:       <mac address="fa:16:3e:5a:c6:3d"/>
Aug 01 19:51:18 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:51:18 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:51:18 user nova-compute[72504]:       <target dev="tap69b8504c-b8"/>
Aug 01 19:51:18 user nova-compute[72504]:     </interface>
Aug 01 19:51:18 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:51:18 user nova-compute[72504]:       <mac address="fa:16:3e:10:19:52"/>
Aug 01 19:51:18 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:51:18 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:51:18 user nova-compute[72504]:       <target dev="tap462a6ab8-f9"/>
Aug 01 19:51:18 user nova-compute[72504]:     </interface>
Aug 01 19:51:18 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:51:18 user nova-compute[72504]:       <mac address="fa:16:3e:e0:ce:00"/>
Aug 01 19:51:18 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:51:18 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:51:18 user nova-compute[72504]:       <target dev="tapf8fdda48-16"/>
Aug 01 19:51:18 user nova-compute[72504]:     </interface>
Aug 01 19:51:18 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:51:18 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f/console.log" append="off"/>
Aug 01 19:51:18 user nova-compute[72504]:     </serial>
Aug 01 19:51:18 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:51:18 user nova-compute[72504]:     <video>
Aug 01 19:51:18 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:51:18 user nova-compute[72504]:     </video>
Aug 01 19:51:18 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:51:18 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:51:18 user nova-compute[72504]:     </rng>
Aug 01 19:51:18 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:51:18 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:51:18 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:51:18 user nova-compute[72504]:     </memballoon>
Aug 01 19:51:18 user nova-compute[72504]:   </devices>
Aug 01 19:51:18 user nova-compute[72504]: </domain>
Aug 01 19:51:18 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1242188617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1242188617',id=9,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeFvsHYdJBNEbcxV4XXAiRnx+5sL87PKC5LnKhGGASCKmKVu4R47G5S+DRgHjKuQT8IHEwuFJNtLjOfV+3XJegm5cY0CWqKT4tpTvGrm284xrF0t3PnSDzim3EkK6piIQ==',key_name='tempest-keypair-1162904154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f84d6702f394a86be93c8b569d31698',ramdisk_id='',reservation_id='r-k1hnrgis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1761881347',owner_user_name='tempest-TaggedBootDevicesTest-1761881347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82b31b1cbe344ff587c86d89c57b9325',uuid=6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "address": "fa:16:3e:b5:fc:7c", "network": {"id": "8ac53e2b-6d51-4d2e-b457-6b26a63bf383", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1111786338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d16fa4f-b0", "ovs_interfaceid": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converting VIF {"id": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "address": "fa:16:3e:b5:fc:7c", "network": {"id": "8ac53e2b-6d51-4d2e-b457-6b26a63bf383", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1111786338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d16fa4f-b0", "ovs_interfaceid": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:fc:7c,bridge_name='br-int',has_traffic_filtering=True,id=5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828,network=Network(8ac53e2b-6d51-4d2e-b457-6b26a63bf383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d16fa4f-b0') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG os_vif [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:fc:7c,bridge_name='br-int',has_traffic_filtering=True,id=5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828,network=Network(8ac53e2b-6d51-4d2e-b457-6b26a63bf383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d16fa4f-b0') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d16fa4f-b0, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5d16fa4f-b0, col_values=(('external_ids', {'iface-id': '5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:fc:7c', 'vm-uuid': '6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:18 user nova-compute[72504]: INFO os_vif [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:fc:7c,bridge_name='br-int',has_traffic_filtering=True,id=5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828,network=Network(8ac53e2b-6d51-4d2e-b457-6b26a63bf383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d16fa4f-b0')
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1242188617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1242188617',id=9,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeFvsHYdJBNEbcxV4XXAiRnx+5sL87PKC5LnKhGGASCKmKVu4R47G5S+DRgHjKuQT8IHEwuFJNtLjOfV+3XJegm5cY0CWqKT4tpTvGrm284xrF0t3PnSDzim3EkK6piIQ==',key_name='tempest-keypair-1162904154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f84d6702f394a86be93c8b569d31698',ramdisk_id='',reservation_id='r-k1hnrgis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1761881347',owner_user_name='tempest-TaggedBootDevicesTest-1761881347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82b31b1cbe344ff587c86d89c57b9325',uuid=6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "423f358a-b722-4561-8f80-0c53f295e565", "address": "fa:16:3e:9a:f0:25", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423f358a-b7", "ovs_interfaceid": "423f358a-b722-4561-8f80-0c53f295e565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converting VIF {"id": "423f358a-b722-4561-8f80-0c53f295e565", "address": "fa:16:3e:9a:f0:25", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423f358a-b7", "ovs_interfaceid": "423f358a-b722-4561-8f80-0c53f295e565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:f0:25,bridge_name='br-int',has_traffic_filtering=True,id=423f358a-b722-4561-8f80-0c53f295e565,network=Network(a7129b01-9ed6-480f-972a-f95db79263ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap423f358a-b7') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG os_vif [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:f0:25,bridge_name='br-int',has_traffic_filtering=True,id=423f358a-b722-4561-8f80-0c53f295e565,network=Network(a7129b01-9ed6-480f-972a-f95db79263ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap423f358a-b7') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap423f358a-b7, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap423f358a-b7, col_values=(('external_ids', {'iface-id': '423f358a-b722-4561-8f80-0c53f295e565', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:f0:25', 'vm-uuid': '6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:18 user nova-compute[72504]: INFO os_vif [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:f0:25,bridge_name='br-int',has_traffic_filtering=True,id=423f358a-b722-4561-8f80-0c53f295e565,network=Network(a7129b01-9ed6-480f-972a-f95db79263ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap423f358a-b7')
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1242188617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1242188617',id=9,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeFvsHYdJBNEbcxV4XXAiRnx+5sL87PKC5LnKhGGASCKmKVu4R47G5S+DRgHjKuQT8IHEwuFJNtLjOfV+3XJegm5cY0CWqKT4tpTvGrm284xrF0t3PnSDzim3EkK6piIQ==',key_name='tempest-keypair-1162904154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f84d6702f394a86be93c8b569d31698',ramdisk_id='',reservation_id='r-k1hnrgis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1761881347',owner_user_name='tempest-TaggedBootDevicesTest-1761881347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82b31b1cbe344ff587c86d89c57b9325',uuid=6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16a739aa-8e59-4e49-9d81-2242527d12ab", "address": "fa:16:3e:6e:4f:3e", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a739aa-8e", "ovs_interfaceid": "16a739aa-8e59-4e49-9d81-2242527d12ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converting VIF {"id": "16a739aa-8e59-4e49-9d81-2242527d12ab", "address": "fa:16:3e:6e:4f:3e", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a739aa-8e", "ovs_interfaceid": "16a739aa-8e59-4e49-9d81-2242527d12ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:4f:3e,bridge_name='br-int',has_traffic_filtering=True,id=16a739aa-8e59-4e49-9d81-2242527d12ab,network=Network(a7129b01-9ed6-480f-972a-f95db79263ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap16a739aa-8e') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG os_vif [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:4f:3e,bridge_name='br-int',has_traffic_filtering=True,id=16a739aa-8e59-4e49-9d81-2242527d12ab,network=Network(a7129b01-9ed6-480f-972a-f95db79263ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap16a739aa-8e') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16a739aa-8e, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap16a739aa-8e, col_values=(('external_ids', {'iface-id': '16a739aa-8e59-4e49-9d81-2242527d12ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:4f:3e', 'vm-uuid': '6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:18 user nova-compute[72504]: INFO os_vif [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:4f:3e,bridge_name='br-int',has_traffic_filtering=True,id=16a739aa-8e59-4e49-9d81-2242527d12ab,network=Network(a7129b01-9ed6-480f-972a-f95db79263ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap16a739aa-8e')
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1242188617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1242188617',id=9,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeFvsHYdJBNEbcxV4XXAiRnx+5sL87PKC5LnKhGGASCKmKVu4R47G5S+DRgHjKuQT8IHEwuFJNtLjOfV+3XJegm5cY0CWqKT4tpTvGrm284xrF0t3PnSDzim3EkK6piIQ==',key_name='tempest-keypair-1162904154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f84d6702f394a86be93c8b569d31698',ramdisk_id='',reservation_id='r-k1hnrgis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1761881347',owner_user_name='tempest-TaggedBootDevicesTest-1761881347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82b31b1cbe344ff587c86d89c57b9325',uuid=6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97484d3b-3fdd-4ad3-8125-12117341441c", "address": "fa:16:3e:32:75:5c", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97484d3b-3f", "ovs_interfaceid": "97484d3b-3fdd-4ad3-8125-12117341441c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converting VIF {"id": "97484d3b-3fdd-4ad3-8125-12117341441c", "address": "fa:16:3e:32:75:5c", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97484d3b-3f", "ovs_interfaceid": "97484d3b-3fdd-4ad3-8125-12117341441c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:75:5c,bridge_name='br-int',has_traffic_filtering=True,id=97484d3b-3fdd-4ad3-8125-12117341441c,network=Network(a7129b01-9ed6-480f-972a-f95db79263ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97484d3b-3f') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG os_vif [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:75:5c,bridge_name='br-int',has_traffic_filtering=True,id=97484d3b-3fdd-4ad3-8125-12117341441c,network=Network(a7129b01-9ed6-480f-972a-f95db79263ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97484d3b-3f') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97484d3b-3f, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap97484d3b-3f, col_values=(('external_ids', {'iface-id': '97484d3b-3fdd-4ad3-8125-12117341441c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:75:5c', 'vm-uuid': '6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:18 user nova-compute[72504]: INFO os_vif [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:75:5c,bridge_name='br-int',has_traffic_filtering=True,id=97484d3b-3fdd-4ad3-8125-12117341441c,network=Network(a7129b01-9ed6-480f-972a-f95db79263ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97484d3b-3f')
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1242188617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1242188617',id=9,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeFvsHYdJBNEbcxV4XXAiRnx+5sL87PKC5LnKhGGASCKmKVu4R47G5S+DRgHjKuQT8IHEwuFJNtLjOfV+3XJegm5cY0CWqKT4tpTvGrm284xrF0t3PnSDzim3EkK6piIQ==',key_name='tempest-keypair-1162904154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f84d6702f394a86be93c8b569d31698',ramdisk_id='',reservation_id='r-k1hnrgis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1761881347',owner_user_name='tempest-TaggedBootDevicesTest-1761881347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82b31b1cbe344ff587c86d89c57b9325',uuid=6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69b8504c-b89b-44af-9324-d6d096960909", "address": "fa:16:3e:5a:c6:3d", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8504c-b8", "ovs_interfaceid": "69b8504c-b89b-44af-9324-d6d096960909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converting VIF {"id": "69b8504c-b89b-44af-9324-d6d096960909", "address": "fa:16:3e:5a:c6:3d", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8504c-b8", "ovs_interfaceid": "69b8504c-b89b-44af-9324-d6d096960909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:c6:3d,bridge_name='br-int',has_traffic_filtering=True,id=69b8504c-b89b-44af-9324-d6d096960909,network=Network(a7129b01-9ed6-480f-972a-f95db79263ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b8504c-b8') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG os_vif [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:c6:3d,bridge_name='br-int',has_traffic_filtering=True,id=69b8504c-b89b-44af-9324-d6d096960909,network=Network(a7129b01-9ed6-480f-972a-f95db79263ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b8504c-b8') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69b8504c-b8, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69b8504c-b8, col_values=(('external_ids', {'iface-id': '69b8504c-b89b-44af-9324-d6d096960909', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:c6:3d', 'vm-uuid': '6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:18 user nova-compute[72504]: INFO os_vif [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:c6:3d,bridge_name='br-int',has_traffic_filtering=True,id=69b8504c-b89b-44af-9324-d6d096960909,network=Network(a7129b01-9ed6-480f-972a-f95db79263ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b8504c-b8')
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1242188617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1242188617',id=9,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeFvsHYdJBNEbcxV4XXAiRnx+5sL87PKC5LnKhGGASCKmKVu4R47G5S+DRgHjKuQT8IHEwuFJNtLjOfV+3XJegm5cY0CWqKT4tpTvGrm284xrF0t3PnSDzim3EkK6piIQ==',key_name='tempest-keypair-1162904154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f84d6702f394a86be93c8b569d31698',ramdisk_id='',reservation_id='r-k1hnrgis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1761881347',owner_user_name='tempest-TaggedBootDevicesTest-1761881347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82b31b1cbe344ff587c86d89c57b9325',uuid=6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "462a6ab8-f964-4dda-9286-2fca0955907b", "address": "fa:16:3e:10:19:52", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462a6ab8-f9", "ovs_interfaceid": "462a6ab8-f964-4dda-9286-2fca0955907b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converting VIF {"id": "462a6ab8-f964-4dda-9286-2fca0955907b", "address": "fa:16:3e:10:19:52", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462a6ab8-f9", "ovs_interfaceid": "462a6ab8-f964-4dda-9286-2fca0955907b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:19:52,bridge_name='br-int',has_traffic_filtering=True,id=462a6ab8-f964-4dda-9286-2fca0955907b,network=Network(65137d48-c682-48b0-9317-84ee3d9bc51d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462a6ab8-f9') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG os_vif [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:19:52,bridge_name='br-int',has_traffic_filtering=True,id=462a6ab8-f964-4dda-9286-2fca0955907b,network=Network(65137d48-c682-48b0-9317-84ee3d9bc51d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462a6ab8-f9') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap462a6ab8-f9, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap462a6ab8-f9, col_values=(('external_ids', {'iface-id': '462a6ab8-f964-4dda-9286-2fca0955907b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:19:52', 'vm-uuid': '6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Updating instance_info_cache with network_info: [{"id": "a4953c19-ef72-4bbe-b271-40cc5162842d", "address": "fa:16:3e:86:10:53", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4953c19-ef", "ovs_interfaceid": "a4953c19-ef72-4bbe-b271-40cc5162842d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:18 user nova-compute[72504]: INFO os_vif [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:19:52,bridge_name='br-int',has_traffic_filtering=True,id=462a6ab8-f964-4dda-9286-2fca0955907b,network=Network(65137d48-c682-48b0-9317-84ee3d9bc51d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462a6ab8-f9')
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1242188617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1242188617',id=9,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeFvsHYdJBNEbcxV4XXAiRnx+5sL87PKC5LnKhGGASCKmKVu4R47G5S+DRgHjKuQT8IHEwuFJNtLjOfV+3XJegm5cY0CWqKT4tpTvGrm284xrF0t3PnSDzim3EkK6piIQ==',key_name='tempest-keypair-1162904154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f84d6702f394a86be93c8b569d31698',ramdisk_id='',reservation_id='r-k1hnrgis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1761881347',owner_user_name='tempest-TaggedBootDevicesTest-1761881347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82b31b1cbe344ff587c86d89c57b9325',uuid=6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8fdda48-16be-4318-a84d-79d50154eec0", "address": "fa:16:3e:e0:ce:00", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8fdda48-16", "ovs_interfaceid": "f8fdda48-16be-4318-a84d-79d50154eec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converting VIF {"id": "f8fdda48-16be-4318-a84d-79d50154eec0", "address": "fa:16:3e:e0:ce:00", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8fdda48-16", "ovs_interfaceid": "f8fdda48-16be-4318-a84d-79d50154eec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ce:00,bridge_name='br-int',has_traffic_filtering=True,id=f8fdda48-16be-4318-a84d-79d50154eec0,network=Network(65137d48-c682-48b0-9317-84ee3d9bc51d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8fdda48-16') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG os_vif [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ce:00,bridge_name='br-int',has_traffic_filtering=True,id=f8fdda48-16be-4318-a84d-79d50154eec0,network=Network(65137d48-c682-48b0-9317-84ee3d9bc51d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8fdda48-16') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-39b3076d-ce59-4e7c-976f-9355bf2f6ff4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8fdda48-16, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf8fdda48-16, col_values=(('external_ids', {'iface-id': 'f8fdda48-16be-4318-a84d-79d50154eec0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:ce:00', 'vm-uuid': '6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:18 user nova-compute[72504]: INFO os_vif [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ce:00,bridge_name='br-int',has_traffic_filtering=True,id=f8fdda48-16be-4318-a84d-79d50154eec0,network=Network(65137d48-c682-48b0-9317-84ee3d9bc51d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8fdda48-16')
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.compute.manager [req-bbd0a4d1-b569-4d2c-bb39-169ad1b6b36e req-aef2991c-889e-4a90-a318-68a24a9ccd9f service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Received event network-changed-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.compute.manager [req-bbd0a4d1-b569-4d2c-bb39-169ad1b6b36e req-aef2991c-889e-4a90-a318-68a24a9ccd9f service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Refreshing instance network info cache due to event network-changed-8f1cca03-e1f6-44db-b8d3-d7a305fc1461. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-bbd0a4d1-b569-4d2c-bb39-169ad1b6b36e req-aef2991c-889e-4a90-a318-68a24a9ccd9f service nova] Acquiring lock "refresh_cache-5193c770-80ca-44c3-9950-cb25c65e94e8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-bbd0a4d1-b569-4d2c-bb39-169ad1b6b36e req-aef2991c-889e-4a90-a318-68a24a9ccd9f service nova] Acquired lock "refresh_cache-5193c770-80ca-44c3-9950-cb25c65e94e8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.network.neutron [req-bbd0a4d1-b569-4d2c-bb39-169ad1b6b36e req-aef2991c-889e-4a90-a318-68a24a9ccd9f service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Refreshing network info cache for port 8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] No BDM found with device name hda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] No VIF found with MAC fa:16:3e:b5:fc:7c, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] No VIF found with MAC fa:16:3e:5a:c6:3d, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:51:18 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Using config drive
Aug 01 19:51:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-01105cab-0c06-4797-99bb-d77725c56946 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72504) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 19:51:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-01105cab-0c06-4797-99bb-d77725c56946 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] COPY block job progress, current cursor: 21692416 final cursor: 75497472 {{(pid=72504) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 19:51:19 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Creating config drive at /opt/stack/data/nova/instances/6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f/disk.config
Aug 01 19:51:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppa_ytg5a {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppa_ytg5a" returned: 0 in 0.068s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:19 user nova-compute[72504]: DEBUG nova.network.neutron [req-bbd0a4d1-b569-4d2c-bb39-169ad1b6b36e req-aef2991c-889e-4a90-a318-68a24a9ccd9f service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Updated VIF entry in instance network info cache for port 8f1cca03-e1f6-44db-b8d3-d7a305fc1461. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:51:19 user nova-compute[72504]: DEBUG nova.network.neutron [req-bbd0a4d1-b569-4d2c-bb39-169ad1b6b36e req-aef2991c-889e-4a90-a318-68a24a9ccd9f service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Updating instance_info_cache with network_info: [{"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:51:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-bbd0a4d1-b569-4d2c-bb39-169ad1b6b36e req-aef2991c-889e-4a90-a318-68a24a9ccd9f service nova] Releasing lock "refresh_cache-5193c770-80ca-44c3-9950-cb25c65e94e8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:51:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-01105cab-0c06-4797-99bb-d77725c56946 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72504) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 19:51:19 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-01105cab-0c06-4797-99bb-d77725c56946 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 19:51:19 user nova-compute[72504]: INFO nova.virt.block_device [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Booting with volume 2ef687e5-d914-480f-824a-371a3117d9d2 at /dev/vdc
Aug 01 19:51:20 user nova-compute[72504]: DEBUG os_brick.utils [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c650cea8-e9fe-4a14-9e90-06aeef1a99b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35e6014-b42b-4844-86df-5ce4643e872c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[509c0e4f-1726-4c50-bf92-9ec74b0c9f50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdd2c4d-10ac-40be-ad97-f51a7052c08c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:51:20 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b9fb82-c671-4d32-b237-0f8c43dd9360]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG os_brick.utils [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Updating existing volume attachment record: 52e2fe41-2db6-4712-873e-6cd660c133fb {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Acquiring lock "8eae5ffe-ab54-4dac-8169-69325448b92f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lock "8eae5ffe-ab54-4dac-8169-69325448b92f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG nova.objects.instance [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lazy-loading 'flavor' on Instance uuid 8eae5ffe-ab54-4dac-8169-69325448b92f {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lock "8eae5ffe-ab54-4dac-8169-69325448b92f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.112s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG nova.privsep.utils [None req-01105cab-0c06-4797-99bb-d77725c56946 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72504) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-01105cab-0c06-4797-99bb-d77725c56946 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpedz33hzu/9ddbc838f48b4bb98ab2aaf29f7d7572.delta /opt/stack/data/nova/instances/snapshots/tmpedz33hzu/9ddbc838f48b4bb98ab2aaf29f7d7572 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Acquiring lock "8eae5ffe-ab54-4dac-8169-69325448b92f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lock "8eae5ffe-ab54-4dac-8169-69325448b92f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:20 user nova-compute[72504]: INFO nova.compute.manager [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Attaching volume fbb512c5-d581-4a9f-b93e-65e4fc1eff25 to /dev/vdb
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-01105cab-0c06-4797-99bb-d77725c56946 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpedz33hzu/9ddbc838f48b4bb98ab2aaf29f7d7572.delta /opt/stack/data/nova/instances/snapshots/tmpedz33hzu/9ddbc838f48b4bb98ab2aaf29f7d7572" returned: 0 in 0.547s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:20 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-01105cab-0c06-4797-99bb-d77725c56946 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Snapshot extracted, beginning image upload
Aug 01 19:51:20 user nova-compute[72504]: DEBUG os_brick.utils [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[80881840-9b8f-4e8c-8125-3b36e9d409d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[47eccb88-7a4c-472d-9bf0-cf2c5a8b0796]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37f8e44-b7cd-41c3-8ea2-31cc87ff26ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfebc337-3529-4481-ab9a-002dae10dfc3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:51:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:51:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:51:21 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:51:21 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9241e149-45f8-4e0f-944b-3f7abe0b58c1]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:51:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:51:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:51:21 user nova-compute[72504]: DEBUG os_brick.utils [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:51:21 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Updating existing volume attachment record: 5279bb00-2b07-4cbd-a6f8-da3d449b2179 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:51:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:22 user nova-compute[72504]: DEBUG nova.compute.manager [req-ebeea889-24ef-42c3-ac55-9a5aa12b9fbc req-a17fe33f-c2c6-40c0-aa72-db5b3b3848a4 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-plugged-5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ebeea889-24ef-42c3-ac55-9a5aa12b9fbc req-a17fe33f-c2c6-40c0-aa72-db5b3b3848a4 service nova] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ebeea889-24ef-42c3-ac55-9a5aa12b9fbc req-a17fe33f-c2c6-40c0-aa72-db5b3b3848a4 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ebeea889-24ef-42c3-ac55-9a5aa12b9fbc req-a17fe33f-c2c6-40c0-aa72-db5b3b3848a4 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:22 user nova-compute[72504]: DEBUG nova.compute.manager [req-ebeea889-24ef-42c3-ac55-9a5aa12b9fbc req-a17fe33f-c2c6-40c0-aa72-db5b3b3848a4 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] No waiting events found dispatching network-vif-plugged-5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:22 user nova-compute[72504]: WARNING nova.compute.manager [req-ebeea889-24ef-42c3-ac55-9a5aa12b9fbc req-a17fe33f-c2c6-40c0-aa72-db5b3b3848a4 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received unexpected event network-vif-plugged-5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828 for instance with vm_state building and task_state spawning.
Aug 01 19:51:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:22 user nova-compute[72504]: DEBUG nova.compute.manager [req-aa837d72-3b2a-4adb-bcc3-0d7ad39b9238 req-e3c0b8c6-fb97-4352-8014-2a1947fae688 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-plugged-423f358a-b722-4561-8f80-0c53f295e565 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-aa837d72-3b2a-4adb-bcc3-0d7ad39b9238 req-e3c0b8c6-fb97-4352-8014-2a1947fae688 service nova] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-aa837d72-3b2a-4adb-bcc3-0d7ad39b9238 req-e3c0b8c6-fb97-4352-8014-2a1947fae688 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-aa837d72-3b2a-4adb-bcc3-0d7ad39b9238 req-e3c0b8c6-fb97-4352-8014-2a1947fae688 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:22 user nova-compute[72504]: DEBUG nova.compute.manager [req-aa837d72-3b2a-4adb-bcc3-0d7ad39b9238 req-e3c0b8c6-fb97-4352-8014-2a1947fae688 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] No waiting events found dispatching network-vif-plugged-423f358a-b722-4561-8f80-0c53f295e565 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:22 user nova-compute[72504]: WARNING nova.compute.manager [req-aa837d72-3b2a-4adb-bcc3-0d7ad39b9238 req-e3c0b8c6-fb97-4352-8014-2a1947fae688 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received unexpected event network-vif-plugged-423f358a-b722-4561-8f80-0c53f295e565 for instance with vm_state building and task_state spawning.
Aug 01 19:51:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG nova.compute.manager [req-81b70165-328b-483f-a062-298210aa46b1 req-bd3a1e8d-df8a-46c0-8d8e-def6a4b0bc97 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-plugged-97484d3b-3fdd-4ad3-8125-12117341441c {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-81b70165-328b-483f-a062-298210aa46b1 req-bd3a1e8d-df8a-46c0-8d8e-def6a4b0bc97 service nova] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-81b70165-328b-483f-a062-298210aa46b1 req-bd3a1e8d-df8a-46c0-8d8e-def6a4b0bc97 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-81b70165-328b-483f-a062-298210aa46b1 req-bd3a1e8d-df8a-46c0-8d8e-def6a4b0bc97 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG nova.compute.manager [req-81b70165-328b-483f-a062-298210aa46b1 req-bd3a1e8d-df8a-46c0-8d8e-def6a4b0bc97 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] No waiting events found dispatching network-vif-plugged-97484d3b-3fdd-4ad3-8125-12117341441c {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:24 user nova-compute[72504]: WARNING nova.compute.manager [req-81b70165-328b-483f-a062-298210aa46b1 req-bd3a1e8d-df8a-46c0-8d8e-def6a4b0bc97 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received unexpected event network-vif-plugged-97484d3b-3fdd-4ad3-8125-12117341441c for instance with vm_state building and task_state spawning.
Aug 01 19:51:24 user nova-compute[72504]: DEBUG nova.compute.manager [req-5e2e7523-f1b9-4227-8dba-565fd987982d req-a89d4e62-8688-43a8-8732-6c2399a396ac service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-plugged-5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5e2e7523-f1b9-4227-8dba-565fd987982d req-a89d4e62-8688-43a8-8732-6c2399a396ac service nova] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5e2e7523-f1b9-4227-8dba-565fd987982d req-a89d4e62-8688-43a8-8732-6c2399a396ac service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5e2e7523-f1b9-4227-8dba-565fd987982d req-a89d4e62-8688-43a8-8732-6c2399a396ac service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG nova.compute.manager [req-5e2e7523-f1b9-4227-8dba-565fd987982d req-a89d4e62-8688-43a8-8732-6c2399a396ac service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] No waiting events found dispatching network-vif-plugged-5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:24 user nova-compute[72504]: WARNING nova.compute.manager [req-5e2e7523-f1b9-4227-8dba-565fd987982d req-a89d4e62-8688-43a8-8732-6c2399a396ac service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received unexpected event network-vif-plugged-5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828 for instance with vm_state building and task_state spawning.
Aug 01 19:51:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG nova.compute.manager [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-plugged-423f358a-b722-4561-8f80-0c53f295e565 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG nova.compute.manager [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] No waiting events found dispatching network-vif-plugged-423f358a-b722-4561-8f80-0c53f295e565 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:24 user nova-compute[72504]: WARNING nova.compute.manager [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received unexpected event network-vif-plugged-423f358a-b722-4561-8f80-0c53f295e565 for instance with vm_state building and task_state spawning.
Aug 01 19:51:24 user nova-compute[72504]: DEBUG nova.compute.manager [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-plugged-16a739aa-8e59-4e49-9d81-2242527d12ab {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG nova.compute.manager [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] No waiting events found dispatching network-vif-plugged-16a739aa-8e59-4e49-9d81-2242527d12ab {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:24 user nova-compute[72504]: WARNING nova.compute.manager [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received unexpected event network-vif-plugged-16a739aa-8e59-4e49-9d81-2242527d12ab for instance with vm_state building and task_state spawning.
Aug 01 19:51:24 user nova-compute[72504]: DEBUG nova.compute.manager [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-plugged-16a739aa-8e59-4e49-9d81-2242527d12ab {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG nova.compute.manager [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] No waiting events found dispatching network-vif-plugged-16a739aa-8e59-4e49-9d81-2242527d12ab {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:24 user nova-compute[72504]: WARNING nova.compute.manager [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received unexpected event network-vif-plugged-16a739aa-8e59-4e49-9d81-2242527d12ab for instance with vm_state building and task_state spawning.
Aug 01 19:51:24 user nova-compute[72504]: DEBUG nova.compute.manager [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-plugged-69b8504c-b89b-44af-9324-d6d096960909 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG nova.compute.manager [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] No waiting events found dispatching network-vif-plugged-69b8504c-b89b-44af-9324-d6d096960909 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:24 user nova-compute[72504]: WARNING nova.compute.manager [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received unexpected event network-vif-plugged-69b8504c-b89b-44af-9324-d6d096960909 for instance with vm_state building and task_state spawning.
Aug 01 19:51:24 user nova-compute[72504]: DEBUG nova.compute.manager [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-plugged-69b8504c-b89b-44af-9324-d6d096960909 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:24 user nova-compute[72504]: DEBUG nova.compute.manager [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] No waiting events found dispatching network-vif-plugged-69b8504c-b89b-44af-9324-d6d096960909 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:24 user nova-compute[72504]: WARNING nova.compute.manager [req-c2e5fb7e-6484-4ea3-8c61-f1580074c907 req-76893672-8763-4ce6-9a53-951fbc6bd961 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received unexpected event network-vif-plugged-69b8504c-b89b-44af-9324-d6d096960909 for instance with vm_state building and task_state spawning.
Aug 01 19:51:25 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-01105cab-0c06-4797-99bb-d77725c56946 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Snapshot image upload complete
Aug 01 19:51:25 user nova-compute[72504]: INFO nova.compute.manager [None req-01105cab-0c06-4797-99bb-d77725c56946 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Took 8.13 seconds to snapshot the instance on the hypervisor.
Aug 01 19:51:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.compute.manager [req-30c71b1d-354f-46d8-aad7-e7b7da583631 req-a0a6c27b-b77d-4d27-ba1c-206d2ea0cd38 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-plugged-97484d3b-3fdd-4ad3-8125-12117341441c {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-30c71b1d-354f-46d8-aad7-e7b7da583631 req-a0a6c27b-b77d-4d27-ba1c-206d2ea0cd38 service nova] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-30c71b1d-354f-46d8-aad7-e7b7da583631 req-a0a6c27b-b77d-4d27-ba1c-206d2ea0cd38 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-30c71b1d-354f-46d8-aad7-e7b7da583631 req-a0a6c27b-b77d-4d27-ba1c-206d2ea0cd38 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.compute.manager [req-30c71b1d-354f-46d8-aad7-e7b7da583631 req-a0a6c27b-b77d-4d27-ba1c-206d2ea0cd38 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] No waiting events found dispatching network-vif-plugged-97484d3b-3fdd-4ad3-8125-12117341441c {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:26 user nova-compute[72504]: WARNING nova.compute.manager [req-30c71b1d-354f-46d8-aad7-e7b7da583631 req-a0a6c27b-b77d-4d27-ba1c-206d2ea0cd38 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received unexpected event network-vif-plugged-97484d3b-3fdd-4ad3-8125-12117341441c for instance with vm_state building and task_state spawning.
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.compute.manager [req-30c71b1d-354f-46d8-aad7-e7b7da583631 req-a0a6c27b-b77d-4d27-ba1c-206d2ea0cd38 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Received event network-changed-2edbeaad-cd66-4a79-9fae-544f2a33e922 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.compute.manager [req-30c71b1d-354f-46d8-aad7-e7b7da583631 req-a0a6c27b-b77d-4d27-ba1c-206d2ea0cd38 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Refreshing instance network info cache due to event network-changed-2edbeaad-cd66-4a79-9fae-544f2a33e922. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-30c71b1d-354f-46d8-aad7-e7b7da583631 req-a0a6c27b-b77d-4d27-ba1c-206d2ea0cd38 service nova] Acquiring lock "refresh_cache-76aa3861-0ca1-4e7f-9a15-9219037bc1ee" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-30c71b1d-354f-46d8-aad7-e7b7da583631 req-a0a6c27b-b77d-4d27-ba1c-206d2ea0cd38 service nova] Acquired lock "refresh_cache-76aa3861-0ca1-4e7f-9a15-9219037bc1ee" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.network.neutron [req-30c71b1d-354f-46d8-aad7-e7b7da583631 req-a0a6c27b-b77d-4d27-ba1c-206d2ea0cd38 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Refreshing network info cache for port 2edbeaad-cd66-4a79-9fae-544f2a33e922 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.compute.manager [req-15f33269-664d-47d9-82f9-6972a4cf7558 req-5a54728d-a919-46cf-99a8-fc506ea2e212 service nova] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Received event network-changed-5ecd0d2b-2f55-49b1-8858-3ab96e942b4f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.compute.manager [req-15f33269-664d-47d9-82f9-6972a4cf7558 req-5a54728d-a919-46cf-99a8-fc506ea2e212 service nova] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Refreshing instance network info cache due to event network-changed-5ecd0d2b-2f55-49b1-8858-3ab96e942b4f. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-15f33269-664d-47d9-82f9-6972a4cf7558 req-5a54728d-a919-46cf-99a8-fc506ea2e212 service nova] Acquiring lock "refresh_cache-1de87977-532f-45f7-856b-84df41b2a567" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-15f33269-664d-47d9-82f9-6972a4cf7558 req-5a54728d-a919-46cf-99a8-fc506ea2e212 service nova] Acquired lock "refresh_cache-1de87977-532f-45f7-856b-84df41b2a567" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.network.neutron [req-15f33269-664d-47d9-82f9-6972a4cf7558 req-5a54728d-a919-46cf-99a8-fc506ea2e212 service nova] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Refreshing network info cache for port 5ecd0d2b-2f55-49b1-8858-3ab96e942b4f {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.compute.manager [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919486.3992765, 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:51:26 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] VM Resumed (Lifecycle Event)
Aug 01 19:51:26 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Instance spawned successfully.
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:51:26 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919486.399668, 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:51:26 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] VM Started (Lifecycle Event)
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:51:26 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:51:26 user nova-compute[72504]: INFO nova.compute.manager [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Took 12.84 seconds to spawn the instance on the hypervisor.
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.compute.manager [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.compute.manager [req-5e4b5352-9be1-43aa-84bf-137028da0802 req-0f72f1c3-a6c6-48fa-a73d-20182f1c5cd8 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-plugged-462a6ab8-f964-4dda-9286-2fca0955907b {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5e4b5352-9be1-43aa-84bf-137028da0802 req-0f72f1c3-a6c6-48fa-a73d-20182f1c5cd8 service nova] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5e4b5352-9be1-43aa-84bf-137028da0802 req-0f72f1c3-a6c6-48fa-a73d-20182f1c5cd8 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5e4b5352-9be1-43aa-84bf-137028da0802 req-0f72f1c3-a6c6-48fa-a73d-20182f1c5cd8 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.compute.manager [req-5e4b5352-9be1-43aa-84bf-137028da0802 req-0f72f1c3-a6c6-48fa-a73d-20182f1c5cd8 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] No waiting events found dispatching network-vif-plugged-462a6ab8-f964-4dda-9286-2fca0955907b {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:26 user nova-compute[72504]: WARNING nova.compute.manager [req-5e4b5352-9be1-43aa-84bf-137028da0802 req-0f72f1c3-a6c6-48fa-a73d-20182f1c5cd8 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received unexpected event network-vif-plugged-462a6ab8-f964-4dda-9286-2fca0955907b for instance with vm_state building and task_state spawning.
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.compute.manager [req-5e4b5352-9be1-43aa-84bf-137028da0802 req-0f72f1c3-a6c6-48fa-a73d-20182f1c5cd8 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-plugged-462a6ab8-f964-4dda-9286-2fca0955907b {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5e4b5352-9be1-43aa-84bf-137028da0802 req-0f72f1c3-a6c6-48fa-a73d-20182f1c5cd8 service nova] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5e4b5352-9be1-43aa-84bf-137028da0802 req-0f72f1c3-a6c6-48fa-a73d-20182f1c5cd8 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5e4b5352-9be1-43aa-84bf-137028da0802 req-0f72f1c3-a6c6-48fa-a73d-20182f1c5cd8 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.compute.manager [req-5e4b5352-9be1-43aa-84bf-137028da0802 req-0f72f1c3-a6c6-48fa-a73d-20182f1c5cd8 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] No waiting events found dispatching network-vif-plugged-462a6ab8-f964-4dda-9286-2fca0955907b {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:26 user nova-compute[72504]: WARNING nova.compute.manager [req-5e4b5352-9be1-43aa-84bf-137028da0802 req-0f72f1c3-a6c6-48fa-a73d-20182f1c5cd8 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received unexpected event network-vif-plugged-462a6ab8-f964-4dda-9286-2fca0955907b for instance with vm_state building and task_state spawning.
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.compute.manager [req-5e4b5352-9be1-43aa-84bf-137028da0802 req-0f72f1c3-a6c6-48fa-a73d-20182f1c5cd8 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-plugged-f8fdda48-16be-4318-a84d-79d50154eec0 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5e4b5352-9be1-43aa-84bf-137028da0802 req-0f72f1c3-a6c6-48fa-a73d-20182f1c5cd8 service nova] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5e4b5352-9be1-43aa-84bf-137028da0802 req-0f72f1c3-a6c6-48fa-a73d-20182f1c5cd8 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5e4b5352-9be1-43aa-84bf-137028da0802 req-0f72f1c3-a6c6-48fa-a73d-20182f1c5cd8 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.compute.manager [req-5e4b5352-9be1-43aa-84bf-137028da0802 req-0f72f1c3-a6c6-48fa-a73d-20182f1c5cd8 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] No waiting events found dispatching network-vif-plugged-f8fdda48-16be-4318-a84d-79d50154eec0 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:26 user nova-compute[72504]: WARNING nova.compute.manager [req-5e4b5352-9be1-43aa-84bf-137028da0802 req-0f72f1c3-a6c6-48fa-a73d-20182f1c5cd8 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received unexpected event network-vif-plugged-f8fdda48-16be-4318-a84d-79d50154eec0 for instance with vm_state building and task_state spawning.
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.compute.manager [req-5e4b5352-9be1-43aa-84bf-137028da0802 req-0f72f1c3-a6c6-48fa-a73d-20182f1c5cd8 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-plugged-f8fdda48-16be-4318-a84d-79d50154eec0 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5e4b5352-9be1-43aa-84bf-137028da0802 req-0f72f1c3-a6c6-48fa-a73d-20182f1c5cd8 service nova] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5e4b5352-9be1-43aa-84bf-137028da0802 req-0f72f1c3-a6c6-48fa-a73d-20182f1c5cd8 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5e4b5352-9be1-43aa-84bf-137028da0802 req-0f72f1c3-a6c6-48fa-a73d-20182f1c5cd8 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.compute.manager [req-5e4b5352-9be1-43aa-84bf-137028da0802 req-0f72f1c3-a6c6-48fa-a73d-20182f1c5cd8 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] No waiting events found dispatching network-vif-plugged-f8fdda48-16be-4318-a84d-79d50154eec0 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:26 user nova-compute[72504]: WARNING nova.compute.manager [req-5e4b5352-9be1-43aa-84bf-137028da0802 req-0f72f1c3-a6c6-48fa-a73d-20182f1c5cd8 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received unexpected event network-vif-plugged-f8fdda48-16be-4318-a84d-79d50154eec0 for instance with vm_state building and task_state spawning.
Aug 01 19:51:26 user nova-compute[72504]: INFO nova.compute.manager [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Took 42.57 seconds to build instance.
Aug 01 19:51:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8c596194-99fa-46f9-8042-a4e3060a312e tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.668s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.network.neutron [req-15f33269-664d-47d9-82f9-6972a4cf7558 req-5a54728d-a919-46cf-99a8-fc506ea2e212 service nova] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Updated VIF entry in instance network info cache for port 5ecd0d2b-2f55-49b1-8858-3ab96e942b4f. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.network.neutron [req-15f33269-664d-47d9-82f9-6972a4cf7558 req-5a54728d-a919-46cf-99a8-fc506ea2e212 service nova] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Updating instance_info_cache with network_info: [{"id": "5ecd0d2b-2f55-49b1-8858-3ab96e942b4f", "address": "fa:16:3e:45:cb:79", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ecd0d2b-2f", "ovs_interfaceid": "5ecd0d2b-2f55-49b1-8858-3ab96e942b4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-15f33269-664d-47d9-82f9-6972a4cf7558 req-5a54728d-a919-46cf-99a8-fc506ea2e212 service nova] Releasing lock "refresh_cache-1de87977-532f-45f7-856b-84df41b2a567" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.network.neutron [req-30c71b1d-354f-46d8-aad7-e7b7da583631 req-a0a6c27b-b77d-4d27-ba1c-206d2ea0cd38 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Updated VIF entry in instance network info cache for port 2edbeaad-cd66-4a79-9fae-544f2a33e922. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG nova.network.neutron [req-30c71b1d-354f-46d8-aad7-e7b7da583631 req-a0a6c27b-b77d-4d27-ba1c-206d2ea0cd38 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Updating instance_info_cache with network_info: [{"id": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "address": "fa:16:3e:a8:fa:27", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2edbeaad-cd", "ovs_interfaceid": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:51:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-30c71b1d-354f-46d8-aad7-e7b7da583631 req-a0a6c27b-b77d-4d27-ba1c-206d2ea0cd38 service nova] Releasing lock "refresh_cache-76aa3861-0ca1-4e7f-9a15-9219037bc1ee" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:51:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:30 user nova-compute[72504]: INFO nova.compute.manager [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Shelving
Aug 01 19:51:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:30 user nova-compute[72504]: DEBUG nova.compute.manager [req-901c6fac-dc1b-49d8-996e-26423370a2c8 req-ce070c06-4a55-4e91-a917-bdacf5564fa5 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Received event network-vif-unplugged-2edbeaad-cd66-4a79-9fae-544f2a33e922 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-901c6fac-dc1b-49d8-996e-26423370a2c8 req-ce070c06-4a55-4e91-a917-bdacf5564fa5 service nova] Acquiring lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-901c6fac-dc1b-49d8-996e-26423370a2c8 req-ce070c06-4a55-4e91-a917-bdacf5564fa5 service nova] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-901c6fac-dc1b-49d8-996e-26423370a2c8 req-ce070c06-4a55-4e91-a917-bdacf5564fa5 service nova] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:30 user nova-compute[72504]: DEBUG nova.compute.manager [req-901c6fac-dc1b-49d8-996e-26423370a2c8 req-ce070c06-4a55-4e91-a917-bdacf5564fa5 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] No waiting events found dispatching network-vif-unplugged-2edbeaad-cd66-4a79-9fae-544f2a33e922 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:30 user nova-compute[72504]: WARNING nova.compute.manager [req-901c6fac-dc1b-49d8-996e-26423370a2c8 req-ce070c06-4a55-4e91-a917-bdacf5564fa5 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Received unexpected event network-vif-unplugged-2edbeaad-cd66-4a79-9fae-544f2a33e922 for instance with vm_state active and task_state shelving.
Aug 01 19:51:30 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Instance destroyed successfully.
Aug 01 19:51:31 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Beginning cold snapshot process
Aug 01 19:51:31 user nova-compute[72504]: DEBUG nova.privsep.utils [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72504) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 19:51:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk /opt/stack/data/nova/instances/snapshots/tmpkf6ke60g/8ebdba9e94a64b4eb0940533034b0327 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk /opt/stack/data/nova/instances/snapshots/tmpkf6ke60g/8ebdba9e94a64b4eb0940533034b0327" returned: 0 in 0.688s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:31 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Snapshot extracted, beginning image upload
Aug 01 19:51:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:32 user nova-compute[72504]: DEBUG nova.compute.manager [req-bd19792d-aaca-4e1b-b66c-6271aebb4cac req-e285865b-1fe7-40b5-99df-c41284a1adae service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Received event network-vif-plugged-2edbeaad-cd66-4a79-9fae-544f2a33e922 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-bd19792d-aaca-4e1b-b66c-6271aebb4cac req-e285865b-1fe7-40b5-99df-c41284a1adae service nova] Acquiring lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-bd19792d-aaca-4e1b-b66c-6271aebb4cac req-e285865b-1fe7-40b5-99df-c41284a1adae service nova] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-bd19792d-aaca-4e1b-b66c-6271aebb4cac req-e285865b-1fe7-40b5-99df-c41284a1adae service nova] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:32 user nova-compute[72504]: DEBUG nova.compute.manager [req-bd19792d-aaca-4e1b-b66c-6271aebb4cac req-e285865b-1fe7-40b5-99df-c41284a1adae service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] No waiting events found dispatching network-vif-plugged-2edbeaad-cd66-4a79-9fae-544f2a33e922 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:32 user nova-compute[72504]: WARNING nova.compute.manager [req-bd19792d-aaca-4e1b-b66c-6271aebb4cac req-e285865b-1fe7-40b5-99df-c41284a1adae service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Received unexpected event network-vif-plugged-2edbeaad-cd66-4a79-9fae-544f2a33e922 for instance with vm_state active and task_state shelving_image_uploading.
Aug 01 19:51:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oIGcHiKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:51:33 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:51:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:51:33 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:51:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:51:33 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[964a4403-6210-4e78-807b-37e981381638]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:51:33 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cf5531-0fc8-4adb-9f22-ab2bf6c1ebf9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25] added
Aug 01 19:51:33 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d879eba-ddb3-4988-9d47-966d9b19bc84]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[15757733-57e0-48c4-ae29-4d1b78030bfb]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oIGcHiKy {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oIGcHiKy" returned: 0 in 0.032s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95fc3c1-40b6-4bcc-b582-054b7798d4d2]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oIGcHiKy'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfe5a36-7bb2-42ec-b61e-605a60c41f8f]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c3aa9f-8fbf-4191-94f0-e3bec909c919]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:33 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:33 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:33 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:33 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:33 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:33 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[544852a5-76a8-4963-873b-475c8a9d2214]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25, portal: 172.16.0.220,3260]
Aug 01 19:51:33 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25, portal: 172.16.0.220,3260] successful.
Aug 01 19:51:33 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3da5fc-9f95-4dce-9510-124a3eeff167]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda96c8b-c438-4e3a-b3ff-f7e9f3c23eef]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:33 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:33 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:33 user nova-compute[72504]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25 (non-flash)
Aug 01 19:51:33 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:33 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:33 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:33 user nova-compute[72504]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25 (non-flash)
Aug 01 19:51:33 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c1396b-4c37-4754-879a-70afa4a2410d]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:51:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oIGcHiKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "1de87977-532f-45f7-856b-84df41b2a567" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "1de87977-532f-45f7-856b-84df41b2a567" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG nova.objects.instance [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lazy-loading 'flavor' on Instance uuid 1de87977-532f-45f7-856b-84df41b2a567 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "1de87977-532f-45f7-856b-84df41b2a567" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "1de87977-532f-45f7-856b-84df41b2a567" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "1de87977-532f-45f7-856b-84df41b2a567" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:34 user nova-compute[72504]: INFO nova.compute.manager [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Attaching volume 7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d to /dev/vdb
Aug 01 19:51:34 user nova-compute[72504]: DEBUG os_brick.utils [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a618fe5-e914-4d6e-b960-d785f5015c79]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3664ce-307d-4f82-b718-897a509a80a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2e7652-2543-4334-9638-303d1e46ad41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabe6eb3-1abd-4c08-9c9c-e8be9328ec8b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:51:34 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:51:34 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[968bebc6-bcde-42a6-b0e5-f05b8f552fbf]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG os_brick.utils [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Updating existing volume attachment record: 4acaa9ea-76b7-412b-9a45-167f9882bc2c {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:51:34 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Snapshot image upload complete
Aug 01 19:51:34 user nova-compute[72504]: DEBUG nova.compute.manager [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:51:34 user nova-compute[72504]: INFO nova.compute.manager [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Shelve offloading
Aug 01 19:51:34 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Instance destroyed successfully.
Aug 01 19:51:34 user nova-compute[72504]: DEBUG nova.compute.manager [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "refresh_cache-76aa3861-0ca1-4e7f-9a15-9219037bc1ee" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquired lock "refresh_cache-76aa3861-0ca1-4e7f-9a15-9219037bc1ee" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG nova.network.neutron [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26162333735366232', 'path': '/dev/sde'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162333735366232', 'path': '/dev/sde'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:51:34 user nova-compute[72504]: DEBUG nova.objects.instance [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lazy-loading 'flavor' on Instance uuid 8eae5ffe-ab54-4dac-8169-69325448b92f {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:51:35 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 19:51:35 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:51:35 user nova-compute[72504]:   <source dev="/dev/sde"/>
Aug 01 19:51:35 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:51:35 user nova-compute[72504]:   <serial>fbb512c5-d581-4a9f-b93e-65e4fc1eff25</serial>
Aug 01 19:51:35 user nova-compute[72504]: </disk>
Aug 01 19:51:35 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 19:51:35 user nova-compute[72504]: DEBUG nova.network.neutron [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Updating instance_info_cache with network_info: [{"id": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "address": "fa:16:3e:a8:fa:27", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2edbeaad-cd", "ovs_interfaceid": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:51:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Releasing lock "refresh_cache-76aa3861-0ca1-4e7f-9a15-9219037bc1ee" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:51:35 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:51:35 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:51:35 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] No VIF found with MAC fa:16:3e:8d:56:4a, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:51:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-78332a67-20dd-4a08-ba68-b6e270fc4fdb tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lock "8eae5ffe-ab54-4dac-8169-69325448b92f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.866s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:35 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Instance destroyed successfully.
Aug 01 19:51:35 user nova-compute[72504]: DEBUG nova.objects.instance [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lazy-loading 'resources' on Instance uuid 76aa3861-0ca1-4e7f-9a15-9219037bc1ee {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1959455272',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1959455272',id=4,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsHS4HasDUoe/iSAkXERl/kuVlkQf10MtX0I95kJDd3Cs0+i0zXsqFDo40azmo6oaI1FB+bIS0tTfcjcH/OnHpg7QjuwLDWmbTaGvKjolNfCML3G3Z8TuOgsM21xi2xRg==',key_name='tempest-keypair-1467874797',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:49:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='da04aaa8143b44d5aa21f59a89cd57ee',ramdisk_id='',reservation_id='r-5nw6f64r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-836718209',owner_user_name='tempest-AttachVolumeShelveTestJSON-836718209-project-member',shelved_at='2023-08-01T19:51:34.750039',shelved_host='user',shelved_image_id='ea371bc6-8609-46a0-8872-1a045bf33672'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:51:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6260679430fa4828b07bc890c62878c3',uuid=76aa3861-0ca1-4e7f-9a15-9219037bc1ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "address": "fa:16:3e:a8:fa:27", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2edbeaad-cd", "ovs_interfaceid": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Converting VIF {"id": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "address": "fa:16:3e:a8:fa:27", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2edbeaad-cd", "ovs_interfaceid": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fa:27,bridge_name='br-int',has_traffic_filtering=True,id=2edbeaad-cd66-4a79-9fae-544f2a33e922,network=Network(40b3d49e-3592-411a-93d6-5a44019ef136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2edbeaad-cd') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG os_vif [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fa:27,bridge_name='br-int',has_traffic_filtering=True,id=2edbeaad-cd66-4a79-9fae-544f2a33e922,network=Network(40b3d49e-3592-411a-93d6-5a44019ef136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2edbeaad-cd') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG nova.compute.manager [req-a66db2b4-30b8-45d7-8872-6d11fb1e268e req-4f057ccb-ea7e-4a3b-8d24-a721b691aa01 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Received event network-changed-2edbeaad-cd66-4a79-9fae-544f2a33e922 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG nova.compute.manager [req-a66db2b4-30b8-45d7-8872-6d11fb1e268e req-4f057ccb-ea7e-4a3b-8d24-a721b691aa01 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Refreshing instance network info cache due to event network-changed-2edbeaad-cd66-4a79-9fae-544f2a33e922. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a66db2b4-30b8-45d7-8872-6d11fb1e268e req-4f057ccb-ea7e-4a3b-8d24-a721b691aa01 service nova] Acquiring lock "refresh_cache-76aa3861-0ca1-4e7f-9a15-9219037bc1ee" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a66db2b4-30b8-45d7-8872-6d11fb1e268e req-4f057ccb-ea7e-4a3b-8d24-a721b691aa01 service nova] Acquired lock "refresh_cache-76aa3861-0ca1-4e7f-9a15-9219037bc1ee" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG nova.network.neutron [req-a66db2b4-30b8-45d7-8872-6d11fb1e268e req-4f057ccb-ea7e-4a3b-8d24-a721b691aa01 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Refreshing network info cache for port 2edbeaad-cd66-4a79-9fae-544f2a33e922 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2edbeaad-cd, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:51:36 user nova-compute[72504]: INFO os_vif [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fa:27,bridge_name='br-int',has_traffic_filtering=True,id=2edbeaad-cd66-4a79-9fae-544f2a33e922,network=Network(40b3d49e-3592-411a-93d6-5a44019ef136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2edbeaad-cd')
Aug 01 19:51:36 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Deleting instance files /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee_del
Aug 01 19:51:36 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Deletion of /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee_del complete
Aug 01 19:51:36 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Deleted allocations for instance 76aa3861-0ca1-4e7f-9a15-9219037bc1ee
Aug 01 19:51:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG nova.objects.instance [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lazy-loading 'numa_topology' on Instance uuid 76aa3861-0ca1-4e7f-9a15-9219037bc1ee {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG nova.network.neutron [req-a66db2b4-30b8-45d7-8872-6d11fb1e268e req-4f057ccb-ea7e-4a3b-8d24-a721b691aa01 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Updated VIF entry in instance network info cache for port 2edbeaad-cd66-4a79-9fae-544f2a33e922. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG nova.network.neutron [req-a66db2b4-30b8-45d7-8872-6d11fb1e268e req-4f057ccb-ea7e-4a3b-8d24-a721b691aa01 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Updating instance_info_cache with network_info: [{"id": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "address": "fa:16:3e:a8:fa:27", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap2edbeaad-cd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a66db2b4-30b8-45d7-8872-6d11fb1e268e req-4f057ccb-ea7e-4a3b-8d24-a721b691aa01 service nova] Releasing lock "refresh_cache-76aa3861-0ca1-4e7f-9a15-9219037bc1ee" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-15b05ad0-3c95-43e0-b49d-21b0eaa22a3f tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.356s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Acquiring lock "8eae5ffe-ab54-4dac-8169-69325448b92f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lock "8eae5ffe-ab54-4dac-8169-69325448b92f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Acquiring lock "8eae5ffe-ab54-4dac-8169-69325448b92f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lock "8eae5ffe-ab54-4dac-8169-69325448b92f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lock "8eae5ffe-ab54-4dac-8169-69325448b92f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:36 user nova-compute[72504]: INFO nova.compute.manager [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Terminating instance
Aug 01 19:51:36 user nova-compute[72504]: DEBUG nova.compute.manager [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG nova.compute.manager [req-40394770-4137-497d-bf7a-174aa77e78d8 req-add2369b-56e3-4f5c-911c-e242c3f32406 service nova] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Received event network-vif-unplugged-81de2627-8b32-47dc-ba79-56afa5d60500 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-40394770-4137-497d-bf7a-174aa77e78d8 req-add2369b-56e3-4f5c-911c-e242c3f32406 service nova] Acquiring lock "8eae5ffe-ab54-4dac-8169-69325448b92f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-40394770-4137-497d-bf7a-174aa77e78d8 req-add2369b-56e3-4f5c-911c-e242c3f32406 service nova] Lock "8eae5ffe-ab54-4dac-8169-69325448b92f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-40394770-4137-497d-bf7a-174aa77e78d8 req-add2369b-56e3-4f5c-911c-e242c3f32406 service nova] Lock "8eae5ffe-ab54-4dac-8169-69325448b92f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG nova.compute.manager [req-40394770-4137-497d-bf7a-174aa77e78d8 req-add2369b-56e3-4f5c-911c-e242c3f32406 service nova] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] No waiting events found dispatching network-vif-unplugged-81de2627-8b32-47dc-ba79-56afa5d60500 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG nova.compute.manager [req-40394770-4137-497d-bf7a-174aa77e78d8 req-add2369b-56e3-4f5c-911c-e242c3f32406 service nova] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Received event network-vif-unplugged-81de2627-8b32-47dc-ba79-56afa5d60500 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:37 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Instance destroyed successfully.
Aug 01 19:51:37 user nova-compute[72504]: DEBUG nova.objects.instance [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lazy-loading 'resources' on Instance uuid 8eae5ffe-ab54-4dac-8169-69325448b92f {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1316361796',display_name='tempest-DeleteServersTestJSON-server-1316361796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1316361796',id=1,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:49:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2371740586fa42249a5299af53448e5a',ramdisk_id='',reservation_id='r-25eer93s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1074648156',owner_user_name='tempest-DeleteServersTestJSON-1074648156-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:49:45Z,user_data=None,user_id='0a266d46b9d84e1ab0385ddf2d4b0b6f',uuid=8eae5ffe-ab54-4dac-8169-69325448b92f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81de2627-8b32-47dc-ba79-56afa5d60500", "address": "fa:16:3e:8d:56:4a", "network": {"id": "e40d9428-7acd-446e-ae33-f0da22181354", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1238785586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2371740586fa42249a5299af53448e5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81de2627-8b", "ovs_interfaceid": "81de2627-8b32-47dc-ba79-56afa5d60500", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Converting VIF {"id": "81de2627-8b32-47dc-ba79-56afa5d60500", "address": "fa:16:3e:8d:56:4a", "network": {"id": "e40d9428-7acd-446e-ae33-f0da22181354", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1238785586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2371740586fa42249a5299af53448e5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81de2627-8b", "ovs_interfaceid": "81de2627-8b32-47dc-ba79-56afa5d60500", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:56:4a,bridge_name='br-int',has_traffic_filtering=True,id=81de2627-8b32-47dc-ba79-56afa5d60500,network=Network(e40d9428-7acd-446e-ae33-f0da22181354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81de2627-8b') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG os_vif [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:56:4a,bridge_name='br-int',has_traffic_filtering=True,id=81de2627-8b32-47dc-ba79-56afa5d60500,network=Network(e40d9428-7acd-446e-ae33-f0da22181354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81de2627-8b') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81de2627-8b, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:51:37 user nova-compute[72504]: INFO os_vif [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:56:4a,bridge_name='br-int',has_traffic_filtering=True,id=81de2627-8b32-47dc-ba79-56afa5d60500,network=Network(e40d9428-7acd-446e-ae33-f0da22181354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81de2627-8b')
Aug 01 19:51:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oIGcHiKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:51:37 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:51:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf96e21-5b26-4ac7-81fc-96df78c292a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f3be70-4dcd-4980-b13b-027fea638181]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:37 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:37 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:37 user nova-compute[72504]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25 (non-flash)
Aug 01 19:51:37 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:37 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:37 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:37 user nova-compute[72504]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25 (non-flash)
Aug 01 19:51:37 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff40c348f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25'): ({'sde'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Removing single pathed devices sde {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:37 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b3b36e-9960-4e0e-8740-c555c974cc09]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.075s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0313ac81-6759-434d-a8d1-ca295566ef85]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Flushing IO for device /dev/sde {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b29d722-5e98-4926-a3fa-fc225a82dff1]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.093s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[decdcedb-43a2-4a6c-9c87-2d76047b3373]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] SCSI volumes sde have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf7474b-fe03-4482-9ac9-204397a90086]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd598941-9dd4-4abe-a4ca-6c5bad7212d6]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25, portal: 172.16.0.220,3260]
Aug 01 19:51:38 user nova-compute[72504]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25, portal: 172.16.0.220,3260] successful.
Aug 01 19:51:38 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb512c5-d581-4a9f-b93e-65e4fc1eff25 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae761ff4-6dc7-421d-9fc7-3d1146dc16a0]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.661s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] <== disconnect_volume: return (663ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:51:38 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Deleting instance files /opt/stack/data/nova/instances/8eae5ffe-ab54-4dac-8169-69325448b92f_del
Aug 01 19:51:38 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Deletion of /opt/stack/data/nova/instances/8eae5ffe-ab54-4dac-8169-69325448b92f_del complete
Aug 01 19:51:38 user nova-compute[72504]: INFO nova.compute.manager [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Took 1.58 seconds to destroy the instance on the hypervisor.
Aug 01 19:51:38 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG nova.compute.manager [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:51:38 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Creating image(s)
Aug 01 19:51:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Did not create local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Ensure instance console log exists: /opt/stack/data/nova/instances/85816260-b37b-4b9e-9b52-f823120645aa/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Start _get_guest_xml network_info=[{"id": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "address": "fa:16:3e:c2:7b:99", "network": {"id": "9ccd7c4b-5d10-4ec8-9f00-f4b269b82d04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1560588778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1898db0f-13", "ovs_interfaceid": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "address": "fa:16:3e:71:06:4f", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d17a5cc-0f", "ovs_interfaceid": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "address": "fa:16:3e:52:80:5a", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769dacee-eb", "ovs_interfaceid": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a5b6139-7885-46c7-9210-676227003327", "address": "fa:16:3e:84:ab:7b", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a5b6139-78", "ovs_interfaceid": "4a5b6139-7885-46c7-9210-676227003327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4fc53eb7-bc35-49cd-af26-52ec96aa2008", "address": "fa:16:3e:ee:80:d5", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc53eb7-bc", "ovs_interfaceid": "4fc53eb7-bc35-49cd-af26-52ec96aa2008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "022ea9fb-47cd-4a25-8217-4dd5f379b522", "address": "fa:16:3e:79:55:d8", "network": {"id": "749ff417-d2f9-4311-b2f7-bbdf0cfd37a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-178411316", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022ea9fb-47", "ovs_interfaceid": "022ea9fb-47cd-4a25-8217-4dd5f379b522", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "address": "fa:16:3e:2a:6f:04", "network": {"id": "749ff417-d2f9-4311-b2f7-bbdf0cfd37a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-178411316", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd0b585f-55", "ovs_interfaceid": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTxOgwEu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '85816260-b37b-4b9e-9b52-f823120645aa', 'attached_at': '', 'detached_at': '', 'volume_id': 'f573b520-1dce-4ba8-b09f-7234510e28f4', 'serial': 'f573b520-1dce-4ba8-b09f-7234510e28f4'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': '2ee5cc62-77cf-4499-83f0-d599f8cf392a', 'volume_type': None}, {'device_type': 'disk', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QusanyjN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '85816260-b37b-4b9e-9b52-f823120645aa', 'attached_at': '', 'detached_at': '', 'volume_id': '2593357d-b560-4929-b260-d3ae1c633315', 'serial': '2593357d-b560-4929-b260-d3ae1c633315'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': '16891e21-7ad4-4aee-9ec7-6ef5c569cf66', 'volume_type': None}, {'device_type': 'disk', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BdQpAIvM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '85816260-b37b-4b9e-9b52-f823120645aa', 'attached_at': '', 'detached_at': '', 'volume_id': '2ef687e5-d914-480f-824a-371a3117d9d2', 'serial': '2ef687e5-d914-480f-824a-371a3117d9d2'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'attachment_id': '52e2fe41-2db6-4712-873e-6cd660c133fb', 'volume_type': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:51:38 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:51:38 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:51:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:51:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTxOgwEu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:51:39 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:51:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:51:39 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:51:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:51:39 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:51:39 user nova-compute[72504]: DEBUG nova.compute.manager [req-0bd1cef9-0fc0-495a-a808-ac0d3ec8c040 req-27b8ee61-7181-4536-ae76-0932585e21ec service nova] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Received event network-vif-deleted-81de2627-8b32-47dc-ba79-56afa5d60500 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:39 user nova-compute[72504]: INFO nova.compute.manager [req-0bd1cef9-0fc0-495a-a808-ac0d3ec8c040 req-27b8ee61-7181-4536-ae76-0932585e21ec service nova] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Neutron deleted interface 81de2627-8b32-47dc-ba79-56afa5d60500; detaching it from the instance and deleting it from the info cache
Aug 01 19:51:39 user nova-compute[72504]: DEBUG nova.network.neutron [req-0bd1cef9-0fc0-495a-a808-ac0d3ec8c040 req-27b8ee61-7181-4536-ae76-0932585e21ec service nova] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG nova.compute.manager [req-6b90c8cc-c3f7-4d90-b6d2-ea9635c28e7d req-57460a24-95aa-4ec0-b428-ef5444c090f0 service nova] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Received event network-vif-plugged-81de2627-8b32-47dc-ba79-56afa5d60500 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6b90c8cc-c3f7-4d90-b6d2-ea9635c28e7d req-57460a24-95aa-4ec0-b428-ef5444c090f0 service nova] Acquiring lock "8eae5ffe-ab54-4dac-8169-69325448b92f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6b90c8cc-c3f7-4d90-b6d2-ea9635c28e7d req-57460a24-95aa-4ec0-b428-ef5444c090f0 service nova] Lock "8eae5ffe-ab54-4dac-8169-69325448b92f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6b90c8cc-c3f7-4d90-b6d2-ea9635c28e7d req-57460a24-95aa-4ec0-b428-ef5444c090f0 service nova] Lock "8eae5ffe-ab54-4dac-8169-69325448b92f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG nova.compute.manager [req-6b90c8cc-c3f7-4d90-b6d2-ea9635c28e7d req-57460a24-95aa-4ec0-b428-ef5444c090f0 service nova] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] No waiting events found dispatching network-vif-plugged-81de2627-8b32-47dc-ba79-56afa5d60500 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:39 user nova-compute[72504]: WARNING nova.compute.manager [req-6b90c8cc-c3f7-4d90-b6d2-ea9635c28e7d req-57460a24-95aa-4ec0-b428-ef5444c090f0 service nova] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Received unexpected event network-vif-plugged-81de2627-8b32-47dc-ba79-56afa5d60500 for instance with vm_state active and task_state deleting.
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a037e1-5d95-4d27-a49b-fb9f1e6d16bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:51:39 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG nova.compute.manager [req-0bd1cef9-0fc0-495a-a808-ac0d3ec8c040 req-27b8ee61-7181-4536-ae76-0932585e21ec service nova] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Detach interface failed, port_id=81de2627-8b32-47dc-ba79-56afa5d60500, reason: Instance 8eae5ffe-ab54-4dac-8169-69325448b92f could not be found. {{(pid=72504) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05b74f2-dd3d-4d52-8dc8-984a9a564007]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4] added
Aug 01 19:51:39 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:39 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Took 0.93 seconds to deallocate network for instance.
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[14626cad-40df-45b5-bee6-1a18f77e112a]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ba3b43-0186-4d8a-846c-4b49ebffa80e]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hTxOgwEu {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hTxOgwEu" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[513c48af-3998-4dad-b0bc-b73a6590874b]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hTxOgwEu'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4eff4a8-6fea-4da8-a4c5-599553c948b5]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc93b601-2265-47e6-a618-aef7b6d274ac]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:39 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:39 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:39 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:39 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:39 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:39 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb654db-c7e0-43e5-a0b2-cdbb7bf2b379]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4, portal: 172.16.0.220,3260]
Aug 01 19:51:39 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4, portal: 172.16.0.220,3260] successful.
Aug 01 19:51:39 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb02ee45-aa6f-4ebe-a9e0-60fbe112248a]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f886f88f-de59-460a-ab96-ac2ee5209c6c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:39 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:39 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:39 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:51:39 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:39 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:39 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:39 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:51:39 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bc95b8-c724-459b-80ed-c68909b62b85]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:51:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTxOgwEu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:51:40 user nova-compute[72504]: INFO nova.compute.manager [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Took 1.00 seconds to detach 1 volumes for instance.
Aug 01 19:51:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26639663432383339', 'path': '/dev/sde'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639663432383339', 'path': '/dev/sde'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QusanyjN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:51:40 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:51:40 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:51:40 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:51:40 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:51:40 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:51:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9696574-14d2-44ba-92d4-f61789d41071]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:51:40 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.040s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea263f0-805e-4257-a426-807b9d7733f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315] added
Aug 01 19:51:40 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51b87bb-b23f-4fb9-b8c5-45e7902ad829]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.075s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f08cb0-6f2e-4c00-af73-b7edbc8107a1]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QusanyjN {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:40 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Deleted allocations for instance 8eae5ffe-ab54-4dac-8169-69325448b92f
Aug 01 19:51:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QusanyjN" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c7b0bc-b907-4fb1-b469-b000fa69c7c1]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QusanyjN'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba578d4-6453-4d42-800f-4842d597c7cb]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a92dad4-482c-429e-a5f4-5514abacce2d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:40 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:40 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:40 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:51:40 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:40 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:40 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:40 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:51:40 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cb44c134-2915-4cf2-a7b8-a2481e6615d7 tempest-DeleteServersTestJSON-1074648156 tempest-DeleteServersTestJSON-1074648156-project-member] Lock "8eae5ffe-ab54-4dac-8169-69325448b92f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.203s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece655fa-9bbc-450f-b9ca-7d914d56e3aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315, portal: 172.16.0.220,3260]
Aug 01 19:51:41 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315, portal: 172.16.0.220,3260] successful.
Aug 01 19:51:41 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23bc253-5953-43b9-b826-723dc2856dc6]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c897d10-08ca-433c-902a-61dfc4889d69]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:41 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:41 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:41 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:51:41 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:51:41 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:51:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:41 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:41 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:41 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:51:41 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:51:41 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:51:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.425s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:51:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:51:41 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:51:41 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:51:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b150ec75-33e4-4af5-9f7b-c40c5460d057]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:41 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: None {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:51:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-d708875b-80d4-4418-b98b-316deec1a832 req-2a30ecd1-0d73-402d-979d-ca195501b169 service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Received event network-changed-6698435e-de04-4c41-8f14-356dd152aa0d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-d708875b-80d4-4418-b98b-316deec1a832 req-2a30ecd1-0d73-402d-979d-ca195501b169 service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Refreshing instance network info cache due to event network-changed-6698435e-de04-4c41-8f14-356dd152aa0d. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:51:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d708875b-80d4-4418-b98b-316deec1a832 req-2a30ecd1-0d73-402d-979d-ca195501b169 service nova] Acquiring lock "refresh_cache-a8966321-946f-4988-83f5-c71cabb1c094" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:51:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d708875b-80d4-4418-b98b-316deec1a832 req-2a30ecd1-0d73-402d-979d-ca195501b169 service nova] Acquired lock "refresh_cache-a8966321-946f-4988-83f5-c71cabb1c094" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:51:41 user nova-compute[72504]: DEBUG nova.network.neutron [req-d708875b-80d4-4418-b98b-316deec1a832 req-2a30ecd1-0d73-402d-979d-ca195501b169 service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Refreshing network info cache for port 6698435e-de04-4c41-8f14-356dd152aa0d {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QusanyjN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.455s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] <== connect_volume: return (1457ms) {'type': 'block', 'scsi_wwn': '23035363265653739', 'path': '/dev/sdf'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035363265653739', 'path': '/dev/sdf'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BdQpAIvM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:51:42 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:51:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:51:42 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:51:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:51:42 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG nova.network.neutron [req-d708875b-80d4-4418-b98b-316deec1a832 req-2a30ecd1-0d73-402d-979d-ca195501b169 service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Updated VIF entry in instance network info cache for port 6698435e-de04-4c41-8f14-356dd152aa0d. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG nova.network.neutron [req-d708875b-80d4-4418-b98b-316deec1a832 req-2a30ecd1-0d73-402d-979d-ca195501b169 service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Updating instance_info_cache with network_info: [{"id": "6698435e-de04-4c41-8f14-356dd152aa0d", "address": "fa:16:3e:bd:89:6b", "network": {"id": "4c56cdef-5441-46f2-abda-780f3573ccaf", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1603717847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4f8a671a5994b72a02f99185c5838cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6698435e-de", "ovs_interfaceid": "6698435e-de04-4c41-8f14-356dd152aa0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e0399a-062c-4715-abb7-841a5e255632]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:51:42 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d708875b-80d4-4418-b98b-316deec1a832 req-2a30ecd1-0d73-402d-979d-ca195501b169 service nova] Releasing lock "refresh_cache-a8966321-946f-4988-83f5-c71cabb1c094" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd95ddfc-2b14-4d51-a1a6-40133270a4d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2] added
Aug 01 19:51:42 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[78658267-5391-4056-bebf-fafa1fd86eff]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[85327f22-00ac-472a-b72a-1e3db436086a]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BdQpAIvM {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BdQpAIvM" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba983a21-e28b-41ac-98b1-9b1ad7bd7d4d]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BdQpAIvM'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4825f67-2532-46bc-acae-f22de25d5230]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c8653b-205c-4577-b760-30f43afbff44]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:42 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:42 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:42 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:51:42 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:51:42 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:42 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:42 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:42 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:51:42 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:51:42 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[868a6ae3-f6f5-451f-a705-5af654bd21bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2, portal: 172.16.0.220,3260]
Aug 01 19:51:42 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2, portal: 172.16.0.220,3260] successful.
Aug 01 19:51:42 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[61086f2e-c7ae-470c-afb4-5d60d8891a55]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe82eb91-5fba-44ec-8843-e3432d629a3a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:42 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:42 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:42 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:51:42 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:51:42 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:51:42 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:42 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:42 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:42 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:51:42 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:51:42 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:51:42 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdc250b-8cc9-4742-a08d-18b5c9880045]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BdQpAIvM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG nova.compute.manager [req-2d792494-39d7-4792-8fbe-9a0a217c1e44 req-81300dc5-bd44-4e11-af86-64c4a0aff7c4 service nova] [instance: 561928fb-3c41-4937-8050-9125614c0641] Received event network-changed-f0a2194f-e3b8-48c4-9157-a35a3f66165b {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG nova.compute.manager [req-2d792494-39d7-4792-8fbe-9a0a217c1e44 req-81300dc5-bd44-4e11-af86-64c4a0aff7c4 service nova] [instance: 561928fb-3c41-4937-8050-9125614c0641] Refreshing instance network info cache due to event network-changed-f0a2194f-e3b8-48c4-9157-a35a3f66165b. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2d792494-39d7-4792-8fbe-9a0a217c1e44 req-81300dc5-bd44-4e11-af86-64c4a0aff7c4 service nova] Acquiring lock "refresh_cache-561928fb-3c41-4937-8050-9125614c0641" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2d792494-39d7-4792-8fbe-9a0a217c1e44 req-81300dc5-bd44-4e11-af86-64c4a0aff7c4 service nova] Acquired lock "refresh_cache-561928fb-3c41-4937-8050-9125614c0641" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:51:42 user nova-compute[72504]: DEBUG nova.network.neutron [req-2d792494-39d7-4792-8fbe-9a0a217c1e44 req-81300dc5-bd44-4e11-af86-64c4a0aff7c4 service nova] [instance: 561928fb-3c41-4937-8050-9125614c0641] Refreshing network info cache for port f0a2194f-e3b8-48c4-9157-a35a3f66165b {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Acquiring lock "561928fb-3c41-4937-8050-9125614c0641" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lock "561928fb-3c41-4937-8050-9125614c0641" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.objects.instance [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lazy-loading 'flavor' on Instance uuid 561928fb-3c41-4937-8050-9125614c0641 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '26534313837366532', 'path': '/dev/sdg'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534313837366532', 'path': '/dev/sdg'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.network.neutron [req-2d792494-39d7-4792-8fbe-9a0a217c1e44 req-81300dc5-bd44-4e11-af86-64c4a0aff7c4 service nova] [instance: 561928fb-3c41-4937-8050-9125614c0641] Updated VIF entry in instance network info cache for port f0a2194f-e3b8-48c4-9157-a35a3f66165b. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.network.neutron [req-2d792494-39d7-4792-8fbe-9a0a217c1e44 req-81300dc5-bd44-4e11-af86-64c4a0aff7c4 service nova] [instance: 561928fb-3c41-4937-8050-9125614c0641] Updating instance_info_cache with network_info: [{"id": "f0a2194f-e3b8-48c4-9157-a35a3f66165b", "address": "fa:16:3e:dc:6f:47", "network": {"id": "40216131-7be3-423d-84ca-9d603526db4b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1648510237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50a77655071466db7143ff1850d3272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a2194f-e3", "ovs_interfaceid": "f0a2194f-e3b8-48c4-9157-a35a3f66165b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lock "561928fb-3c41-4937-8050-9125614c0641" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.441s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957777004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-957777004',id=10,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3fHv2po9fI8JWLJ/STotCC/ZMt1usNvDJY9OhHFX37UU3G4ImUWgVManPneIT3OQbzL9S8YjwTKJ0753XHtgZTG443G0jU6eMV/ruR8/RM1GoV1Hc8J2PbUW4LxIr9KA==',key_name='tempest-keypair-1242269901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87a15b5dc83241d9a0bfd3df652e08a5',ramdisk_id='',reservation_id='r-har3d7vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1825089340',owner_user_name='tempest-TaggedBootDevicesTest_v242-1825089340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2947163cbc44c7b8e0d1a251ec2c906',uuid=85816260-b37b-4b9e-9b52-f823120645aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "address": "fa:16:3e:c2:7b:99", "network": {"id": "9ccd7c4b-5d10-4ec8-9f00-f4b269b82d04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1560588778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1898db0f-13", "ovs_interfaceid": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converting VIF {"id": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "address": "fa:16:3e:c2:7b:99", "network": {"id": "9ccd7c4b-5d10-4ec8-9f00-f4b269b82d04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1560588778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1898db0f-13", "ovs_interfaceid": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:7b:99,bridge_name='br-int',has_traffic_filtering=True,id=1898db0f-13d0-443c-a15f-bcb85039ecdd,network=Network(9ccd7c4b-5d10-4ec8-9f00-f4b269b82d04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1898db0f-13') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957777004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-957777004',id=10,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3fHv2po9fI8JWLJ/STotCC/ZMt1usNvDJY9OhHFX37UU3G4ImUWgVManPneIT3OQbzL9S8YjwTKJ0753XHtgZTG443G0jU6eMV/ruR8/RM1GoV1Hc8J2PbUW4LxIr9KA==',key_name='tempest-keypair-1242269901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87a15b5dc83241d9a0bfd3df652e08a5',ramdisk_id='',reservation_id='r-har3d7vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1825089340',owner_user_name='tempest-TaggedBootDevicesTest_v242-1825089340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2947163cbc44c7b8e0d1a251ec2c906',uuid=85816260-b37b-4b9e-9b52-f823120645aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "address": "fa:16:3e:71:06:4f", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d17a5cc-0f", "ovs_interfaceid": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converting VIF {"id": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "address": "fa:16:3e:71:06:4f", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d17a5cc-0f", "ovs_interfaceid": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:06:4f,bridge_name='br-int',has_traffic_filtering=True,id=4d17a5cc-0fda-4d09-9121-baab1fed85e8,network=Network(c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4d17a5cc-0f') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957777004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-957777004',id=10,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3fHv2po9fI8JWLJ/STotCC/ZMt1usNvDJY9OhHFX37UU3G4ImUWgVManPneIT3OQbzL9S8YjwTKJ0753XHtgZTG443G0jU6eMV/ruR8/RM1GoV1Hc8J2PbUW4LxIr9KA==',key_name='tempest-keypair-1242269901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87a15b5dc83241d9a0bfd3df652e08a5',ramdisk_id='',reservation_id='r-har3d7vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1825089340',owner_user_name='tempest-TaggedBootDevicesTest_v242-1825089340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2947163cbc44c7b8e0d1a251ec2c906',uuid=85816260-b37b-4b9e-9b52-f823120645aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "address": "fa:16:3e:52:80:5a", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769dacee-eb", "ovs_interfaceid": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converting VIF {"id": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "address": "fa:16:3e:52:80:5a", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769dacee-eb", "ovs_interfaceid": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:80:5a,bridge_name='br-int',has_traffic_filtering=True,id=769dacee-ebe9-47f8-994f-1d59b15e2a1b,network=Network(c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap769dacee-eb') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957777004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-957777004',id=10,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3fHv2po9fI8JWLJ/STotCC/ZMt1usNvDJY9OhHFX37UU3G4ImUWgVManPneIT3OQbzL9S8YjwTKJ0753XHtgZTG443G0jU6eMV/ruR8/RM1GoV1Hc8J2PbUW4LxIr9KA==',key_name='tempest-keypair-1242269901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87a15b5dc83241d9a0bfd3df652e08a5',ramdisk_id='',reservation_id='r-har3d7vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1825089340',owner_user_name='tempest-TaggedBootDevicesTest_v242-1825089340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2947163cbc44c7b8e0d1a251ec2c906',uuid=85816260-b37b-4b9e-9b52-f823120645aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a5b6139-7885-46c7-9210-676227003327", "address": "fa:16:3e:84:ab:7b", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a5b6139-78", "ovs_interfaceid": "4a5b6139-7885-46c7-9210-676227003327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converting VIF {"id": "4a5b6139-7885-46c7-9210-676227003327", "address": "fa:16:3e:84:ab:7b", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a5b6139-78", "ovs_interfaceid": "4a5b6139-7885-46c7-9210-676227003327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:ab:7b,bridge_name='br-int',has_traffic_filtering=True,id=4a5b6139-7885-46c7-9210-676227003327,network=Network(c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a5b6139-78') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957777004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-957777004',id=10,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3fHv2po9fI8JWLJ/STotCC/ZMt1usNvDJY9OhHFX37UU3G4ImUWgVManPneIT3OQbzL9S8YjwTKJ0753XHtgZTG443G0jU6eMV/ruR8/RM1GoV1Hc8J2PbUW4LxIr9KA==',key_name='tempest-keypair-1242269901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87a15b5dc83241d9a0bfd3df652e08a5',ramdisk_id='',reservation_id='r-har3d7vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1825089340',owner_user_name='tempest-TaggedBootDevicesTest_v242-1825089340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2947163cbc44c7b8e0d1a251ec2c906',uuid=85816260-b37b-4b9e-9b52-f823120645aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fc53eb7-bc35-49cd-af26-52ec96aa2008", "address": "fa:16:3e:ee:80:d5", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc53eb7-bc", "ovs_interfaceid": "4fc53eb7-bc35-49cd-af26-52ec96aa2008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converting VIF {"id": "4fc53eb7-bc35-49cd-af26-52ec96aa2008", "address": "fa:16:3e:ee:80:d5", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc53eb7-bc", "ovs_interfaceid": "4fc53eb7-bc35-49cd-af26-52ec96aa2008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:80:d5,bridge_name='br-int',has_traffic_filtering=True,id=4fc53eb7-bc35-49cd-af26-52ec96aa2008,network=Network(c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fc53eb7-bc') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957777004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-957777004',id=10,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3fHv2po9fI8JWLJ/STotCC/ZMt1usNvDJY9OhHFX37UU3G4ImUWgVManPneIT3OQbzL9S8YjwTKJ0753XHtgZTG443G0jU6eMV/ruR8/RM1GoV1Hc8J2PbUW4LxIr9KA==',key_name='tempest-keypair-1242269901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87a15b5dc83241d9a0bfd3df652e08a5',ramdisk_id='',reservation_id='r-har3d7vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1825089340',owner_user_name='tempest-TaggedBootDevicesTest_v242-1825089340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2947163cbc44c7b8e0d1a251ec2c906',uuid=85816260-b37b-4b9e-9b52-f823120645aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "022ea9fb-47cd-4a25-8217-4dd5f379b522", "address": "fa:16:3e:79:55:d8", "network": {"id": "749ff417-d2f9-4311-b2f7-bbdf0cfd37a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-178411316", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022ea9fb-47", "ovs_interfaceid": "022ea9fb-47cd-4a25-8217-4dd5f379b522", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converting VIF {"id": "022ea9fb-47cd-4a25-8217-4dd5f379b522", "address": "fa:16:3e:79:55:d8", "network": {"id": "749ff417-d2f9-4311-b2f7-bbdf0cfd37a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-178411316", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022ea9fb-47", "ovs_interfaceid": "022ea9fb-47cd-4a25-8217-4dd5f379b522", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:55:d8,bridge_name='br-int',has_traffic_filtering=True,id=022ea9fb-47cd-4a25-8217-4dd5f379b522,network=Network(749ff417-d2f9-4311-b2f7-bbdf0cfd37a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap022ea9fb-47') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957777004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-957777004',id=10,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3fHv2po9fI8JWLJ/STotCC/ZMt1usNvDJY9OhHFX37UU3G4ImUWgVManPneIT3OQbzL9S8YjwTKJ0753XHtgZTG443G0jU6eMV/ruR8/RM1GoV1Hc8J2PbUW4LxIr9KA==',key_name='tempest-keypair-1242269901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87a15b5dc83241d9a0bfd3df652e08a5',ramdisk_id='',reservation_id='r-har3d7vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1825089340',owner_user_name='tempest-TaggedBootDevicesTest_v242-1825089340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2947163cbc44c7b8e0d1a251ec2c906',uuid=85816260-b37b-4b9e-9b52-f823120645aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "address": "fa:16:3e:2a:6f:04", "network": {"id": "749ff417-d2f9-4311-b2f7-bbdf0cfd37a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-178411316", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd0b585f-55", "ovs_interfaceid": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converting VIF {"id": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "address": "fa:16:3e:2a:6f:04", "network": {"id": "749ff417-d2f9-4311-b2f7-bbdf0cfd37a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-178411316", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd0b585f-55", "ovs_interfaceid": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:6f:04,bridge_name='br-int',has_traffic_filtering=True,id=fd0b585f-558c-44a1-a5a3-24f825aa19e0,network=Network(749ff417-d2f9-4311-b2f7-bbdf0cfd37a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd0b585f-55') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.objects.instance [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lazy-loading 'pci_devices' on Instance uuid 85816260-b37b-4b9e-9b52-f823120645aa {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2d792494-39d7-4792-8fbe-9a0a217c1e44 req-81300dc5-bd44-4e11-af86-64c4a0aff7c4 service nova] Releasing lock "refresh_cache-561928fb-3c41-4937-8050-9125614c0641" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:51:43 user nova-compute[72504]:   <uuid>85816260-b37b-4b9e-9b52-f823120645aa</uuid>
Aug 01 19:51:43 user nova-compute[72504]:   <name>instance-0000000a</name>
Aug 01 19:51:43 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:51:43 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:51:43 user nova-compute[72504]:   <metadata>
Aug 01 19:51:43 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:51:43 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:51:43 user nova-compute[72504]:       <nova:name>tempest-device-tagging-server-957777004</nova:name>
Aug 01 19:51:43 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:51:38</nova:creationTime>
Aug 01 19:51:43 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:51:43 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:51:43 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:51:43 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:51:43 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:51:43 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:51:43 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:51:43 user nova-compute[72504]:       <nova:owner>
Aug 01 19:51:43 user nova-compute[72504]:         <nova:user uuid="c2947163cbc44c7b8e0d1a251ec2c906">tempest-TaggedBootDevicesTest_v242-1825089340-project-member</nova:user>
Aug 01 19:51:43 user nova-compute[72504]:         <nova:project uuid="87a15b5dc83241d9a0bfd3df652e08a5">tempest-TaggedBootDevicesTest_v242-1825089340</nova:project>
Aug 01 19:51:43 user nova-compute[72504]:       </nova:owner>
Aug 01 19:51:43 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:51:43 user nova-compute[72504]:       <nova:ports>
Aug 01 19:51:43 user nova-compute[72504]:         <nova:port uuid="1898db0f-13d0-443c-a15f-bcb85039ecdd">
Aug 01 19:51:43 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 19:51:43 user nova-compute[72504]:         </nova:port>
Aug 01 19:51:43 user nova-compute[72504]:         <nova:port uuid="4d17a5cc-0fda-4d09-9121-baab1fed85e8">
Aug 01 19:51:43 user nova-compute[72504]:           <nova:ip type="fixed" address="10.1.1.228" ipVersion="4"/>
Aug 01 19:51:43 user nova-compute[72504]:         </nova:port>
Aug 01 19:51:43 user nova-compute[72504]:         <nova:port uuid="769dacee-ebe9-47f8-994f-1d59b15e2a1b">
Aug 01 19:51:43 user nova-compute[72504]:           <nova:ip type="fixed" address="10.1.1.195" ipVersion="4"/>
Aug 01 19:51:43 user nova-compute[72504]:         </nova:port>
Aug 01 19:51:43 user nova-compute[72504]:         <nova:port uuid="4a5b6139-7885-46c7-9210-676227003327">
Aug 01 19:51:43 user nova-compute[72504]:           <nova:ip type="fixed" address="10.1.1.132" ipVersion="4"/>
Aug 01 19:51:43 user nova-compute[72504]:         </nova:port>
Aug 01 19:51:43 user nova-compute[72504]:         <nova:port uuid="4fc53eb7-bc35-49cd-af26-52ec96aa2008">
Aug 01 19:51:43 user nova-compute[72504]:           <nova:ip type="fixed" address="10.1.1.208" ipVersion="4"/>
Aug 01 19:51:43 user nova-compute[72504]:         </nova:port>
Aug 01 19:51:43 user nova-compute[72504]:         <nova:port uuid="022ea9fb-47cd-4a25-8217-4dd5f379b522">
Aug 01 19:51:43 user nova-compute[72504]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 01 19:51:43 user nova-compute[72504]:         </nova:port>
Aug 01 19:51:43 user nova-compute[72504]:         <nova:port uuid="fd0b585f-558c-44a1-a5a3-24f825aa19e0">
Aug 01 19:51:43 user nova-compute[72504]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 01 19:51:43 user nova-compute[72504]:         </nova:port>
Aug 01 19:51:43 user nova-compute[72504]:       </nova:ports>
Aug 01 19:51:43 user nova-compute[72504]:     </nova:instance>
Aug 01 19:51:43 user nova-compute[72504]:   </metadata>
Aug 01 19:51:43 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:51:43 user nova-compute[72504]:     <system>
Aug 01 19:51:43 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:51:43 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:51:43 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:51:43 user nova-compute[72504]:       <entry name="serial">85816260-b37b-4b9e-9b52-f823120645aa</entry>
Aug 01 19:51:43 user nova-compute[72504]:       <entry name="uuid">85816260-b37b-4b9e-9b52-f823120645aa</entry>
Aug 01 19:51:43 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:51:43 user nova-compute[72504]:     </system>
Aug 01 19:51:43 user nova-compute[72504]:   </sysinfo>
Aug 01 19:51:43 user nova-compute[72504]:   <os>
Aug 01 19:51:43 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:51:43 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:51:43 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:51:43 user nova-compute[72504]:   </os>
Aug 01 19:51:43 user nova-compute[72504]:   <features>
Aug 01 19:51:43 user nova-compute[72504]:     <acpi/>
Aug 01 19:51:43 user nova-compute[72504]:     <apic/>
Aug 01 19:51:43 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:51:43 user nova-compute[72504]:   </features>
Aug 01 19:51:43 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:51:43 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:51:43 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:51:43 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:51:43 user nova-compute[72504]:   </clock>
Aug 01 19:51:43 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:51:43 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:51:43 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:51:43 user nova-compute[72504]:   </cpu>
Aug 01 19:51:43 user nova-compute[72504]:   <devices>
Aug 01 19:51:43 user nova-compute[72504]:     <disk type="file" device="cdrom">
Aug 01 19:51:43 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 19:51:43 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/85816260-b37b-4b9e-9b52-f823120645aa/disk.config"/>
Aug 01 19:51:43 user nova-compute[72504]:       <target dev="hda" bus="ide"/>
Aug 01 19:51:43 user nova-compute[72504]:     </disk>
Aug 01 19:51:43 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 19:51:43 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:51:43 user nova-compute[72504]:       <source dev="/dev/sde"/>
Aug 01 19:51:43 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:51:43 user nova-compute[72504]:       <serial>f573b520-1dce-4ba8-b09f-7234510e28f4</serial>
Aug 01 19:51:43 user nova-compute[72504]:     </disk>
Aug 01 19:51:43 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 19:51:43 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:51:43 user nova-compute[72504]:       <source dev="/dev/sdf"/>
Aug 01 19:51:43 user nova-compute[72504]:       <target dev="vdb" bus="virtio"/>
Aug 01 19:51:43 user nova-compute[72504]:       <serial>2593357d-b560-4929-b260-d3ae1c633315</serial>
Aug 01 19:51:43 user nova-compute[72504]:     </disk>
Aug 01 19:51:43 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 19:51:43 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:51:43 user nova-compute[72504]:       <source dev="/dev/sdg"/>
Aug 01 19:51:43 user nova-compute[72504]:       <target dev="vdc" bus="virtio"/>
Aug 01 19:51:43 user nova-compute[72504]:       <serial>2ef687e5-d914-480f-824a-371a3117d9d2</serial>
Aug 01 19:51:43 user nova-compute[72504]:     </disk>
Aug 01 19:51:43 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:51:43 user nova-compute[72504]:       <mac address="fa:16:3e:c2:7b:99"/>
Aug 01 19:51:43 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:51:43 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:51:43 user nova-compute[72504]:       <target dev="tap1898db0f-13"/>
Aug 01 19:51:43 user nova-compute[72504]:     </interface>
Aug 01 19:51:43 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:51:43 user nova-compute[72504]:       <mac address="fa:16:3e:71:06:4f"/>
Aug 01 19:51:43 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:51:43 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:51:43 user nova-compute[72504]:       <target dev="tap4d17a5cc-0f"/>
Aug 01 19:51:43 user nova-compute[72504]:     </interface>
Aug 01 19:51:43 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:51:43 user nova-compute[72504]:       <mac address="fa:16:3e:52:80:5a"/>
Aug 01 19:51:43 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:51:43 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:51:43 user nova-compute[72504]:       <target dev="tap769dacee-eb"/>
Aug 01 19:51:43 user nova-compute[72504]:     </interface>
Aug 01 19:51:43 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:51:43 user nova-compute[72504]:       <mac address="fa:16:3e:84:ab:7b"/>
Aug 01 19:51:43 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:51:43 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:51:43 user nova-compute[72504]:       <target dev="tap4a5b6139-78"/>
Aug 01 19:51:43 user nova-compute[72504]:     </interface>
Aug 01 19:51:43 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:51:43 user nova-compute[72504]:       <mac address="fa:16:3e:ee:80:d5"/>
Aug 01 19:51:43 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:51:43 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:51:43 user nova-compute[72504]:       <target dev="tap4fc53eb7-bc"/>
Aug 01 19:51:43 user nova-compute[72504]:     </interface>
Aug 01 19:51:43 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:51:43 user nova-compute[72504]:       <mac address="fa:16:3e:79:55:d8"/>
Aug 01 19:51:43 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:51:43 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:51:43 user nova-compute[72504]:       <target dev="tap022ea9fb-47"/>
Aug 01 19:51:43 user nova-compute[72504]:     </interface>
Aug 01 19:51:43 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:51:43 user nova-compute[72504]:       <mac address="fa:16:3e:2a:6f:04"/>
Aug 01 19:51:43 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:51:43 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:51:43 user nova-compute[72504]:       <target dev="tapfd0b585f-55"/>
Aug 01 19:51:43 user nova-compute[72504]:     </interface>
Aug 01 19:51:43 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:51:43 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/85816260-b37b-4b9e-9b52-f823120645aa/console.log" append="off"/>
Aug 01 19:51:43 user nova-compute[72504]:     </serial>
Aug 01 19:51:43 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:51:43 user nova-compute[72504]:     <video>
Aug 01 19:51:43 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:51:43 user nova-compute[72504]:     </video>
Aug 01 19:51:43 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:51:43 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:51:43 user nova-compute[72504]:     </rng>
Aug 01 19:51:43 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:51:43 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:51:43 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:51:43 user nova-compute[72504]:     </memballoon>
Aug 01 19:51:43 user nova-compute[72504]:   </devices>
Aug 01 19:51:43 user nova-compute[72504]: </domain>
Aug 01 19:51:43 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957777004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-957777004',id=10,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3fHv2po9fI8JWLJ/STotCC/ZMt1usNvDJY9OhHFX37UU3G4ImUWgVManPneIT3OQbzL9S8YjwTKJ0753XHtgZTG443G0jU6eMV/ruR8/RM1GoV1Hc8J2PbUW4LxIr9KA==',key_name='tempest-keypair-1242269901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87a15b5dc83241d9a0bfd3df652e08a5',ramdisk_id='',reservation_id='r-har3d7vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1825089340',owner_user_name='tempest-TaggedBootDevicesTest_v242-1825089340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2947163cbc44c7b8e0d1a251ec2c906',uuid=85816260-b37b-4b9e-9b52-f823120645aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "address": "fa:16:3e:c2:7b:99", "network": {"id": "9ccd7c4b-5d10-4ec8-9f00-f4b269b82d04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1560588778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1898db0f-13", "ovs_interfaceid": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converting VIF {"id": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "address": "fa:16:3e:c2:7b:99", "network": {"id": "9ccd7c4b-5d10-4ec8-9f00-f4b269b82d04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1560588778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1898db0f-13", "ovs_interfaceid": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:7b:99,bridge_name='br-int',has_traffic_filtering=True,id=1898db0f-13d0-443c-a15f-bcb85039ecdd,network=Network(9ccd7c4b-5d10-4ec8-9f00-f4b269b82d04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1898db0f-13') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG os_vif [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:7b:99,bridge_name='br-int',has_traffic_filtering=True,id=1898db0f-13d0-443c-a15f-bcb85039ecdd,network=Network(9ccd7c4b-5d10-4ec8-9f00-f4b269b82d04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1898db0f-13') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1898db0f-13, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1898db0f-13, col_values=(('external_ids', {'iface-id': '1898db0f-13d0-443c-a15f-bcb85039ecdd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:7b:99', 'vm-uuid': '85816260-b37b-4b9e-9b52-f823120645aa'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:43 user nova-compute[72504]: INFO os_vif [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:7b:99,bridge_name='br-int',has_traffic_filtering=True,id=1898db0f-13d0-443c-a15f-bcb85039ecdd,network=Network(9ccd7c4b-5d10-4ec8-9f00-f4b269b82d04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1898db0f-13')
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957777004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-957777004',id=10,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3fHv2po9fI8JWLJ/STotCC/ZMt1usNvDJY9OhHFX37UU3G4ImUWgVManPneIT3OQbzL9S8YjwTKJ0753XHtgZTG443G0jU6eMV/ruR8/RM1GoV1Hc8J2PbUW4LxIr9KA==',key_name='tempest-keypair-1242269901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87a15b5dc83241d9a0bfd3df652e08a5',ramdisk_id='',reservation_id='r-har3d7vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1825089340',owner_user_name='tempest-TaggedBootDevicesTest_v242-1825089340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2947163cbc44c7b8e0d1a251ec2c906',uuid=85816260-b37b-4b9e-9b52-f823120645aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "address": "fa:16:3e:71:06:4f", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d17a5cc-0f", "ovs_interfaceid": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converting VIF {"id": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "address": "fa:16:3e:71:06:4f", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d17a5cc-0f", "ovs_interfaceid": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:06:4f,bridge_name='br-int',has_traffic_filtering=True,id=4d17a5cc-0fda-4d09-9121-baab1fed85e8,network=Network(c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4d17a5cc-0f') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG os_vif [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:06:4f,bridge_name='br-int',has_traffic_filtering=True,id=4d17a5cc-0fda-4d09-9121-baab1fed85e8,network=Network(c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4d17a5cc-0f') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d17a5cc-0f, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4d17a5cc-0f, col_values=(('external_ids', {'iface-id': '4d17a5cc-0fda-4d09-9121-baab1fed85e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:06:4f', 'vm-uuid': '85816260-b37b-4b9e-9b52-f823120645aa'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:43 user nova-compute[72504]: INFO os_vif [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:06:4f,bridge_name='br-int',has_traffic_filtering=True,id=4d17a5cc-0fda-4d09-9121-baab1fed85e8,network=Network(c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4d17a5cc-0f')
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957777004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-957777004',id=10,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3fHv2po9fI8JWLJ/STotCC/ZMt1usNvDJY9OhHFX37UU3G4ImUWgVManPneIT3OQbzL9S8YjwTKJ0753XHtgZTG443G0jU6eMV/ruR8/RM1GoV1Hc8J2PbUW4LxIr9KA==',key_name='tempest-keypair-1242269901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87a15b5dc83241d9a0bfd3df652e08a5',ramdisk_id='',reservation_id='r-har3d7vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1825089340',owner_user_name='tempest-TaggedBootDevicesTest_v242-1825089340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2947163cbc44c7b8e0d1a251ec2c906',uuid=85816260-b37b-4b9e-9b52-f823120645aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "address": "fa:16:3e:52:80:5a", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769dacee-eb", "ovs_interfaceid": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converting VIF {"id": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "address": "fa:16:3e:52:80:5a", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769dacee-eb", "ovs_interfaceid": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:80:5a,bridge_name='br-int',has_traffic_filtering=True,id=769dacee-ebe9-47f8-994f-1d59b15e2a1b,network=Network(c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap769dacee-eb') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG os_vif [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:80:5a,bridge_name='br-int',has_traffic_filtering=True,id=769dacee-ebe9-47f8-994f-1d59b15e2a1b,network=Network(c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap769dacee-eb') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap769dacee-eb, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap769dacee-eb, col_values=(('external_ids', {'iface-id': '769dacee-ebe9-47f8-994f-1d59b15e2a1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:80:5a', 'vm-uuid': '85816260-b37b-4b9e-9b52-f823120645aa'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:43 user nova-compute[72504]: INFO os_vif [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:80:5a,bridge_name='br-int',has_traffic_filtering=True,id=769dacee-ebe9-47f8-994f-1d59b15e2a1b,network=Network(c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap769dacee-eb')
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957777004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-957777004',id=10,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3fHv2po9fI8JWLJ/STotCC/ZMt1usNvDJY9OhHFX37UU3G4ImUWgVManPneIT3OQbzL9S8YjwTKJ0753XHtgZTG443G0jU6eMV/ruR8/RM1GoV1Hc8J2PbUW4LxIr9KA==',key_name='tempest-keypair-1242269901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87a15b5dc83241d9a0bfd3df652e08a5',ramdisk_id='',reservation_id='r-har3d7vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1825089340',owner_user_name='tempest-TaggedBootDevicesTest_v242-1825089340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2947163cbc44c7b8e0d1a251ec2c906',uuid=85816260-b37b-4b9e-9b52-f823120645aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a5b6139-7885-46c7-9210-676227003327", "address": "fa:16:3e:84:ab:7b", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a5b6139-78", "ovs_interfaceid": "4a5b6139-7885-46c7-9210-676227003327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converting VIF {"id": "4a5b6139-7885-46c7-9210-676227003327", "address": "fa:16:3e:84:ab:7b", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a5b6139-78", "ovs_interfaceid": "4a5b6139-7885-46c7-9210-676227003327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:ab:7b,bridge_name='br-int',has_traffic_filtering=True,id=4a5b6139-7885-46c7-9210-676227003327,network=Network(c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a5b6139-78') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG os_vif [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ab:7b,bridge_name='br-int',has_traffic_filtering=True,id=4a5b6139-7885-46c7-9210-676227003327,network=Network(c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a5b6139-78') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a5b6139-78, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a5b6139-78, col_values=(('external_ids', {'iface-id': '4a5b6139-7885-46c7-9210-676227003327', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:ab:7b', 'vm-uuid': '85816260-b37b-4b9e-9b52-f823120645aa'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Acquiring lock "561928fb-3c41-4937-8050-9125614c0641" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lock "561928fb-3c41-4937-8050-9125614c0641" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:43 user nova-compute[72504]: INFO nova.compute.manager [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Attaching volume 4b87db97-7516-42d7-86af-a488fdca6032 to /dev/vdb
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:43 user nova-compute[72504]: INFO os_vif [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ab:7b,bridge_name='br-int',has_traffic_filtering=True,id=4a5b6139-7885-46c7-9210-676227003327,network=Network(c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a5b6139-78')
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957777004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-957777004',id=10,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3fHv2po9fI8JWLJ/STotCC/ZMt1usNvDJY9OhHFX37UU3G4ImUWgVManPneIT3OQbzL9S8YjwTKJ0753XHtgZTG443G0jU6eMV/ruR8/RM1GoV1Hc8J2PbUW4LxIr9KA==',key_name='tempest-keypair-1242269901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87a15b5dc83241d9a0bfd3df652e08a5',ramdisk_id='',reservation_id='r-har3d7vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1825089340',owner_user_name='tempest-TaggedBootDevicesTest_v242-1825089340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2947163cbc44c7b8e0d1a251ec2c906',uuid=85816260-b37b-4b9e-9b52-f823120645aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fc53eb7-bc35-49cd-af26-52ec96aa2008", "address": "fa:16:3e:ee:80:d5", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc53eb7-bc", "ovs_interfaceid": "4fc53eb7-bc35-49cd-af26-52ec96aa2008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converting VIF {"id": "4fc53eb7-bc35-49cd-af26-52ec96aa2008", "address": "fa:16:3e:ee:80:d5", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc53eb7-bc", "ovs_interfaceid": "4fc53eb7-bc35-49cd-af26-52ec96aa2008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:80:d5,bridge_name='br-int',has_traffic_filtering=True,id=4fc53eb7-bc35-49cd-af26-52ec96aa2008,network=Network(c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fc53eb7-bc') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG os_vif [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:80:d5,bridge_name='br-int',has_traffic_filtering=True,id=4fc53eb7-bc35-49cd-af26-52ec96aa2008,network=Network(c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fc53eb7-bc') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fc53eb7-bc, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4fc53eb7-bc, col_values=(('external_ids', {'iface-id': '4fc53eb7-bc35-49cd-af26-52ec96aa2008', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:80:d5', 'vm-uuid': '85816260-b37b-4b9e-9b52-f823120645aa'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:51:43 user nova-compute[72504]: DEBUG os_brick.utils [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:44 user nova-compute[72504]: INFO os_vif [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:80:d5,bridge_name='br-int',has_traffic_filtering=True,id=4fc53eb7-bc35-49cd-af26-52ec96aa2008,network=Network(c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fc53eb7-bc')
Aug 01 19:51:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957777004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-957777004',id=10,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3fHv2po9fI8JWLJ/STotCC/ZMt1usNvDJY9OhHFX37UU3G4ImUWgVManPneIT3OQbzL9S8YjwTKJ0753XHtgZTG443G0jU6eMV/ruR8/RM1GoV1Hc8J2PbUW4LxIr9KA==',key_name='tempest-keypair-1242269901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87a15b5dc83241d9a0bfd3df652e08a5',ramdisk_id='',reservation_id='r-har3d7vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1825089340',owner_user_name='tempest-TaggedBootDevicesTest_v242-1825089340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2947163cbc44c7b8e0d1a251ec2c906',uuid=85816260-b37b-4b9e-9b52-f823120645aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "022ea9fb-47cd-4a25-8217-4dd5f379b522", "address": "fa:16:3e:79:55:d8", "network": {"id": "749ff417-d2f9-4311-b2f7-bbdf0cfd37a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-178411316", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022ea9fb-47", "ovs_interfaceid": "022ea9fb-47cd-4a25-8217-4dd5f379b522", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converting VIF {"id": "022ea9fb-47cd-4a25-8217-4dd5f379b522", "address": "fa:16:3e:79:55:d8", "network": {"id": "749ff417-d2f9-4311-b2f7-bbdf0cfd37a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-178411316", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022ea9fb-47", "ovs_interfaceid": "022ea9fb-47cd-4a25-8217-4dd5f379b522", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:55:d8,bridge_name='br-int',has_traffic_filtering=True,id=022ea9fb-47cd-4a25-8217-4dd5f379b522,network=Network(749ff417-d2f9-4311-b2f7-bbdf0cfd37a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap022ea9fb-47') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG os_vif [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:55:d8,bridge_name='br-int',has_traffic_filtering=True,id=022ea9fb-47cd-4a25-8217-4dd5f379b522,network=Network(749ff417-d2f9-4311-b2f7-bbdf0cfd37a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap022ea9fb-47') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap022ea9fb-47, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap022ea9fb-47, col_values=(('external_ids', {'iface-id': '022ea9fb-47cd-4a25-8217-4dd5f379b522', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:55:d8', 'vm-uuid': '85816260-b37b-4b9e-9b52-f823120645aa'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[93113efd-6ed7-4fc6-a155-ea493a694a7e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[13aa8542-79e2-46b7-8831-804c0c725912]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNeZfGsc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:51:44 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:51:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:51:44 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:51:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:51:44 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cacf54-5903-4169-96b4-3991ead9984e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dc0269-5b84-47f8-97e2-5dfb0cb5fd7e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8175ac-72fe-4472-929a-5ed49743be73]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:51:44 user nova-compute[72504]: INFO os_vif [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:55:d8,bridge_name='br-int',has_traffic_filtering=True,id=022ea9fb-47cd-4a25-8217-4dd5f379b522,network=Network(749ff417-d2f9-4311-b2f7-bbdf0cfd37a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap022ea9fb-47')
Aug 01 19:51:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957777004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-957777004',id=10,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3fHv2po9fI8JWLJ/STotCC/ZMt1usNvDJY9OhHFX37UU3G4ImUWgVManPneIT3OQbzL9S8YjwTKJ0753XHtgZTG443G0jU6eMV/ruR8/RM1GoV1Hc8J2PbUW4LxIr9KA==',key_name='tempest-keypair-1242269901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87a15b5dc83241d9a0bfd3df652e08a5',ramdisk_id='',reservation_id='r-har3d7vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1825089340',owner_user_name='tempest-TaggedBootDevicesTest_v242-1825089340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2947163cbc44c7b8e0d1a251ec2c906',uuid=85816260-b37b-4b9e-9b52-f823120645aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "address": "fa:16:3e:2a:6f:04", "network": {"id": "749ff417-d2f9-4311-b2f7-bbdf0cfd37a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-178411316", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd0b585f-55", "ovs_interfaceid": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converting VIF {"id": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "address": "fa:16:3e:2a:6f:04", "network": {"id": "749ff417-d2f9-4311-b2f7-bbdf0cfd37a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-178411316", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd0b585f-55", "ovs_interfaceid": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:6f:04,bridge_name='br-int',has_traffic_filtering=True,id=fd0b585f-558c-44a1-a5a3-24f825aa19e0,network=Network(749ff417-d2f9-4311-b2f7-bbdf0cfd37a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd0b585f-55') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG os_vif [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:6f:04,bridge_name='br-int',has_traffic_filtering=True,id=fd0b585f-558c-44a1-a5a3-24f825aa19e0,network=Network(749ff417-d2f9-4311-b2f7-bbdf0cfd37a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd0b585f-55') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:51:44 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd0b585f-55, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd0b585f-55, col_values=(('external_ids', {'iface-id': 'fd0b585f-558c-44a1-a5a3-24f825aa19e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:6f:04', 'vm-uuid': '85816260-b37b-4b9e-9b52-f823120645aa'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:51:44 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[002c3af7-d810-4a44-8e45-5b43357c2791]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG os_brick.utils [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Updating existing volume attachment record: ad977f59-98ce-41a8-8561-368b3fea64c6 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9dca7f-e9cd-403e-9061-c0f38dd07994]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d] added
Aug 01 19:51:44 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0e7227-f9b1-4c4b-9a6c-5abfb85ca7d1]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:44 user nova-compute[72504]: INFO os_vif [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:6f:04,bridge_name='br-int',has_traffic_filtering=True,id=fd0b585f-558c-44a1-a5a3-24f825aa19e0,network=Network(749ff417-d2f9-4311-b2f7-bbdf0cfd37a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd0b585f-55')
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb171a38-eede-4843-b223-b73ed325c410]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HNeZfGsc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HNeZfGsc" returned: 0 in 0.028s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7836c944-b187-4cc7-ad30-40d99e98ea4b]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HNeZfGsc'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fecc3d2-0be8-47c8-b6b7-af952ac469b3]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] No BDM found with device name hda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] No VIF found with MAC fa:16:3e:c2:7b:99, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] No VIF found with MAC fa:16:3e:ee:80:d5, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:51:44 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Using config drive
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a393eb-9e0e-4227-9658-a5becfc28b27]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:44 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:44 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:44 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:51:44 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:51:44 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:51:44 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:44 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:44 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:44 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:51:44 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:51:44 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:51:44 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:44 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Creating config drive at /opt/stack/data/nova/instances/85816260-b37b-4b9e-9b52-f823120645aa/disk.config
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/85816260-b37b-4b9e-9b52-f823120645aa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpb3hl_wgz {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/85816260-b37b-4b9e-9b52-f823120645aa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpb3hl_wgz" returned: 0 in 0.065s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d -p 172.16.0.220:3260 --login" returned: 0 in 1.188s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:45 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7462fb04-33e2-4b4f-8f6a-33a2704a5acd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d, portal: 172.16.0.220,3260]
Aug 01 19:51:45 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d, portal: 172.16.0.220,3260] successful.
Aug 01 19:51:45 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:45 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[402f5a40-bc6c-4e02-b895-48724a4286e2]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:45 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d946e8d1-9473-40de-b84e-3087a3f82b84]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:45 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:45 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:45 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:51:45 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:51:45 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:51:45 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:51:45 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:51:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:45 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:45 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:45 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:51:45 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:51:45 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:51:45 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:51:45 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:51:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.537s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:51:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:51:45 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:51:45 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:51:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:45 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6bf067-6f8f-4aea-8296-29c0d0b36b6f]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:45 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:51:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNeZfGsc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:51:45 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690919490.994703, 76aa3861-0ca1-4e7f-9a15-9219037bc1ee => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:51:45 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] VM Stopped (Lifecycle Event)
Aug 01 19:51:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:46 user nova-compute[72504]: DEBUG nova.compute.manager [None req-901b5f67-0897-438e-b3fb-58d72b803d83 None None] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:51:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:46 user nova-compute[72504]: DEBUG nova.compute.manager [req-3685d4d4-7123-4538-8d86-854d5c6d0579 req-0af6a966-71c3-4335-8b89-abf04f2ae186 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-plugged-1898db0f-13d0-443c-a15f-bcb85039ecdd {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3685d4d4-7123-4538-8d86-854d5c6d0579 req-0af6a966-71c3-4335-8b89-abf04f2ae186 service nova] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3685d4d4-7123-4538-8d86-854d5c6d0579 req-0af6a966-71c3-4335-8b89-abf04f2ae186 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3685d4d4-7123-4538-8d86-854d5c6d0579 req-0af6a966-71c3-4335-8b89-abf04f2ae186 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:46 user nova-compute[72504]: DEBUG nova.compute.manager [req-3685d4d4-7123-4538-8d86-854d5c6d0579 req-0af6a966-71c3-4335-8b89-abf04f2ae186 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] No waiting events found dispatching network-vif-plugged-1898db0f-13d0-443c-a15f-bcb85039ecdd {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:46 user nova-compute[72504]: WARNING nova.compute.manager [req-3685d4d4-7123-4538-8d86-854d5c6d0579 req-0af6a966-71c3-4335-8b89-abf04f2ae186 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received unexpected event network-vif-plugged-1898db0f-13d0-443c-a15f-bcb85039ecdd for instance with vm_state building and task_state spawning.
Aug 01 19:51:46 user nova-compute[72504]: DEBUG nova.compute.manager [req-a1064641-a9d5-493f-b583-a558d6c1fede req-aa5a0fe1-e907-4a3e-b69f-af7f31ef9cef service nova] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Received event network-changed-381103b0-a255-4d2a-b20e-8dc4b15028e9 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:46 user nova-compute[72504]: DEBUG nova.compute.manager [req-a1064641-a9d5-493f-b583-a558d6c1fede req-aa5a0fe1-e907-4a3e-b69f-af7f31ef9cef service nova] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Refreshing instance network info cache due to event network-changed-381103b0-a255-4d2a-b20e-8dc4b15028e9. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:51:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a1064641-a9d5-493f-b583-a558d6c1fede req-aa5a0fe1-e907-4a3e-b69f-af7f31ef9cef service nova] Acquiring lock "refresh_cache-c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:51:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a1064641-a9d5-493f-b583-a558d6c1fede req-aa5a0fe1-e907-4a3e-b69f-af7f31ef9cef service nova] Acquired lock "refresh_cache-c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:51:46 user nova-compute[72504]: DEBUG nova.network.neutron [req-a1064641-a9d5-493f-b583-a558d6c1fede req-aa5a0fe1-e907-4a3e-b69f-af7f31ef9cef service nova] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Refreshing network info cache for port 381103b0-a255-4d2a-b20e-8dc4b15028e9 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:51:46 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.591s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:51:46 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] <== connect_volume: return (2593ms) {'type': 'block', 'scsi_wwn': '23630386361626161', 'path': '/dev/sdh'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:51:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630386361626161', 'path': '/dev/sdh'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:51:46 user nova-compute[72504]: DEBUG nova.objects.instance [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lazy-loading 'flavor' on Instance uuid 1de87977-532f-45f7-856b-84df41b2a567 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:51:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 19:51:46 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:51:46 user nova-compute[72504]:   <source dev="/dev/sdh"/>
Aug 01 19:51:46 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:51:46 user nova-compute[72504]:   <serial>7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d</serial>
Aug 01 19:51:46 user nova-compute[72504]: </disk>
Aug 01 19:51:46 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 19:51:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG nova.compute.manager [req-0f148fc0-6a1e-437d-809e-3ba4aa80ae27 req-9cc57a01-c5df-4e70-9d00-f6a2b0ea878a service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-plugged-4d17a5cc-0fda-4d09-9121-baab1fed85e8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0f148fc0-6a1e-437d-809e-3ba4aa80ae27 req-9cc57a01-c5df-4e70-9d00-f6a2b0ea878a service nova] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0f148fc0-6a1e-437d-809e-3ba4aa80ae27 req-9cc57a01-c5df-4e70-9d00-f6a2b0ea878a service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0f148fc0-6a1e-437d-809e-3ba4aa80ae27 req-9cc57a01-c5df-4e70-9d00-f6a2b0ea878a service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG nova.compute.manager [req-0f148fc0-6a1e-437d-809e-3ba4aa80ae27 req-9cc57a01-c5df-4e70-9d00-f6a2b0ea878a service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] No waiting events found dispatching network-vif-plugged-4d17a5cc-0fda-4d09-9121-baab1fed85e8 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:47 user nova-compute[72504]: WARNING nova.compute.manager [req-0f148fc0-6a1e-437d-809e-3ba4aa80ae27 req-9cc57a01-c5df-4e70-9d00-f6a2b0ea878a service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received unexpected event network-vif-plugged-4d17a5cc-0fda-4d09-9121-baab1fed85e8 for instance with vm_state building and task_state spawning.
Aug 01 19:51:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] No VIF found with MAC fa:16:3e:45:cb:79, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG nova.network.neutron [req-a1064641-a9d5-493f-b583-a558d6c1fede req-aa5a0fe1-e907-4a3e-b69f-af7f31ef9cef service nova] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Updated VIF entry in instance network info cache for port 381103b0-a255-4d2a-b20e-8dc4b15028e9. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG nova.network.neutron [req-a1064641-a9d5-493f-b583-a558d6c1fede req-aa5a0fe1-e907-4a3e-b69f-af7f31ef9cef service nova] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Updating instance_info_cache with network_info: [{"id": "381103b0-a255-4d2a-b20e-8dc4b15028e9", "address": "fa:16:3e:45:86:19", "network": {"id": "b2c62156-50c6-4f54-b857-961843d14579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-554746486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd6112c6db747f297455ca969783d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381103b0-a2", "ovs_interfaceid": "381103b0-a255-4d2a-b20e-8dc4b15028e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a1064641-a9d5-493f-b583-a558d6c1fede req-aa5a0fe1-e907-4a3e-b69f-af7f31ef9cef service nova] Releasing lock "refresh_cache-c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Acquiring lock "a8966321-946f-4988-83f5-c71cabb1c094" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "a8966321-946f-4988-83f5-c71cabb1c094" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG nova.objects.instance [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lazy-loading 'flavor' on Instance uuid a8966321-946f-4988-83f5-c71cabb1c094 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "a8966321-946f-4988-83f5-c71cabb1c094" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.125s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c43e3cd9-b98a-4ca9-aeff-daf43b69898b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "1de87977-532f-45f7-856b-84df41b2a567" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.295s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Acquiring lock "a8966321-946f-4988-83f5-c71cabb1c094" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "a8966321-946f-4988-83f5-c71cabb1c094" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:47 user nova-compute[72504]: INFO nova.compute.manager [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Attaching volume 6c8a63c2-9a6e-4913-bca7-a661f9390a65 to /dev/sdc
Aug 01 19:51:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG os_brick.utils [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[482380dc-120c-4a3e-bdb6-a347aa51b61b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9409d7d2-61c4-42d4-9ed9-a5810f0ebb79]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f58161-80e1-42ca-bf6f-a31464864e17]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b67a90-c0a5-4888-87f5-095b6b4e60e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:51:48 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:51:48 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97d389d-b6f3-4ee5-9edd-1e491dcb22d0]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG os_brick.utils [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Updating existing volume attachment record: 69836d99-9594-439a-8c7b-4c4be8ac42d2 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG nova.compute.manager [req-2fb7382f-debf-47c7-831a-770068b9070f req-a6bfa258-f729-4fa8-8321-70f739d397a2 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-plugged-1898db0f-13d0-443c-a15f-bcb85039ecdd {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2fb7382f-debf-47c7-831a-770068b9070f req-a6bfa258-f729-4fa8-8321-70f739d397a2 service nova] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2fb7382f-debf-47c7-831a-770068b9070f req-a6bfa258-f729-4fa8-8321-70f739d397a2 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2fb7382f-debf-47c7-831a-770068b9070f req-a6bfa258-f729-4fa8-8321-70f739d397a2 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG nova.compute.manager [req-2fb7382f-debf-47c7-831a-770068b9070f req-a6bfa258-f729-4fa8-8321-70f739d397a2 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] No waiting events found dispatching network-vif-plugged-1898db0f-13d0-443c-a15f-bcb85039ecdd {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:48 user nova-compute[72504]: WARNING nova.compute.manager [req-2fb7382f-debf-47c7-831a-770068b9070f req-a6bfa258-f729-4fa8-8321-70f739d397a2 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received unexpected event network-vif-plugged-1898db0f-13d0-443c-a15f-bcb85039ecdd for instance with vm_state building and task_state spawning.
Aug 01 19:51:48 user nova-compute[72504]: DEBUG nova.compute.manager [req-2fb7382f-debf-47c7-831a-770068b9070f req-a6bfa258-f729-4fa8-8321-70f739d397a2 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-plugged-769dacee-ebe9-47f8-994f-1d59b15e2a1b {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2fb7382f-debf-47c7-831a-770068b9070f req-a6bfa258-f729-4fa8-8321-70f739d397a2 service nova] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2fb7382f-debf-47c7-831a-770068b9070f req-a6bfa258-f729-4fa8-8321-70f739d397a2 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2fb7382f-debf-47c7-831a-770068b9070f req-a6bfa258-f729-4fa8-8321-70f739d397a2 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG nova.compute.manager [req-2fb7382f-debf-47c7-831a-770068b9070f req-a6bfa258-f729-4fa8-8321-70f739d397a2 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] No waiting events found dispatching network-vif-plugged-769dacee-ebe9-47f8-994f-1d59b15e2a1b {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:48 user nova-compute[72504]: WARNING nova.compute.manager [req-2fb7382f-debf-47c7-831a-770068b9070f req-a6bfa258-f729-4fa8-8321-70f739d397a2 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received unexpected event network-vif-plugged-769dacee-ebe9-47f8-994f-1d59b15e2a1b for instance with vm_state building and task_state spawning.
Aug 01 19:51:48 user nova-compute[72504]: DEBUG nova.compute.manager [req-2fb7382f-debf-47c7-831a-770068b9070f req-a6bfa258-f729-4fa8-8321-70f739d397a2 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-plugged-769dacee-ebe9-47f8-994f-1d59b15e2a1b {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2fb7382f-debf-47c7-831a-770068b9070f req-a6bfa258-f729-4fa8-8321-70f739d397a2 service nova] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2fb7382f-debf-47c7-831a-770068b9070f req-a6bfa258-f729-4fa8-8321-70f739d397a2 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2fb7382f-debf-47c7-831a-770068b9070f req-a6bfa258-f729-4fa8-8321-70f739d397a2 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG nova.compute.manager [req-2fb7382f-debf-47c7-831a-770068b9070f req-a6bfa258-f729-4fa8-8321-70f739d397a2 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] No waiting events found dispatching network-vif-plugged-769dacee-ebe9-47f8-994f-1d59b15e2a1b {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:48 user nova-compute[72504]: WARNING nova.compute.manager [req-2fb7382f-debf-47c7-831a-770068b9070f req-a6bfa258-f729-4fa8-8321-70f739d397a2 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received unexpected event network-vif-plugged-769dacee-ebe9-47f8-994f-1d59b15e2a1b for instance with vm_state building and task_state spawning.
Aug 01 19:51:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:49 user nova-compute[72504]: DEBUG nova.compute.manager [req-79f6845d-4c63-498b-98c4-3616a7db7ad4 req-2faae228-9997-4704-a4d7-9aa2973cae77 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-plugged-4d17a5cc-0fda-4d09-9121-baab1fed85e8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-79f6845d-4c63-498b-98c4-3616a7db7ad4 req-2faae228-9997-4704-a4d7-9aa2973cae77 service nova] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-79f6845d-4c63-498b-98c4-3616a7db7ad4 req-2faae228-9997-4704-a4d7-9aa2973cae77 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-79f6845d-4c63-498b-98c4-3616a7db7ad4 req-2faae228-9997-4704-a4d7-9aa2973cae77 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:49 user nova-compute[72504]: DEBUG nova.compute.manager [req-79f6845d-4c63-498b-98c4-3616a7db7ad4 req-2faae228-9997-4704-a4d7-9aa2973cae77 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] No waiting events found dispatching network-vif-plugged-4d17a5cc-0fda-4d09-9121-baab1fed85e8 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:49 user nova-compute[72504]: WARNING nova.compute.manager [req-79f6845d-4c63-498b-98c4-3616a7db7ad4 req-2faae228-9997-4704-a4d7-9aa2973cae77 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received unexpected event network-vif-plugged-4d17a5cc-0fda-4d09-9121-baab1fed85e8 for instance with vm_state building and task_state spawning.
Aug 01 19:51:49 user nova-compute[72504]: DEBUG nova.compute.manager [req-79f6845d-4c63-498b-98c4-3616a7db7ad4 req-2faae228-9997-4704-a4d7-9aa2973cae77 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-plugged-4a5b6139-7885-46c7-9210-676227003327 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-79f6845d-4c63-498b-98c4-3616a7db7ad4 req-2faae228-9997-4704-a4d7-9aa2973cae77 service nova] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-79f6845d-4c63-498b-98c4-3616a7db7ad4 req-2faae228-9997-4704-a4d7-9aa2973cae77 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-79f6845d-4c63-498b-98c4-3616a7db7ad4 req-2faae228-9997-4704-a4d7-9aa2973cae77 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:49 user nova-compute[72504]: DEBUG nova.compute.manager [req-79f6845d-4c63-498b-98c4-3616a7db7ad4 req-2faae228-9997-4704-a4d7-9aa2973cae77 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] No waiting events found dispatching network-vif-plugged-4a5b6139-7885-46c7-9210-676227003327 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:49 user nova-compute[72504]: WARNING nova.compute.manager [req-79f6845d-4c63-498b-98c4-3616a7db7ad4 req-2faae228-9997-4704-a4d7-9aa2973cae77 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received unexpected event network-vif-plugged-4a5b6139-7885-46c7-9210-676227003327 for instance with vm_state building and task_state spawning.
Aug 01 19:51:49 user nova-compute[72504]: DEBUG nova.compute.manager [req-79f6845d-4c63-498b-98c4-3616a7db7ad4 req-2faae228-9997-4704-a4d7-9aa2973cae77 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-plugged-4a5b6139-7885-46c7-9210-676227003327 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-79f6845d-4c63-498b-98c4-3616a7db7ad4 req-2faae228-9997-4704-a4d7-9aa2973cae77 service nova] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-79f6845d-4c63-498b-98c4-3616a7db7ad4 req-2faae228-9997-4704-a4d7-9aa2973cae77 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-79f6845d-4c63-498b-98c4-3616a7db7ad4 req-2faae228-9997-4704-a4d7-9aa2973cae77 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:49 user nova-compute[72504]: DEBUG nova.compute.manager [req-79f6845d-4c63-498b-98c4-3616a7db7ad4 req-2faae228-9997-4704-a4d7-9aa2973cae77 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] No waiting events found dispatching network-vif-plugged-4a5b6139-7885-46c7-9210-676227003327 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:49 user nova-compute[72504]: WARNING nova.compute.manager [req-79f6845d-4c63-498b-98c4-3616a7db7ad4 req-2faae228-9997-4704-a4d7-9aa2973cae77 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received unexpected event network-vif-plugged-4a5b6139-7885-46c7-9210-676227003327 for instance with vm_state building and task_state spawning.
Aug 01 19:51:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:50 user nova-compute[72504]: DEBUG nova.compute.manager [req-41ff67cb-df5e-4e3b-84d9-4a66535e63bb req-a50ffb34-f2fc-4a36-bcf3-20a6a0ddfe02 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-plugged-022ea9fb-47cd-4a25-8217-4dd5f379b522 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-41ff67cb-df5e-4e3b-84d9-4a66535e63bb req-a50ffb34-f2fc-4a36-bcf3-20a6a0ddfe02 service nova] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-41ff67cb-df5e-4e3b-84d9-4a66535e63bb req-a50ffb34-f2fc-4a36-bcf3-20a6a0ddfe02 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-41ff67cb-df5e-4e3b-84d9-4a66535e63bb req-a50ffb34-f2fc-4a36-bcf3-20a6a0ddfe02 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:50 user nova-compute[72504]: DEBUG nova.compute.manager [req-41ff67cb-df5e-4e3b-84d9-4a66535e63bb req-a50ffb34-f2fc-4a36-bcf3-20a6a0ddfe02 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] No waiting events found dispatching network-vif-plugged-022ea9fb-47cd-4a25-8217-4dd5f379b522 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:50 user nova-compute[72504]: WARNING nova.compute.manager [req-41ff67cb-df5e-4e3b-84d9-4a66535e63bb req-a50ffb34-f2fc-4a36-bcf3-20a6a0ddfe02 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received unexpected event network-vif-plugged-022ea9fb-47cd-4a25-8217-4dd5f379b522 for instance with vm_state building and task_state spawning.
Aug 01 19:51:50 user nova-compute[72504]: DEBUG nova.compute.manager [req-41ff67cb-df5e-4e3b-84d9-4a66535e63bb req-a50ffb34-f2fc-4a36-bcf3-20a6a0ddfe02 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-plugged-022ea9fb-47cd-4a25-8217-4dd5f379b522 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-41ff67cb-df5e-4e3b-84d9-4a66535e63bb req-a50ffb34-f2fc-4a36-bcf3-20a6a0ddfe02 service nova] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-41ff67cb-df5e-4e3b-84d9-4a66535e63bb req-a50ffb34-f2fc-4a36-bcf3-20a6a0ddfe02 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-41ff67cb-df5e-4e3b-84d9-4a66535e63bb req-a50ffb34-f2fc-4a36-bcf3-20a6a0ddfe02 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:50 user nova-compute[72504]: DEBUG nova.compute.manager [req-41ff67cb-df5e-4e3b-84d9-4a66535e63bb req-a50ffb34-f2fc-4a36-bcf3-20a6a0ddfe02 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] No waiting events found dispatching network-vif-plugged-022ea9fb-47cd-4a25-8217-4dd5f379b522 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:50 user nova-compute[72504]: WARNING nova.compute.manager [req-41ff67cb-df5e-4e3b-84d9-4a66535e63bb req-a50ffb34-f2fc-4a36-bcf3-20a6a0ddfe02 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received unexpected event network-vif-plugged-022ea9fb-47cd-4a25-8217-4dd5f379b522 for instance with vm_state building and task_state spawning.
Aug 01 19:51:51 user nova-compute[72504]: DEBUG nova.compute.manager [req-befe6da1-5ea9-497a-94dc-2c46ba5388e1 req-0e45ae22-53c9-4252-b29c-7c4216cc8ca7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-plugged-4fc53eb7-bc35-49cd-af26-52ec96aa2008 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-befe6da1-5ea9-497a-94dc-2c46ba5388e1 req-0e45ae22-53c9-4252-b29c-7c4216cc8ca7 service nova] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-befe6da1-5ea9-497a-94dc-2c46ba5388e1 req-0e45ae22-53c9-4252-b29c-7c4216cc8ca7 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-befe6da1-5ea9-497a-94dc-2c46ba5388e1 req-0e45ae22-53c9-4252-b29c-7c4216cc8ca7 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:51 user nova-compute[72504]: DEBUG nova.compute.manager [req-befe6da1-5ea9-497a-94dc-2c46ba5388e1 req-0e45ae22-53c9-4252-b29c-7c4216cc8ca7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] No waiting events found dispatching network-vif-plugged-4fc53eb7-bc35-49cd-af26-52ec96aa2008 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:51 user nova-compute[72504]: WARNING nova.compute.manager [req-befe6da1-5ea9-497a-94dc-2c46ba5388e1 req-0e45ae22-53c9-4252-b29c-7c4216cc8ca7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received unexpected event network-vif-plugged-4fc53eb7-bc35-49cd-af26-52ec96aa2008 for instance with vm_state building and task_state spawning.
Aug 01 19:51:51 user nova-compute[72504]: DEBUG nova.compute.manager [req-befe6da1-5ea9-497a-94dc-2c46ba5388e1 req-0e45ae22-53c9-4252-b29c-7c4216cc8ca7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-plugged-4fc53eb7-bc35-49cd-af26-52ec96aa2008 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-befe6da1-5ea9-497a-94dc-2c46ba5388e1 req-0e45ae22-53c9-4252-b29c-7c4216cc8ca7 service nova] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-befe6da1-5ea9-497a-94dc-2c46ba5388e1 req-0e45ae22-53c9-4252-b29c-7c4216cc8ca7 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-befe6da1-5ea9-497a-94dc-2c46ba5388e1 req-0e45ae22-53c9-4252-b29c-7c4216cc8ca7 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:51 user nova-compute[72504]: DEBUG nova.compute.manager [req-befe6da1-5ea9-497a-94dc-2c46ba5388e1 req-0e45ae22-53c9-4252-b29c-7c4216cc8ca7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] No waiting events found dispatching network-vif-plugged-4fc53eb7-bc35-49cd-af26-52ec96aa2008 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:51 user nova-compute[72504]: WARNING nova.compute.manager [req-befe6da1-5ea9-497a-94dc-2c46ba5388e1 req-0e45ae22-53c9-4252-b29c-7c4216cc8ca7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received unexpected event network-vif-plugged-4fc53eb7-bc35-49cd-af26-52ec96aa2008 for instance with vm_state building and task_state spawning.
Aug 01 19:51:51 user nova-compute[72504]: DEBUG nova.compute.manager [req-befe6da1-5ea9-497a-94dc-2c46ba5388e1 req-0e45ae22-53c9-4252-b29c-7c4216cc8ca7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-plugged-fd0b585f-558c-44a1-a5a3-24f825aa19e0 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-befe6da1-5ea9-497a-94dc-2c46ba5388e1 req-0e45ae22-53c9-4252-b29c-7c4216cc8ca7 service nova] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-befe6da1-5ea9-497a-94dc-2c46ba5388e1 req-0e45ae22-53c9-4252-b29c-7c4216cc8ca7 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-befe6da1-5ea9-497a-94dc-2c46ba5388e1 req-0e45ae22-53c9-4252-b29c-7c4216cc8ca7 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:51 user nova-compute[72504]: DEBUG nova.compute.manager [req-befe6da1-5ea9-497a-94dc-2c46ba5388e1 req-0e45ae22-53c9-4252-b29c-7c4216cc8ca7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] No waiting events found dispatching network-vif-plugged-fd0b585f-558c-44a1-a5a3-24f825aa19e0 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:51 user nova-compute[72504]: WARNING nova.compute.manager [req-befe6da1-5ea9-497a-94dc-2c46ba5388e1 req-0e45ae22-53c9-4252-b29c-7c4216cc8ca7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received unexpected event network-vif-plugged-fd0b585f-558c-44a1-a5a3-24f825aa19e0 for instance with vm_state building and task_state spawning.
Aug 01 19:51:51 user nova-compute[72504]: DEBUG nova.compute.manager [req-befe6da1-5ea9-497a-94dc-2c46ba5388e1 req-0e45ae22-53c9-4252-b29c-7c4216cc8ca7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-plugged-fd0b585f-558c-44a1-a5a3-24f825aa19e0 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-befe6da1-5ea9-497a-94dc-2c46ba5388e1 req-0e45ae22-53c9-4252-b29c-7c4216cc8ca7 service nova] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-befe6da1-5ea9-497a-94dc-2c46ba5388e1 req-0e45ae22-53c9-4252-b29c-7c4216cc8ca7 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-befe6da1-5ea9-497a-94dc-2c46ba5388e1 req-0e45ae22-53c9-4252-b29c-7c4216cc8ca7 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:51 user nova-compute[72504]: DEBUG nova.compute.manager [req-befe6da1-5ea9-497a-94dc-2c46ba5388e1 req-0e45ae22-53c9-4252-b29c-7c4216cc8ca7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] No waiting events found dispatching network-vif-plugged-fd0b585f-558c-44a1-a5a3-24f825aa19e0 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:51 user nova-compute[72504]: WARNING nova.compute.manager [req-befe6da1-5ea9-497a-94dc-2c46ba5388e1 req-0e45ae22-53c9-4252-b29c-7c4216cc8ca7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received unexpected event network-vif-plugged-fd0b585f-558c-44a1-a5a3-24f825aa19e0 for instance with vm_state building and task_state spawning.
Aug 01 19:51:51 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919511.6902385, 85816260-b37b-4b9e-9b52-f823120645aa => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:51:51 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] VM Resumed (Lifecycle Event)
Aug 01 19:51:51 user nova-compute[72504]: DEBUG nova.compute.manager [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:51:51 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:51:51 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Instance spawned successfully.
Aug 01 19:51:51 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 19:51:51 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:51:51 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:51:51 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:51:51 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:51:51 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:51:51 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:51:51 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:51:51 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:51:51 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:51:51 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919511.6922665, 85816260-b37b-4b9e-9b52-f823120645aa => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:51:51 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] VM Started (Lifecycle Event)
Aug 01 19:51:51 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:51:51 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:51:51 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:51:51 user nova-compute[72504]: INFO nova.compute.manager [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Took 13.01 seconds to spawn the instance on the hypervisor.
Aug 01 19:51:51 user nova-compute[72504]: DEBUG nova.compute.manager [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:51:52 user nova-compute[72504]: INFO nova.compute.manager [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Took 58.78 seconds to build instance.
Aug 01 19:51:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-73066aff-c1e6-45bc-bd6f-046b99ba6013 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "85816260-b37b-4b9e-9b52-f823120645aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 58.932s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Acquiring lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:52 user nova-compute[72504]: DEBUG nova.objects.instance [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lazy-loading 'flavor' on Instance uuid c9fd391d-51c0-4ef9-86cc-5ce2c76c177a {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:51:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "840f652e-bd31-4cb0-bd52-2873a641d876" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "840f652e-bd31-4cb0-bd52-2873a641d876" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:52 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690919497.5926936, 8eae5ffe-ab54-4dac-8169-69325448b92f => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:51:52 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] VM Stopped (Lifecycle Event)
Aug 01 19:51:52 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1edf23fa-2033-4c57-b5d0-89be2490bba4 None None] [instance: 8eae5ffe-ab54-4dac-8169-69325448b92f] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:51:52 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 19:51:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Acquiring lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:52 user nova-compute[72504]: INFO nova.compute.manager [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Attaching volume c8c1eb1a-fa84-484b-94e3-ef248f4742f8 to /dev/vdb
Aug 01 19:51:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:52 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:51:52 user nova-compute[72504]: INFO nova.compute.claims [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Claim successful on node user
Aug 01 19:51:52 user nova-compute[72504]: DEBUG os_brick.utils [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:51:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[880d99fd-c9ae-4e9f-b4d9-0d2462340111]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a32abe-148f-4224-9331-8b4a80564fdb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb87273-f954-4f41-8f7c-f574dd5106d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb837d4-075f-49a1-aa9f-7170a693feb6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:51:53 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:51:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffc808c-9374-4d8b-b328-b982d4b8eee4]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG os_brick.utils [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Updating existing volume attachment record: be31913f-abfd-4b5e-8b41-75e764297617 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG nova.network.neutron [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 19:51:53 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 19:51:53 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG nova.policy [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '451baacc96384f35bd8bbb87626ac52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cc01820f324654b0959d5fb2adefc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:51:53 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Creating image(s)
Aug 01 19:51:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "/opt/stack/data/nova/instances/840f652e-bd31-4cb0-bd52-2873a641d876/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "/opt/stack/data/nova/instances/840f652e-bd31-4cb0-bd52-2873a641d876/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "/opt/stack/data/nova/instances/840f652e-bd31-4cb0-bd52-2873a641d876/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.021s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.174s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.157s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/840f652e-bd31-4cb0-bd52-2873a641d876/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/840f652e-bd31-4cb0-bd52-2873a641d876/disk 1073741824" returned: 0 in 0.062s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.162s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:54 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Checking if we can resize image /opt/stack/data/nova/instances/840f652e-bd31-4cb0-bd52-2873a641d876/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 19:51:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/840f652e-bd31-4cb0-bd52-2873a641d876/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:54 user nova-compute[72504]: DEBUG nova.network.neutron [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Successfully created port: aee39726-8236-4507-8bec-fc1b40eafbba {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:51:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/840f652e-bd31-4cb0-bd52-2873a641d876/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:54 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Cannot resize image /opt/stack/data/nova/instances/840f652e-bd31-4cb0-bd52-2873a641d876/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 19:51:54 user nova-compute[72504]: DEBUG nova.objects.instance [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lazy-loading 'migration_context' on Instance uuid 840f652e-bd31-4cb0-bd52-2873a641d876 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:51:54 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 19:51:54 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Ensure instance console log exists: /opt/stack/data/nova/instances/840f652e-bd31-4cb0-bd52-2873a641d876/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:51:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqCxSyTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:51:55 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:51:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:51:55 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:51:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:51:55 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a6f6d8-0803-4da3-9819-dee750769352]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:51:55 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG nova.network.neutron [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Successfully updated port: aee39726-8236-4507-8bec-fc1b40eafbba {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "refresh_cache-840f652e-bd31-4cb0-bd52-2873a641d876" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquired lock "refresh_cache-840f652e-bd31-4cb0-bd52-2873a641d876" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG nova.network.neutron [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[debe3c7c-ee52-4745-8219-436c6585f8e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032] added
Aug 01 19:51:55 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[601c4c3b-3d91-4c3c-a213-940ac1160276]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-f71c1bc1-7422-4de6-856f-a71f4213715a req-55323421-1be6-497c-b56e-c1fce03f28fe service nova] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Received event network-changed-aee39726-8236-4507-8bec-fc1b40eafbba {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-f71c1bc1-7422-4de6-856f-a71f4213715a req-55323421-1be6-497c-b56e-c1fce03f28fe service nova] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Refreshing instance network info cache due to event network-changed-aee39726-8236-4507-8bec-fc1b40eafbba. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f71c1bc1-7422-4de6-856f-a71f4213715a req-55323421-1be6-497c-b56e-c1fce03f28fe service nova] Acquiring lock "refresh_cache-840f652e-bd31-4cb0-bd52-2873a641d876" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f98656-c4de-4a50-9b00-182c0488e4eb]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PqCxSyTX {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PqCxSyTX" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[213aa86f-e7f8-4a58-9d27-4e665afc1b47]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PqCxSyTX'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e6bf64-e2dc-4e4d-8194-c529b379df0c]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8e3c82-59b8-44bb-9de9-b12a6fed6981]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:55 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:55 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:55 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:51:55 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:51:55 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:51:55 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:51:55 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:55 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:55 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:55 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:51:55 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:51:55 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:51:55 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:51:55 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdccabf-2b68-4f5b-bc2c-efe3899f3a2e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032, portal: 172.16.0.220,3260]
Aug 01 19:51:55 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032, portal: 172.16.0.220,3260] successful.
Aug 01 19:51:55 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ebfadf-54ae-4719-abc2-184c13722cda]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6d3ac8-b54e-4c6d-8ebd-32750911f4d8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)
Aug 01 19:51:55 user nova-compute[72504]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:55 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:55 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:55 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:51:55 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:51:55 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:51:55 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:51:55 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)
Aug 01 19:51:55 user nova-compute[72504]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:55 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:55 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:55 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:51:55 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:51:55 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:51:55 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:51:55 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc53274-cc0f-4331-8180-6c24be6736b4]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqCxSyTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:51:55 user nova-compute[72504]: DEBUG nova.network.neutron [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.network.neutron [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Updating instance_info_cache with network_info: [{"id": "aee39726-8236-4507-8bec-fc1b40eafbba", "address": "fa:16:3e:85:04:12", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaee39726-82", "ovs_interfaceid": "aee39726-8236-4507-8bec-fc1b40eafbba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Releasing lock "refresh_cache-840f652e-bd31-4cb0-bd52-2873a641d876" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Instance network_info: |[{"id": "aee39726-8236-4507-8bec-fc1b40eafbba", "address": "fa:16:3e:85:04:12", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaee39726-82", "ovs_interfaceid": "aee39726-8236-4507-8bec-fc1b40eafbba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f71c1bc1-7422-4de6-856f-a71f4213715a req-55323421-1be6-497c-b56e-c1fce03f28fe service nova] Acquired lock "refresh_cache-840f652e-bd31-4cb0-bd52-2873a641d876" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.network.neutron [req-f71c1bc1-7422-4de6-856f-a71f4213715a req-55323421-1be6-497c-b56e-c1fce03f28fe service nova] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Refreshing network info cache for port aee39726-8236-4507-8bec-fc1b40eafbba {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Start _get_guest_xml network_info=[{"id": "aee39726-8236-4507-8bec-fc1b40eafbba", "address": "fa:16:3e:85:04:12", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaee39726-82", "ovs_interfaceid": "aee39726-8236-4507-8bec-fc1b40eafbba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:51:56 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:51:56 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-213349054',display_name='tempest-AttachVolumeNegativeTest-server-213349054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-213349054',id=11,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRxZYaSQKZIQ/Pt5J0BXbm2lRIKONwgYHOC1bhODF0hBOMKdKipZL4fdq6kqFXYzSF9s9Y40ehRtWlIBpjTt52eLemda2o2Eaw7z3ml5hOeJRa5fZIPSsa2CY8ylUu1sA==',key_name='tempest-keypair-944089750',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15cc01820f324654b0959d5fb2adefc3',ramdisk_id='',reservation_id='r-8la04reb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2109955223',owner_user_name='tempest-AttachVolumeNegativeTest-2109955223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:51:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='451baacc96384f35bd8bbb87626ac52d',uuid=840f652e-bd31-4cb0-bd52-2873a641d876,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aee39726-8236-4507-8bec-fc1b40eafbba", "address": "fa:16:3e:85:04:12", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaee39726-82", "ovs_interfaceid": "aee39726-8236-4507-8bec-fc1b40eafbba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Converting VIF {"id": "aee39726-8236-4507-8bec-fc1b40eafbba", "address": "fa:16:3e:85:04:12", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaee39726-82", "ovs_interfaceid": "aee39726-8236-4507-8bec-fc1b40eafbba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:04:12,bridge_name='br-int',has_traffic_filtering=True,id=aee39726-8236-4507-8bec-fc1b40eafbba,network=Network(67292f1d-2643-4cfa-aaf6-0a698d87bfd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaee39726-82') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.objects.instance [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lazy-loading 'pci_devices' on Instance uuid 840f652e-bd31-4cb0-bd52-2873a641d876 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:51:56 user nova-compute[72504]:   <uuid>840f652e-bd31-4cb0-bd52-2873a641d876</uuid>
Aug 01 19:51:56 user nova-compute[72504]:   <name>instance-0000000b</name>
Aug 01 19:51:56 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:51:56 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:51:56 user nova-compute[72504]:   <metadata>
Aug 01 19:51:56 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:51:56 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:51:56 user nova-compute[72504]:       <nova:name>tempest-AttachVolumeNegativeTest-server-213349054</nova:name>
Aug 01 19:51:56 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:51:56</nova:creationTime>
Aug 01 19:51:56 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:51:56 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:51:56 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:51:56 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:51:56 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:51:56 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:51:56 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:51:56 user nova-compute[72504]:       <nova:owner>
Aug 01 19:51:56 user nova-compute[72504]:         <nova:user uuid="451baacc96384f35bd8bbb87626ac52d">tempest-AttachVolumeNegativeTest-2109955223-project-member</nova:user>
Aug 01 19:51:56 user nova-compute[72504]:         <nova:project uuid="15cc01820f324654b0959d5fb2adefc3">tempest-AttachVolumeNegativeTest-2109955223</nova:project>
Aug 01 19:51:56 user nova-compute[72504]:       </nova:owner>
Aug 01 19:51:56 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:51:56 user nova-compute[72504]:       <nova:ports>
Aug 01 19:51:56 user nova-compute[72504]:         <nova:port uuid="aee39726-8236-4507-8bec-fc1b40eafbba">
Aug 01 19:51:56 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 19:51:56 user nova-compute[72504]:         </nova:port>
Aug 01 19:51:56 user nova-compute[72504]:       </nova:ports>
Aug 01 19:51:56 user nova-compute[72504]:     </nova:instance>
Aug 01 19:51:56 user nova-compute[72504]:   </metadata>
Aug 01 19:51:56 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:51:56 user nova-compute[72504]:     <system>
Aug 01 19:51:56 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:51:56 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:51:56 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:51:56 user nova-compute[72504]:       <entry name="serial">840f652e-bd31-4cb0-bd52-2873a641d876</entry>
Aug 01 19:51:56 user nova-compute[72504]:       <entry name="uuid">840f652e-bd31-4cb0-bd52-2873a641d876</entry>
Aug 01 19:51:56 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:51:56 user nova-compute[72504]:     </system>
Aug 01 19:51:56 user nova-compute[72504]:   </sysinfo>
Aug 01 19:51:56 user nova-compute[72504]:   <os>
Aug 01 19:51:56 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:51:56 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:51:56 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:51:56 user nova-compute[72504]:   </os>
Aug 01 19:51:56 user nova-compute[72504]:   <features>
Aug 01 19:51:56 user nova-compute[72504]:     <acpi/>
Aug 01 19:51:56 user nova-compute[72504]:     <apic/>
Aug 01 19:51:56 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:51:56 user nova-compute[72504]:   </features>
Aug 01 19:51:56 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:51:56 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:51:56 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:51:56 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:51:56 user nova-compute[72504]:   </clock>
Aug 01 19:51:56 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:51:56 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:51:56 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:51:56 user nova-compute[72504]:   </cpu>
Aug 01 19:51:56 user nova-compute[72504]:   <devices>
Aug 01 19:51:56 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:51:56 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:51:56 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/840f652e-bd31-4cb0-bd52-2873a641d876/disk"/>
Aug 01 19:51:56 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:51:56 user nova-compute[72504]:     </disk>
Aug 01 19:51:56 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:51:56 user nova-compute[72504]:       <mac address="fa:16:3e:85:04:12"/>
Aug 01 19:51:56 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:51:56 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:51:56 user nova-compute[72504]:       <target dev="tapaee39726-82"/>
Aug 01 19:51:56 user nova-compute[72504]:     </interface>
Aug 01 19:51:56 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:51:56 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/840f652e-bd31-4cb0-bd52-2873a641d876/console.log" append="off"/>
Aug 01 19:51:56 user nova-compute[72504]:     </serial>
Aug 01 19:51:56 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:51:56 user nova-compute[72504]:     <video>
Aug 01 19:51:56 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:51:56 user nova-compute[72504]:     </video>
Aug 01 19:51:56 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:51:56 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:51:56 user nova-compute[72504]:     </rng>
Aug 01 19:51:56 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:51:56 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:51:56 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:51:56 user nova-compute[72504]:     </memballoon>
Aug 01 19:51:56 user nova-compute[72504]:   </devices>
Aug 01 19:51:56 user nova-compute[72504]: </domain>
Aug 01 19:51:56 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-213349054',display_name='tempest-AttachVolumeNegativeTest-server-213349054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-213349054',id=11,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRxZYaSQKZIQ/Pt5J0BXbm2lRIKONwgYHOC1bhODF0hBOMKdKipZL4fdq6kqFXYzSF9s9Y40ehRtWlIBpjTt52eLemda2o2Eaw7z3ml5hOeJRa5fZIPSsa2CY8ylUu1sA==',key_name='tempest-keypair-944089750',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15cc01820f324654b0959d5fb2adefc3',ramdisk_id='',reservation_id='r-8la04reb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2109955223',owner_user_name='tempest-AttachVolumeNegativeTest-2109955223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:51:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='451baacc96384f35bd8bbb87626ac52d',uuid=840f652e-bd31-4cb0-bd52-2873a641d876,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aee39726-8236-4507-8bec-fc1b40eafbba", "address": "fa:16:3e:85:04:12", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaee39726-82", "ovs_interfaceid": "aee39726-8236-4507-8bec-fc1b40eafbba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Converting VIF {"id": "aee39726-8236-4507-8bec-fc1b40eafbba", "address": "fa:16:3e:85:04:12", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaee39726-82", "ovs_interfaceid": "aee39726-8236-4507-8bec-fc1b40eafbba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:04:12,bridge_name='br-int',has_traffic_filtering=True,id=aee39726-8236-4507-8bec-fc1b40eafbba,network=Network(67292f1d-2643-4cfa-aaf6-0a698d87bfd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaee39726-82') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG os_vif [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:04:12,bridge_name='br-int',has_traffic_filtering=True,id=aee39726-8236-4507-8bec-fc1b40eafbba,network=Network(67292f1d-2643-4cfa-aaf6-0a698d87bfd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaee39726-82') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaee39726-82, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaee39726-82, col_values=(('external_ids', {'iface-id': 'aee39726-8236-4507-8bec-fc1b40eafbba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:04:12', 'vm-uuid': '840f652e-bd31-4cb0-bd52-2873a641d876'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:56 user nova-compute[72504]: INFO os_vif [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:04:12,bridge_name='br-int',has_traffic_filtering=True,id=aee39726-8236-4507-8bec-fc1b40eafbba,network=Network(67292f1d-2643-4cfa-aaf6-0a698d87bfd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaee39726-82')
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] No VIF found with MAC fa:16:3e:85:04:12, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.network.neutron [req-f71c1bc1-7422-4de6-856f-a71f4213715a req-55323421-1be6-497c-b56e-c1fce03f28fe service nova] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Updated VIF entry in instance network info cache for port aee39726-8236-4507-8bec-fc1b40eafbba. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.network.neutron [req-f71c1bc1-7422-4de6-856f-a71f4213715a req-55323421-1be6-497c-b56e-c1fce03f28fe service nova] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Updating instance_info_cache with network_info: [{"id": "aee39726-8236-4507-8bec-fc1b40eafbba", "address": "fa:16:3e:85:04:12", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaee39726-82", "ovs_interfaceid": "aee39726-8236-4507-8bec-fc1b40eafbba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f71c1bc1-7422-4de6-856f-a71f4213715a req-55323421-1be6-497c-b56e-c1fce03f28fe service nova] Releasing lock "refresh_cache-840f652e-bd31-4cb0-bd52-2873a641d876" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '23831333532386435', 'path': '/dev/sdi'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831333532386435', 'path': '/dev/sdi'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.objects.instance [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lazy-loading 'flavor' on Instance uuid 561928fb-3c41-4937-8050-9125614c0641 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:51:56 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 19:51:56 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:51:56 user nova-compute[72504]:   <source dev="/dev/sdi"/>
Aug 01 19:51:56 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:51:56 user nova-compute[72504]:   <serial>4b87db97-7516-42d7-86af-a488fdca6032</serial>
Aug 01 19:51:56 user nova-compute[72504]: </disk>
Aug 01 19:51:56 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 19:51:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:51:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:51:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] No VIF found with MAC fa:16:3e:dc:6f:47, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-28d5c305-d664-4bdc-a21f-8db5d16d83fc tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lock "561928fb-3c41-4937-8050-9125614c0641" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.110s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aOJqIUbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:51:58 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:51:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.005s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:51:58 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:51:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:51:58 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d459999b-dd11-4f6e-9321-770fe1130f0e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:51:58 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[716edafc-477f-4433-87d5-d4b3765dcd72]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65] added
Aug 01 19:51:58 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[903ebf05-e281-4a49-8e00-3d211c7063f0]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b6dee4-74ed-41e0-b762-0c705b87b146]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aOJqIUbc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aOJqIUbc" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa5fe06-f787-4919-a764-2feff749ddeb]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aOJqIUbc'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[05624349-8429-4e01-851a-bc0b8503212e]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d31bedd-bbe2-4288-ba08-100f1e330532]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:51:58 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:51:58 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG nova.compute.manager [req-63d618a6-4ea0-4ee9-88be-a5e7af6d4bc1 req-b8bd405f-9e80-4440-9741-7426b89284ec service nova] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Received event network-vif-plugged-aee39726-8236-4507-8bec-fc1b40eafbba {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-63d618a6-4ea0-4ee9-88be-a5e7af6d4bc1 req-b8bd405f-9e80-4440-9741-7426b89284ec service nova] Acquiring lock "840f652e-bd31-4cb0-bd52-2873a641d876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-63d618a6-4ea0-4ee9-88be-a5e7af6d4bc1 req-b8bd405f-9e80-4440-9741-7426b89284ec service nova] Lock "840f652e-bd31-4cb0-bd52-2873a641d876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-63d618a6-4ea0-4ee9-88be-a5e7af6d4bc1 req-b8bd405f-9e80-4440-9741-7426b89284ec service nova] Lock "840f652e-bd31-4cb0-bd52-2873a641d876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG nova.compute.manager [req-63d618a6-4ea0-4ee9-88be-a5e7af6d4bc1 req-b8bd405f-9e80-4440-9741-7426b89284ec service nova] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] No waiting events found dispatching network-vif-plugged-aee39726-8236-4507-8bec-fc1b40eafbba {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:51:58 user nova-compute[72504]: WARNING nova.compute.manager [req-63d618a6-4ea0-4ee9-88be-a5e7af6d4bc1 req-b8bd405f-9e80-4440-9741-7426b89284ec service nova] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Received unexpected event network-vif-plugged-aee39726-8236-4507-8bec-fc1b40eafbba for instance with vm_state building and task_state spawning.
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98e3e23-fe5a-4d53-aa6c-09e03f5759eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65, portal: 172.16.0.220,3260]
Aug 01 19:51:58 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65, portal: 172.16.0.220,3260] successful.
Aug 01 19:51:58 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a450da-dd48-4e2d-9e68-650f952287fc]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0a7c67-1b5a-442a-b006-a2765de37624]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65 (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:51:58 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65 (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:51:58 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:51:58 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.393s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2da9de-c139-495d-8f94-acaede77e38a]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:51:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aOJqIUbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:51:59 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:51:59 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] <== connect_volume: return (1455ms) {'type': 'block', 'scsi_wwn': '23034613838326466', 'path': '/dev/sdj'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:51:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034613838326466', 'path': '/dev/sdj'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:51:59 user nova-compute[72504]: DEBUG nova.objects.instance [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lazy-loading 'flavor' on Instance uuid a8966321-946f-4988-83f5-c71cabb1c094 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:51:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 19:51:59 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:51:59 user nova-compute[72504]:   <source dev="/dev/sdj"/>
Aug 01 19:51:59 user nova-compute[72504]:   <target dev="sdc" bus="scsi"/>
Aug 01 19:51:59 user nova-compute[72504]:   <serial>6c8a63c2-9a6e-4913-bca7-a661f9390a65</serial>
Aug 01 19:51:59 user nova-compute[72504]:   <address type="drive" controller="0" unit="2"/>
Aug 01 19:51:59 user nova-compute[72504]: </disk>
Aug 01 19:51:59 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 19:51:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Acquiring lock "561928fb-3c41-4937-8050-9125614c0641" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:51:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Lock "561928fb-3c41-4937-8050-9125614c0641" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:51:59 user nova-compute[72504]: DEBUG os_brick.utils [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:51:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:59 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[373be780-8ac6-437c-918a-be8f7ba91849]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:59 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b44885-ae64-47d5-adf5-9c68f58151fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:51:59 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ac7676-aa4d-4cf2-9cd2-483923a5cd83]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:59 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d772839c-bd97-4570-9176-99f258d92e05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:51:59 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:51:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:51:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:51:59 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:51:59 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6740ce-90ff-4072-9d40-1fa3788f421b]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:51:59 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:51:59 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:51:59 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:51:59 user nova-compute[72504]: DEBUG os_brick.utils [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:52:00 user nova-compute[72504]: INFO nova.compute.manager [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] [instance: 561928fb-3c41-4937-8050-9125614c0641] Swapping volume 4b87db97-7516-42d7-86af-a488fdca6032 for 3564d168-3fb7-4b49-b507-e271adbb541e
Aug 01 19:52:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] No BDM found with device name sda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:52:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:52:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:52:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] No VIF found with MAC fa:16:3e:bd:89:6b, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:52:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b4ca8bc8-f4ff-4119-ad67-7e66f0335fef tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "a8966321-946f-4988-83f5-c71cabb1c094" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.583s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:00 user nova-compute[72504]: DEBUG nova.compute.manager [req-4c679553-a601-49f8-9f26-a1c27afb39f0 req-92c9f8b4-b519-4f4e-b17f-5fd523823537 service nova] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Received event network-vif-plugged-aee39726-8236-4507-8bec-fc1b40eafbba {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4c679553-a601-49f8-9f26-a1c27afb39f0 req-92c9f8b4-b519-4f4e-b17f-5fd523823537 service nova] Acquiring lock "840f652e-bd31-4cb0-bd52-2873a641d876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4c679553-a601-49f8-9f26-a1c27afb39f0 req-92c9f8b4-b519-4f4e-b17f-5fd523823537 service nova] Lock "840f652e-bd31-4cb0-bd52-2873a641d876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4c679553-a601-49f8-9f26-a1c27afb39f0 req-92c9f8b4-b519-4f4e-b17f-5fd523823537 service nova] Lock "840f652e-bd31-4cb0-bd52-2873a641d876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:00 user nova-compute[72504]: DEBUG nova.compute.manager [req-4c679553-a601-49f8-9f26-a1c27afb39f0 req-92c9f8b4-b519-4f4e-b17f-5fd523823537 service nova] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] No waiting events found dispatching network-vif-plugged-aee39726-8236-4507-8bec-fc1b40eafbba {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:52:00 user nova-compute[72504]: WARNING nova.compute.manager [req-4c679553-a601-49f8-9f26-a1c27afb39f0 req-92c9f8b4-b519-4f4e-b17f-5fd523823537 service nova] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Received unexpected event network-vif-plugged-aee39726-8236-4507-8bec-fc1b40eafbba for instance with vm_state building and task_state spawning.
Aug 01 19:52:00 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919520.8132677, 840f652e-bd31-4cb0-bd52-2873a641d876 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:52:00 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] VM Resumed (Lifecycle Event)
Aug 01 19:52:00 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:52:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:52:00 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Instance spawned successfully.
Aug 01 19:52:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 19:52:00 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:52:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:52:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:52:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:52:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:52:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:52:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:52:00 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:52:00 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:52:00 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919520.8180573, 840f652e-bd31-4cb0-bd52-2873a641d876 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:52:00 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] VM Started (Lifecycle Event)
Aug 01 19:52:00 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:52:00 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:52:00 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:52:00 user nova-compute[72504]: INFO nova.compute.manager [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Took 7.20 seconds to spawn the instance on the hypervisor.
Aug 01 19:52:00 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:52:01 user nova-compute[72504]: INFO nova.compute.manager [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Took 8.26 seconds to build instance.
Aug 01 19:52:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3d1b99d0-a7c7-41cc-aa3a-c5ed7a9e17e3 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "840f652e-bd31-4cb0-bd52-2873a641d876" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.537s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Acquiring lock "a8966321-946f-4988-83f5-c71cabb1c094" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "a8966321-946f-4988-83f5-c71cabb1c094" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:01 user nova-compute[72504]: INFO nova.compute.manager [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Detaching volume 6c8a63c2-9a6e-4913-bca7-a661f9390a65
Aug 01 19:52:01 user nova-compute[72504]: INFO nova.virt.block_device [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Attempting to driver detach volume 6c8a63c2-9a6e-4913-bca7-a661f9390a65 from mountpoint /dev/sdc
Aug 01 19:52:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Attempting to detach device sdc from instance a8966321-946f-4988-83f5-c71cabb1c094 from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 19:52:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:52:01 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:52:01 user nova-compute[72504]:   <source dev="/dev/sdj"/>
Aug 01 19:52:01 user nova-compute[72504]:   <target dev="sdc" bus="scsi"/>
Aug 01 19:52:01 user nova-compute[72504]:   <serial>6c8a63c2-9a6e-4913-bca7-a661f9390a65</serial>
Aug 01 19:52:01 user nova-compute[72504]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 01 19:52:01 user nova-compute[72504]: </disk>
Aug 01 19:52:01 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:52:01 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Successfully detached device sdc from instance a8966321-946f-4988-83f5-c71cabb1c094 from the persistent domain config.
Aug 01 19:52:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance a8966321-946f-4988-83f5-c71cabb1c094 from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 19:52:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:52:01 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:52:01 user nova-compute[72504]:   <source dev="/dev/sdj"/>
Aug 01 19:52:01 user nova-compute[72504]:   <target dev="sdc" bus="scsi"/>
Aug 01 19:52:01 user nova-compute[72504]:   <serial>6c8a63c2-9a6e-4913-bca7-a661f9390a65</serial>
Aug 01 19:52:01 user nova-compute[72504]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 01 19:52:01 user nova-compute[72504]: </disk>
Aug 01 19:52:01 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690919522.0250418, a8966321-946f-4988-83f5-c71cabb1c094 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance a8966321-946f-4988-83f5-c71cabb1c094 {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 19:52:02 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Successfully detached device sdc from instance a8966321-946f-4988-83f5-c71cabb1c094 from the live domain config.
Aug 01 19:52:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aOJqIUbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:52:02 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:52:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f0cff1-8cfe-425e-ba00-0e76034e68a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce20022-6a14-44d7-a16d-8d2296c0a024]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)
Aug 01 19:52:02 user nova-compute[72504]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65 (non-flash)
Aug 01 19:52:02 user nova-compute[72504]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:52:02 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:52:02 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:52:02 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:02 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:02 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:02 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:02 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)
Aug 01 19:52:02 user nova-compute[72504]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65 (non-flash)
Aug 01 19:52:02 user nova-compute[72504]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:52:02 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:52:02 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:52:02 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:02 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:02 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:02 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:02 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff40c10c5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65'): ({'sdj'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Removing single pathed devices sdj {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d4536f-365e-48ce-a34e-443531c1ad70]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5dcfb5-3f62-47ec-996b-c98f0156aa37]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Flushing IO for device /dev/sdj {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a011dc25-d3b4-4469-a720-a3690cbbcbcc]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.052s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae4b035-d43b-4368-9e96-980b3927bdac]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] SCSI volumes sdj have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[232f02f2-43be-413e-a797-f24162e65487]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb49b816-eef1-43ab-8fb5-14359d694dc4]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65, portal: 172.16.0.220,3260]
Aug 01 19:52:02 user nova-compute[72504]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65, portal: 172.16.0.220,3260] successful.
Aug 01 19:52:02 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c8a63c2-9a6e-4913-bca7-a661f9390a65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d56a0c-985d-47a8-9851-b2be0629cafb]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] <== disconnect_volume: return (384ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:52:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG nova.objects.instance [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lazy-loading 'flavor' on Instance uuid a8966321-946f-4988-83f5-c71cabb1c094 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZLrYucls', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:52:03 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:52:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:52:03 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:52:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:52:03 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[606a4a10-1f94-47f8-aede-eb036fc19b8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:52:03 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-eb71105d-787f-448d-bc31-4738929fe7ac tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "a8966321-946f-4988-83f5-c71cabb1c094" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.057s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2ed02a-9214-44fa-8a08-ef3b88ef11b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8] added
Aug 01 19:52:03 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[696e8a93-8997-4bd2-a535-6a2dbc540d03]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff169f52-55a5-4e39-85a8-4229e5244ce2]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZLrYucls {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZLrYucls" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[18db4732-8183-4c40-b410-e06a0f22b8da]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZLrYucls'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[30753620-9ca5-4819-9123-ebf0ba127c68]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c293ba71-7b91-48f3-8274-27491c58116b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:03 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:03 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fb10c9-1489-47cc-b8be-0559d673408c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8, portal: 172.16.0.220,3260]
Aug 01 19:52:03 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8, portal: 172.16.0.220,3260] successful.
Aug 01 19:52:03 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d8de7c-6cc6-4cc8-ac22-4540d2283310]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[248498ff-614b-4924-9f1d-b0c849eb0933]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8 (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:03 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8 (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:03 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:03 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] HCTL ('41', '-', '-', 0) found on session 12 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb056cc7-5712-4a8d-82b0-be05b84c3dc0]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:03 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: None {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:52:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f0e6d927-9da5-4dfc-b82a-4047fccbb55f tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Acquiring lock "a8966321-946f-4988-83f5-c71cabb1c094" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f0e6d927-9da5-4dfc-b82a-4047fccbb55f tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "a8966321-946f-4988-83f5-c71cabb1c094" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f0e6d927-9da5-4dfc-b82a-4047fccbb55f tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Acquiring lock "a8966321-946f-4988-83f5-c71cabb1c094-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f0e6d927-9da5-4dfc-b82a-4047fccbb55f tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "a8966321-946f-4988-83f5-c71cabb1c094-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f0e6d927-9da5-4dfc-b82a-4047fccbb55f tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "a8966321-946f-4988-83f5-c71cabb1c094-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:04 user nova-compute[72504]: INFO nova.compute.manager [None req-f0e6d927-9da5-4dfc-b82a-4047fccbb55f tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Terminating instance
Aug 01 19:52:04 user nova-compute[72504]: DEBUG nova.compute.manager [None req-f0e6d927-9da5-4dfc-b82a-4047fccbb55f tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 19:52:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-af345dc8-d11c-4929-883a-473b904910c4 req-179319a2-a368-42d0-953e-e1414f71da5c service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Received event network-vif-unplugged-6698435e-de04-4c41-8f14-356dd152aa0d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-af345dc8-d11c-4929-883a-473b904910c4 req-179319a2-a368-42d0-953e-e1414f71da5c service nova] Acquiring lock "a8966321-946f-4988-83f5-c71cabb1c094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-af345dc8-d11c-4929-883a-473b904910c4 req-179319a2-a368-42d0-953e-e1414f71da5c service nova] Lock "a8966321-946f-4988-83f5-c71cabb1c094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-af345dc8-d11c-4929-883a-473b904910c4 req-179319a2-a368-42d0-953e-e1414f71da5c service nova] Lock "a8966321-946f-4988-83f5-c71cabb1c094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-af345dc8-d11c-4929-883a-473b904910c4 req-179319a2-a368-42d0-953e-e1414f71da5c service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] No waiting events found dispatching network-vif-unplugged-6698435e-de04-4c41-8f14-356dd152aa0d {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:52:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-af345dc8-d11c-4929-883a-473b904910c4 req-179319a2-a368-42d0-953e-e1414f71da5c service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Received event network-vif-unplugged-6698435e-de04-4c41-8f14-356dd152aa0d for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:52:04 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:52:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZLrYucls', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:52:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:52:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '23633636438356437', 'path': '/dev/sdj'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:52:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633636438356437', 'path': '/dev/sdj'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:52:04 user nova-compute[72504]: DEBUG nova.objects.instance [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lazy-loading 'flavor' on Instance uuid c9fd391d-51c0-4ef9-86cc-5ce2c76c177a {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:52:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 19:52:04 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:52:04 user nova-compute[72504]:   <source dev="/dev/sdj"/>
Aug 01 19:52:04 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:52:04 user nova-compute[72504]:   <serial>c8c1eb1a-fa84-484b-94e3-ef248f4742f8</serial>
Aug 01 19:52:04 user nova-compute[72504]: </disk>
Aug 01 19:52:04 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 19:52:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:05 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Instance destroyed successfully.
Aug 01 19:52:05 user nova-compute[72504]: DEBUG nova.objects.instance [None req-f0e6d927-9da5-4dfc-b82a-4047fccbb55f tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lazy-loading 'resources' on Instance uuid a8966321-946f-4988-83f5-c71cabb1c094 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:52:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-f0e6d927-9da5-4dfc-b82a-4047fccbb55f tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:49:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1681496768',display_name='tempest-AttachSCSIVolumeTestJSON-server-1681496768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1681496768',id=6,image_ref='608990c8-07be-45f7-84d1-1ba4d0d390d6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTafKCY44Fzr43KaPS96ziwv+rxw+O+c49opwupGkQLUaS3Hg0ovp6ybqVBUHcBDN365QGu/f5jDFSmp+B9ddflmSL8wop3loCxBBcDxSde3Ig9vk3+IP0Iu5Os/me4nQ==',key_name='tempest-keypair-636030287',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:50:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4f8a671a5994b72a02f99185c5838cf',ramdisk_id='',reservation_id='r-tr8nwqwi',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='608990c8-07be-45f7-84d1-1ba4d0d390d6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2019072662',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2019072662-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:50:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2fcce6ceaee4043a7aaac1d550884d6',uuid=a8966321-946f-4988-83f5-c71cabb1c094,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6698435e-de04-4c41-8f14-356dd152aa0d", "address": "fa:16:3e:bd:89:6b", "network": {"id": "4c56cdef-5441-46f2-abda-780f3573ccaf", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1603717847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4f8a671a5994b72a02f99185c5838cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6698435e-de", "ovs_interfaceid": "6698435e-de04-4c41-8f14-356dd152aa0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:52:05 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-f0e6d927-9da5-4dfc-b82a-4047fccbb55f tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Converting VIF {"id": "6698435e-de04-4c41-8f14-356dd152aa0d", "address": "fa:16:3e:bd:89:6b", "network": {"id": "4c56cdef-5441-46f2-abda-780f3573ccaf", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1603717847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4f8a671a5994b72a02f99185c5838cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6698435e-de", "ovs_interfaceid": "6698435e-de04-4c41-8f14-356dd152aa0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:52:05 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-f0e6d927-9da5-4dfc-b82a-4047fccbb55f tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:89:6b,bridge_name='br-int',has_traffic_filtering=True,id=6698435e-de04-4c41-8f14-356dd152aa0d,network=Network(4c56cdef-5441-46f2-abda-780f3573ccaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6698435e-de') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:52:05 user nova-compute[72504]: DEBUG os_vif [None req-f0e6d927-9da5-4dfc-b82a-4047fccbb55f tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:89:6b,bridge_name='br-int',has_traffic_filtering=True,id=6698435e-de04-4c41-8f14-356dd152aa0d,network=Network(4c56cdef-5441-46f2-abda-780f3573ccaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6698435e-de') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:52:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6698435e-de, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:52:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:05 user nova-compute[72504]: INFO os_vif [None req-f0e6d927-9da5-4dfc-b82a-4047fccbb55f tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:89:6b,bridge_name='br-int',has_traffic_filtering=True,id=6698435e-de04-4c41-8f14-356dd152aa0d,network=Network(4c56cdef-5441-46f2-abda-780f3573ccaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6698435e-de')
Aug 01 19:52:05 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-f0e6d927-9da5-4dfc-b82a-4047fccbb55f tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Deleting instance files /opt/stack/data/nova/instances/a8966321-946f-4988-83f5-c71cabb1c094_del
Aug 01 19:52:05 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-f0e6d927-9da5-4dfc-b82a-4047fccbb55f tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Deletion of /opt/stack/data/nova/instances/a8966321-946f-4988-83f5-c71cabb1c094_del complete
Aug 01 19:52:05 user nova-compute[72504]: INFO nova.compute.manager [None req-f0e6d927-9da5-4dfc-b82a-4047fccbb55f tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 01 19:52:05 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-f0e6d927-9da5-4dfc-b82a-4047fccbb55f tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 19:52:05 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 19:52:05 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: a8966321-946f-4988-83f5-c71cabb1c094] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 19:52:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:52:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:52:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] No VIF found with MAC fa:16:3e:45:86:19, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:52:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2c2bd8fa-351c-461c-8444-96197582a589 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.991s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:06 user nova-compute[72504]: DEBUG nova.compute.manager [req-ee9678bd-d987-48aa-93a5-75767224221b req-3d5ae564-eb60-4885-ae70-62e548c133a3 service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Received event network-vif-plugged-6698435e-de04-4c41-8f14-356dd152aa0d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ee9678bd-d987-48aa-93a5-75767224221b req-3d5ae564-eb60-4885-ae70-62e548c133a3 service nova] Acquiring lock "a8966321-946f-4988-83f5-c71cabb1c094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ee9678bd-d987-48aa-93a5-75767224221b req-3d5ae564-eb60-4885-ae70-62e548c133a3 service nova] Lock "a8966321-946f-4988-83f5-c71cabb1c094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ee9678bd-d987-48aa-93a5-75767224221b req-3d5ae564-eb60-4885-ae70-62e548c133a3 service nova] Lock "a8966321-946f-4988-83f5-c71cabb1c094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:06 user nova-compute[72504]: DEBUG nova.compute.manager [req-ee9678bd-d987-48aa-93a5-75767224221b req-3d5ae564-eb60-4885-ae70-62e548c133a3 service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] No waiting events found dispatching network-vif-plugged-6698435e-de04-4c41-8f14-356dd152aa0d {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:52:06 user nova-compute[72504]: WARNING nova.compute.manager [req-ee9678bd-d987-48aa-93a5-75767224221b req-3d5ae564-eb60-4885-ae70-62e548c133a3 service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Received unexpected event network-vif-plugged-6698435e-de04-4c41-8f14-356dd152aa0d for instance with vm_state active and task_state deleting.
Aug 01 19:52:06 user nova-compute[72504]: DEBUG nova.compute.manager [req-ee9678bd-d987-48aa-93a5-75767224221b req-3d5ae564-eb60-4885-ae70-62e548c133a3 service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Received event network-vif-plugged-6698435e-de04-4c41-8f14-356dd152aa0d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ee9678bd-d987-48aa-93a5-75767224221b req-3d5ae564-eb60-4885-ae70-62e548c133a3 service nova] Acquiring lock "a8966321-946f-4988-83f5-c71cabb1c094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ee9678bd-d987-48aa-93a5-75767224221b req-3d5ae564-eb60-4885-ae70-62e548c133a3 service nova] Lock "a8966321-946f-4988-83f5-c71cabb1c094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ee9678bd-d987-48aa-93a5-75767224221b req-3d5ae564-eb60-4885-ae70-62e548c133a3 service nova] Lock "a8966321-946f-4988-83f5-c71cabb1c094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:06 user nova-compute[72504]: DEBUG nova.compute.manager [req-ee9678bd-d987-48aa-93a5-75767224221b req-3d5ae564-eb60-4885-ae70-62e548c133a3 service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] No waiting events found dispatching network-vif-plugged-6698435e-de04-4c41-8f14-356dd152aa0d {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:52:06 user nova-compute[72504]: WARNING nova.compute.manager [req-ee9678bd-d987-48aa-93a5-75767224221b req-3d5ae564-eb60-4885-ae70-62e548c133a3 service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Received unexpected event network-vif-plugged-6698435e-de04-4c41-8f14-356dd152aa0d for instance with vm_state active and task_state deleting.
Aug 01 19:52:06 user nova-compute[72504]: DEBUG nova.compute.manager [req-ee9678bd-d987-48aa-93a5-75767224221b req-3d5ae564-eb60-4885-ae70-62e548c133a3 service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Received event network-vif-plugged-6698435e-de04-4c41-8f14-356dd152aa0d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ee9678bd-d987-48aa-93a5-75767224221b req-3d5ae564-eb60-4885-ae70-62e548c133a3 service nova] Acquiring lock "a8966321-946f-4988-83f5-c71cabb1c094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ee9678bd-d987-48aa-93a5-75767224221b req-3d5ae564-eb60-4885-ae70-62e548c133a3 service nova] Lock "a8966321-946f-4988-83f5-c71cabb1c094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ee9678bd-d987-48aa-93a5-75767224221b req-3d5ae564-eb60-4885-ae70-62e548c133a3 service nova] Lock "a8966321-946f-4988-83f5-c71cabb1c094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:06 user nova-compute[72504]: DEBUG nova.compute.manager [req-ee9678bd-d987-48aa-93a5-75767224221b req-3d5ae564-eb60-4885-ae70-62e548c133a3 service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] No waiting events found dispatching network-vif-plugged-6698435e-de04-4c41-8f14-356dd152aa0d {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:52:06 user nova-compute[72504]: WARNING nova.compute.manager [req-ee9678bd-d987-48aa-93a5-75767224221b req-3d5ae564-eb60-4885-ae70-62e548c133a3 service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Received unexpected event network-vif-plugged-6698435e-de04-4c41-8f14-356dd152aa0d for instance with vm_state active and task_state deleting.
Aug 01 19:52:06 user nova-compute[72504]: DEBUG nova.compute.manager [req-ee9678bd-d987-48aa-93a5-75767224221b req-3d5ae564-eb60-4885-ae70-62e548c133a3 service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Received event network-vif-unplugged-6698435e-de04-4c41-8f14-356dd152aa0d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ee9678bd-d987-48aa-93a5-75767224221b req-3d5ae564-eb60-4885-ae70-62e548c133a3 service nova] Acquiring lock "a8966321-946f-4988-83f5-c71cabb1c094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ee9678bd-d987-48aa-93a5-75767224221b req-3d5ae564-eb60-4885-ae70-62e548c133a3 service nova] Lock "a8966321-946f-4988-83f5-c71cabb1c094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ee9678bd-d987-48aa-93a5-75767224221b req-3d5ae564-eb60-4885-ae70-62e548c133a3 service nova] Lock "a8966321-946f-4988-83f5-c71cabb1c094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:06 user nova-compute[72504]: DEBUG nova.compute.manager [req-ee9678bd-d987-48aa-93a5-75767224221b req-3d5ae564-eb60-4885-ae70-62e548c133a3 service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] No waiting events found dispatching network-vif-unplugged-6698435e-de04-4c41-8f14-356dd152aa0d {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:52:06 user nova-compute[72504]: DEBUG nova.compute.manager [req-ee9678bd-d987-48aa-93a5-75767224221b req-3d5ae564-eb60-4885-ae70-62e548c133a3 service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Received event network-vif-unplugged-6698435e-de04-4c41-8f14-356dd152aa0d for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:52:06 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:52:06 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Took 1.73 seconds to deallocate network for instance.
Aug 01 19:52:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f0e6d927-9da5-4dfc-b82a-4047fccbb55f tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f0e6d927-9da5-4dfc-b82a-4047fccbb55f tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:07 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-f0e6d927-9da5-4dfc-b82a-4047fccbb55f tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:52:07 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-f0e6d927-9da5-4dfc-b82a-4047fccbb55f tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:52:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f0e6d927-9da5-4dfc-b82a-4047fccbb55f tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:07 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-f0e6d927-9da5-4dfc-b82a-4047fccbb55f tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Deleted allocations for instance a8966321-946f-4988-83f5-c71cabb1c094
Aug 01 19:52:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f0e6d927-9da5-4dfc-b82a-4047fccbb55f tempest-AttachSCSIVolumeTestJSON-2019072662 tempest-AttachSCSIVolumeTestJSON-2019072662-project-member] Lock "a8966321-946f-4988-83f5-c71cabb1c094" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.587s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Acquiring lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:07 user nova-compute[72504]: INFO nova.compute.manager [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Detaching volume c8c1eb1a-fa84-484b-94e3-ef248f4742f8
Aug 01 19:52:07 user nova-compute[72504]: INFO nova.virt.block_device [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Attempting to driver detach volume c8c1eb1a-fa84-484b-94e3-ef248f4742f8 from mountpoint /dev/vdb
Aug 01 19:52:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Attempting to detach device vdb from instance c9fd391d-51c0-4ef9-86cc-5ce2c76c177a from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 19:52:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:52:07 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:52:07 user nova-compute[72504]:   <source dev="/dev/sdj"/>
Aug 01 19:52:07 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:52:07 user nova-compute[72504]:   <serial>c8c1eb1a-fa84-484b-94e3-ef248f4742f8</serial>
Aug 01 19:52:07 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 19:52:07 user nova-compute[72504]: </disk>
Aug 01 19:52:07 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:52:07 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Successfully detached device vdb from instance c9fd391d-51c0-4ef9-86cc-5ce2c76c177a from the persistent domain config.
Aug 01 19:52:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c9fd391d-51c0-4ef9-86cc-5ce2c76c177a from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 19:52:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:52:07 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:52:07 user nova-compute[72504]:   <source dev="/dev/sdj"/>
Aug 01 19:52:07 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:52:07 user nova-compute[72504]:   <serial>c8c1eb1a-fa84-484b-94e3-ef248f4742f8</serial>
Aug 01 19:52:07 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 19:52:07 user nova-compute[72504]: </disk>
Aug 01 19:52:07 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690919528.3947444, c9fd391d-51c0-4ef9-86cc-5ce2c76c177a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c9fd391d-51c0-4ef9-86cc-5ce2c76c177a {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 19:52:08 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Successfully detached device vdb from instance c9fd391d-51c0-4ef9-86cc-5ce2c76c177a from the live domain config.
Aug 01 19:52:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZLrYucls', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:52:08 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:52:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e51ea4-0ac6-4292-8b4c-9a56a8772bd0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc14b8b5-775f-4a11-9eea-14db698122da]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)
Aug 01 19:52:08 user nova-compute[72504]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8 (non-flash)
Aug 01 19:52:08 user nova-compute[72504]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:52:08 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:52:08 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:52:08 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:08 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:08 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:08 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:08 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)
Aug 01 19:52:08 user nova-compute[72504]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8 (non-flash)
Aug 01 19:52:08 user nova-compute[72504]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:52:08 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:52:08 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:52:08 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:08 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:08 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:08 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:08 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff4140d8670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8'): ({'sdj'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Removing single pathed devices sdj {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[49dceaf0-2c72-4153-822c-d1b4d1d16fab]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb12f0cf-adea-47aa-bc95-e1caaf5c2d73]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Flushing IO for device /dev/sdj {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe8ecc9-e677-4109-a74f-e8653c7cde0c]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.043s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a50cfc1-818b-4aac-99b2-4b565eb277d1]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] SCSI volumes sdj have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf8155c-999d-47b4-94e9-2c3ef75a90dc]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG nova.compute.manager [req-cf99f382-55fe-493a-b70b-ff09c2a36e8f req-f88f916f-52c8-4ef3-8ff9-7169ac40687b service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Received event network-vif-plugged-6698435e-de04-4c41-8f14-356dd152aa0d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cf99f382-55fe-493a-b70b-ff09c2a36e8f req-f88f916f-52c8-4ef3-8ff9-7169ac40687b service nova] Acquiring lock "a8966321-946f-4988-83f5-c71cabb1c094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cf99f382-55fe-493a-b70b-ff09c2a36e8f req-f88f916f-52c8-4ef3-8ff9-7169ac40687b service nova] Lock "a8966321-946f-4988-83f5-c71cabb1c094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cf99f382-55fe-493a-b70b-ff09c2a36e8f req-f88f916f-52c8-4ef3-8ff9-7169ac40687b service nova] Lock "a8966321-946f-4988-83f5-c71cabb1c094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG nova.compute.manager [req-cf99f382-55fe-493a-b70b-ff09c2a36e8f req-f88f916f-52c8-4ef3-8ff9-7169ac40687b service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] No waiting events found dispatching network-vif-plugged-6698435e-de04-4c41-8f14-356dd152aa0d {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:52:08 user nova-compute[72504]: WARNING nova.compute.manager [req-cf99f382-55fe-493a-b70b-ff09c2a36e8f req-f88f916f-52c8-4ef3-8ff9-7169ac40687b service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Received unexpected event network-vif-plugged-6698435e-de04-4c41-8f14-356dd152aa0d for instance with vm_state deleted and task_state None.
Aug 01 19:52:08 user nova-compute[72504]: DEBUG nova.compute.manager [req-cf99f382-55fe-493a-b70b-ff09c2a36e8f req-f88f916f-52c8-4ef3-8ff9-7169ac40687b service nova] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Received event network-vif-deleted-6698435e-de04-4c41-8f14-356dd152aa0d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37f776e-7091-43f1-b24e-ab3f420840ca]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8, portal: 172.16.0.220,3260]
Aug 01 19:52:08 user nova-compute[72504]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8, portal: 172.16.0.220,3260] successful.
Aug 01 19:52:08 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c1eb1a-fa84-484b-94e3-ef248f4742f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[89df97fc-12b3-4046-9b53-eae96a9b1c66]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] <== disconnect_volume: return (339ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:52:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:52:09 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:52:10 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:10 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] [instance: 561928fb-3c41-4937-8050-9125614c0641] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaxhQRrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '561928fb-3c41-4937-8050-9125614c0641', 'attached_at': '', 'detached_at': '', 'volume_id': '3564d168-3fb7-4b49-b507-e271adbb541e', 'serial': '3564d168-3fb7-4b49-b507-e271adbb541e'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqCxSyTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '561928fb-3c41-4937-8050-9125614c0641', 'attached_at': '', 'detached_at': '', 'volume_id': '4b87db97-7516-42d7-86af-a488fdca6032', 'serial'} {{(pid=72504) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 01 19:52:10 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] [instance: 561928fb-3c41-4937-8050-9125614c0641] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:52:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaxhQRrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:52:10 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:52:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:52:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:52:10 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:52:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:52:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:52:10 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:52:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:10 user nova-compute[72504]: DEBUG nova.objects.instance [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lazy-loading 'flavor' on Instance uuid c9fd391d-51c0-4ef9-86cc-5ce2c76c177a {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:52:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:10 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdcb521-f5df-4287-a1c5-c1177fd7a1f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:52:10 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-616536de-5acc-4c73-8191-f8b5b6808585 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.215s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f19873-25de-4a4a-8273-265ace3d4a9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e] added
Aug 01 19:52:11 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[014a9938-5d7e-49d8-a6ae-76033f6916c1]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b865c4-111f-48fb-b7bb-6d49dd8c48c8]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YaxhQRrp {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YaxhQRrp" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[79af74f1-d819-4eba-ba4f-c310d8ea2005]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YaxhQRrp'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[39af469a-3005-447e-8b5a-830b4fa63015]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe2e153-b241-4b63-8d91-6a5c57843820]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:11 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:11 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[800accb1-e656-4d2d-be8a-d5e6e460b24e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e, portal: 172.16.0.220,3260]
Aug 01 19:52:11 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e, portal: 172.16.0.220,3260] successful.
Aug 01 19:52:11 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82d3094-1b9e-49f6-8058-1b9cd02fbbb3]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bc62f1-9600-4e4c-bca4-0bad8662a28d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:11 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:11 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:11 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] HCTL ('41', '-', '-', 0) found on session 13 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc483227-e316-4511-9b3d-015585ead903]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Searching for a device in session 13 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaxhQRrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:52:11 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:52:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:52:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '26335383637333032', 'path': '/dev/sdj'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:52:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] [instance: 561928fb-3c41-4937-8050-9125614c0641] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335383637333032', 'path': '/dev/sdj'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:52:12 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Lazy-loading 'flavor' on Instance uuid 561928fb-3c41-4937-8050-9125614c0641 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:52:12 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:52:12 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:52:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] COPY block job progress, current cursor: 9437184 final cursor: 1073741824 {{(pid=72504) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 19:52:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:12 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:52:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] COPY block job progress, current cursor: 148897792 final cursor: 1073741824 {{(pid=72504) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 19:52:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:52:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/840f652e-bd31-4cb0-bd52-2873a641d876/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/840f652e-bd31-4cb0-bd52-2873a641d876/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/840f652e-bd31-4cb0-bd52-2873a641d876/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/840f652e-bd31-4cb0-bd52-2873a641d876/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] COPY block job progress, current cursor: 316669952 final cursor: 1073741824 {{(pid=72504) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 19:52:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:52:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] COPY block job progress, current cursor: 378535936 final cursor: 1073741824 {{(pid=72504) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 19:52:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:52:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:52:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:52:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] COPY block job progress, current cursor: 499122176 final cursor: 1073741824 {{(pid=72504) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 19:52:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:52:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:52:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:52:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] COPY block job progress, current cursor: 584056832 final cursor: 1073741824 {{(pid=72504) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 19:52:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] COPY block job progress, current cursor: 830472192 final cursor: 1073741824 {{(pid=72504) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 19:52:16 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:52:16 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:52:16 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=7315MB free_disk=25.534347534179688GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:52:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:16 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:52:16 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 5193c770-80ca-44c3-9950-cb25c65e94e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:52:16 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1de87977-532f-45f7-856b-84df41b2a567 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:52:16 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 561928fb-3c41-4937-8050-9125614c0641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:52:16 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance c9fd391d-51c0-4ef9-86cc-5ce2c76c177a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:52:16 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:52:16 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 85816260-b37b-4b9e-9b52-f823120645aa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:52:16 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 840f652e-bd31-4cb0-bd52-2873a641d876 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:52:16 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:52:16 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:52:16 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:52:16 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:52:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] COPY block job progress, current cursor: 990904320 final cursor: 1073741824 {{(pid=72504) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 19:52:16 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:52:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.532s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72504) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] [instance: 561928fb-3c41-4937-8050-9125614c0641] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqCxSyTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:52:17 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:52:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae7b122-1399-467a-bf1a-1590ea3da8d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebedca6-70f5-4fa7-8760-feb8fefd603b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)
Aug 01 19:52:17 user nova-compute[72504]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e (non-flash)
Aug 01 19:52:17 user nova-compute[72504]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:52:17 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:52:17 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:52:17 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:17 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:17 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:17 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:17 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)
Aug 01 19:52:17 user nova-compute[72504]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e (non-flash)
Aug 01 19:52:17 user nova-compute[72504]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:52:17 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:52:17 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:52:17 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:17 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:17 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:17 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:17 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff41a8e0ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032'): ({'sdi'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Removing single pathed devices sdi {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[942f6147-260e-4950-bb15-76d66ff18f62]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf0a00a-3cd8-40a4-8cdd-8acb889a7916]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Flushing IO for device /dev/sdi {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaccb3aa-8fde-4d0a-b8c6-6fcaa6735ad1]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.056s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8667ee-6d18-418d-a1ba-0ffc9977be43]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] SCSI volumes sdi have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7009c35-bb79-4929-81b6-13985ecdd9af]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ea3bb6-84a5-48fe-992b-1adea7b0ee0b]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032, portal: 172.16.0.220,3260]
Aug 01 19:52:17 user nova-compute[72504]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032, portal: 172.16.0.220,3260] successful.
Aug 01 19:52:17 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8074b6-9641-438e-a9cc-3c7ee4f501f2]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] <== disconnect_volume: return (336ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] [instance: 561928fb-3c41-4937-8050-9125614c0641] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaxhQRrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '561928fb-3c41-4937-8050-9125614c0641', 'attached_at': '', 'detached_at': '', 'volume_id': '3564d168-3fb7-4b49-b507-e271adbb541e', 'serial'} {{(pid=72504) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 01 19:52:17 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] [instance: 561928fb-3c41-4937-8050-9125614c0641] swap_volume: removing Cinder connection for volume 4b87db97-7516-42d7-86af-a488fdca6032 {{(pid=72504) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 01 19:52:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] [instance: 561928fb-3c41-4937-8050-9125614c0641] swap_volume: Updating volume 4b87db97-7516-42d7-86af-a488fdca6032 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "YaxhQRrp", "auth_password": "mVgy28O7iZ5NjL", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "3564d168-3fb7-4b49-b507-e271adbb541e"}, "status": "reserved", "instance": "561928fb-3c41-4937-8050-9125614c0641", "attached_at": "", "detached_at": "", "volume_id": "3564d168-3fb7-4b49-b507-e271adbb541e", "serial": "3564d168-3fb7-4b49-b507-e271adbb541e"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '3564d168-3fb7-4b49-b507-e271adbb541e', 'no_device': None, 'attachment_id': '5d9ee767-8f94-4150-bcaf-50bbcadda6b2'} {{(pid=72504) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 01 19:52:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e6f2635e-def5-4808-a73d-1cddb3d73d0c tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Lock "561928fb-3c41-4937-8050-9125614c0641" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.171s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:19 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:52:19 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690919525.0376453, a8966321-946f-4988-83f5-c71cabb1c094 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:52:20 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: a8966321-946f-4988-83f5-c71cabb1c094] VM Stopped (Lifecycle Event)
Aug 01 19:52:20 user nova-compute[72504]: DEBUG nova.compute.manager [None req-acd4ea54-512f-4591-be82-15f1ccdcae09 None None] [instance: a8966321-946f-4988-83f5-c71cabb1c094] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-5193c770-80ca-44c3-9950-cb25c65e94e8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-5193c770-80ca-44c3-9950-cb25c65e94e8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Acquiring lock "561928fb-3c41-4937-8050-9125614c0641" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Lock "561928fb-3c41-4937-8050-9125614c0641" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG os_brick.utils [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[818652af-abca-47f6-b97a-4824768fd0e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee0ad29-0e86-43a9-8410-0144ebd303de]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[94494ed7-671b-499c-8c84-58a4706bc6f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23e1156-c683-4640-a334-0f5308b38abc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Updating instance_info_cache with network_info: [{"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:52:20 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:52:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc25f67-e5a5-4202-a433-d9ef52271149]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG os_brick.utils [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-5193c770-80ca-44c3-9950-cb25c65e94e8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:52:20 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:52:20 user nova-compute[72504]: INFO nova.compute.manager [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] [instance: 561928fb-3c41-4937-8050-9125614c0641] Swapping volume 3564d168-3fb7-4b49-b507-e271adbb541e for 4b87db97-7516-42d7-86af-a488fdca6032
Aug 01 19:52:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "7391a8ce-7ce5-47ec-97f6-6159645688ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:26 user nova-compute[72504]: DEBUG nova.compute.manager [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 19:52:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:27 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:52:27 user nova-compute[72504]: INFO nova.compute.claims [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Claim successful on node user
Aug 01 19:52:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:27 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:52:27 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:52:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:27 user nova-compute[72504]: DEBUG nova.compute.manager [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 19:52:27 user nova-compute[72504]: DEBUG nova.compute.manager [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 19:52:27 user nova-compute[72504]: DEBUG nova.network.neutron [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 19:52:27 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 19:52:27 user nova-compute[72504]: DEBUG nova.compute.manager [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 19:52:27 user nova-compute[72504]: DEBUG nova.policy [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01263cb2c1874026be1c735abc966b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82898c99bce4f04afda7e9ff6e4d5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 19:52:27 user nova-compute[72504]: INFO nova.virt.block_device [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Booting with blank volume at /dev/vda
Aug 01 19:52:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:28 user nova-compute[72504]: DEBUG nova.network.neutron [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Successfully created port: 2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG nova.compute.manager [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] [instance: 561928fb-3c41-4937-8050-9125614c0641] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqCxSyTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '561928fb-3c41-4937-8050-9125614c0641', 'attached_at': '', 'detached_at': '', 'volume_id': '4b87db97-7516-42d7-86af-a488fdca6032', 'serial': '4b87db97-7516-42d7-86af-a488fdca6032'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaxhQRrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '3564d168-3fb7-4b49-b507-e271adbb541e'}, 'status': 'reserved', 'instance': '561928fb-3c41-4937-8050-9125614c0641', 'attached_at': '', 'detached_at': '', 'volume_id': '3564d168-3fb7-4b49-b507-e271adbb541e', 'serial'} {{(pid=72504) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] [instance: 561928fb-3c41-4937-8050-9125614c0641] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqCxSyTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:52:29 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:52:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:52:29 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:52:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:52:29 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07dbc7f-1627-49b1-8b01-fd827b022f57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:52:29 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2408d0-ddda-4aa1-a1a5-cb97f0d192cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032] added
Aug 01 19:52:29 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[733eaa94-74bc-4833-9865-1d2c3b90911b]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG nova.network.neutron [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Successfully updated port: 2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "refresh_cache-7391a8ce-7ce5-47ec-97f6-6159645688ea" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquired lock "refresh_cache-7391a8ce-7ce5-47ec-97f6-6159645688ea" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG nova.network.neutron [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c691d33f-a284-4426-ac33-ea05d63febd7]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PqCxSyTX {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG nova.compute.manager [req-c35e598e-8124-4127-a5c8-f94430930afc req-666c7b9b-5e13-4a3d-96b7-dfc58ba7309a service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Received event network-changed-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG nova.compute.manager [req-c35e598e-8124-4127-a5c8-f94430930afc req-666c7b9b-5e13-4a3d-96b7-dfc58ba7309a service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Refreshing instance network info cache due to event network-changed-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c35e598e-8124-4127-a5c8-f94430930afc req-666c7b9b-5e13-4a3d-96b7-dfc58ba7309a service nova] Acquiring lock "refresh_cache-7391a8ce-7ce5-47ec-97f6-6159645688ea" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PqCxSyTX" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d3cdf9-57c9-468b-bd94-a8dc1b2bc4d5]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PqCxSyTX'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40a2dbc-1aa7-427c-909b-3dfa56b28d4f]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG nova.network.neutron [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e7b61b-036e-47b3-b2c8-3f678485d9ec]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:29 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:29 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d96dd71-4cdf-4782-b2ee-80b931022a21]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032, portal: 172.16.0.220,3260]
Aug 01 19:52:29 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032, portal: 172.16.0.220,3260] successful.
Aug 01 19:52:29 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfda8958-2fec-45c2-9c9a-5f8a2a41a431]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c01118-0743-4ae9-a081-438ee5708b17]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:29 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:29 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:29 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] HCTL ('40', '-', '-', 0) found on session 14 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5659199-b774-46ff-a254-baf49b669c57]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Searching for a device in session 14 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:52:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqCxSyTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:52:30 user nova-compute[72504]: DEBUG nova.network.neutron [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Updating instance_info_cache with network_info: [{"id": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "address": "fa:16:3e:08:82:e6", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd06cd7-81", "ovs_interfaceid": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:52:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Releasing lock "refresh_cache-7391a8ce-7ce5-47ec-97f6-6159645688ea" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:52:30 user nova-compute[72504]: DEBUG nova.compute.manager [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Instance network_info: |[{"id": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "address": "fa:16:3e:08:82:e6", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd06cd7-81", "ovs_interfaceid": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 19:52:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c35e598e-8124-4127-a5c8-f94430930afc req-666c7b9b-5e13-4a3d-96b7-dfc58ba7309a service nova] Acquired lock "refresh_cache-7391a8ce-7ce5-47ec-97f6-6159645688ea" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:52:30 user nova-compute[72504]: DEBUG nova.network.neutron [req-c35e598e-8124-4127-a5c8-f94430930afc req-666c7b9b-5e13-4a3d-96b7-dfc58ba7309a service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Refreshing network info cache for port 2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:52:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:30 user nova-compute[72504]: DEBUG nova.network.neutron [req-c35e598e-8124-4127-a5c8-f94430930afc req-666c7b9b-5e13-4a3d-96b7-dfc58ba7309a service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Updated VIF entry in instance network info cache for port 2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:52:30 user nova-compute[72504]: DEBUG nova.network.neutron [req-c35e598e-8124-4127-a5c8-f94430930afc req-666c7b9b-5e13-4a3d-96b7-dfc58ba7309a service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Updating instance_info_cache with network_info: [{"id": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "address": "fa:16:3e:08:82:e6", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd06cd7-81", "ovs_interfaceid": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:52:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c35e598e-8124-4127-a5c8-f94430930afc req-666c7b9b-5e13-4a3d-96b7-dfc58ba7309a service nova] Releasing lock "refresh_cache-7391a8ce-7ce5-47ec-97f6-6159645688ea" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:52:30 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:52:30 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '23831333532386435', 'path': '/dev/sdi'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:52:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] [instance: 561928fb-3c41-4937-8050-9125614c0641] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831333532386435', 'path': '/dev/sdi'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:52:30 user nova-compute[72504]: DEBUG nova.objects.instance [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Lazy-loading 'flavor' on Instance uuid 561928fb-3c41-4937-8050-9125614c0641 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:52:31 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72504) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 19:52:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] COPY block job progress, current cursor: 89128960 final cursor: 1073741824 {{(pid=72504) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 19:52:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] COPY block job progress, current cursor: 248512512 final cursor: 1073741824 {{(pid=72504) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 19:52:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] COPY block job progress, current cursor: 382730240 final cursor: 1073741824 {{(pid=72504) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 19:52:33 user nova-compute[72504]: DEBUG os_brick.utils [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:52:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e272cad2-ac31-4ab0-b31e-cb6a5bbdfba7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd0dd13-da21-4dea-b3e1-c7377f0b239a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] COPY block job progress, current cursor: 456130560 final cursor: 1073741824 {{(pid=72504) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 19:52:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[253029e5-ea95-4556-b032-ea00916ab7e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6384858b-deeb-4b9a-9bbd-8d599976ef52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:52:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:52:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:52:33 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:52:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9684e4-e20a-40f2-af95-36bd973c9924]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:52:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:52:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:52:33 user nova-compute[72504]: DEBUG os_brick.utils [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:52:33 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Updating existing volume attachment record: 2ceec72f-cb71-4c09-a6ce-c4b18ff336dd {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:52:34 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] COPY block job progress, current cursor: 612368384 final cursor: 1073741824 {{(pid=72504) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 19:52:34 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] COPY block job progress, current cursor: 789577728 final cursor: 1073741824 {{(pid=72504) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 19:52:35 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] COPY block job progress, current cursor: 880803840 final cursor: 1073741824 {{(pid=72504) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 19:52:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:35 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] COPY block job progress, current cursor: 1016070144 final cursor: 1073741824 {{(pid=72504) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 19:52:35 user nova-compute[72504]: DEBUG nova.compute.manager [req-5ed8258e-1a9c-436d-b43d-4c1b42f9a5d7 req-ec2d4aa7-5d93-406c-a9f0-b1351ec52dc5 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-changed-5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:35 user nova-compute[72504]: DEBUG nova.compute.manager [req-5ed8258e-1a9c-436d-b43d-4c1b42f9a5d7 req-ec2d4aa7-5d93-406c-a9f0-b1351ec52dc5 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Refreshing instance network info cache due to event network-changed-5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:52:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5ed8258e-1a9c-436d-b43d-4c1b42f9a5d7 req-ec2d4aa7-5d93-406c-a9f0-b1351ec52dc5 service nova] Acquiring lock "refresh_cache-6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:52:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5ed8258e-1a9c-436d-b43d-4c1b42f9a5d7 req-ec2d4aa7-5d93-406c-a9f0-b1351ec52dc5 service nova] Acquired lock "refresh_cache-6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:52:35 user nova-compute[72504]: DEBUG nova.network.neutron [req-5ed8258e-1a9c-436d-b43d-4c1b42f9a5d7 req-ec2d4aa7-5d93-406c-a9f0-b1351ec52dc5 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Refreshing network info cache for port 5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72504) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] [instance: 561928fb-3c41-4937-8050-9125614c0641] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaxhQRrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '3564d168-3fb7-4b49-b507-e271adbb541e'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:52:36 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:52:36 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd019fc-b2c4-402b-afa1-6bac2d1a1b67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f0d340-8524-4132-bd7f-b6ed9096622b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e (non-flash)
Aug 01 19:52:36 user nova-compute[72504]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)
Aug 01 19:52:36 user nova-compute[72504]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:52:36 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:52:36 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:52:36 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:36 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:36 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:36 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:36 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e (non-flash)
Aug 01 19:52:36 user nova-compute[72504]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)
Aug 01 19:52:36 user nova-compute[72504]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:52:36 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:52:36 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:52:36 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:36 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:36 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:36 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:36 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff41a8e2b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e'): ({'sdj'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Removing single pathed devices sdj {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[060f55a3-171b-43f0-9126-ba9993b38f8b]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e0a472-018a-4ee6-a4d0-8b16b1c2dcb4]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Flushing IO for device /dev/sdj {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1f8985-5c52-4ce0-9299-abc94122b4b9]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.047s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cddfcee-dea8-4d8c-9f89-65fcb91a8a4a]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] SCSI volumes sdj have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2682351e-8410-41b9-8929-245b8b943ffd]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd80a765-5e83-49c7-b6e3-7abf9e34f55f]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e, portal: 172.16.0.220,3260]
Aug 01 19:52:36 user nova-compute[72504]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e, portal: 172.16.0.220,3260] successful.
Aug 01 19:52:36 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3564d168-3fb7-4b49-b507-e271adbb541e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b6beca-2673-4861-9155-92e8f5768cf6]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] <== disconnect_volume: return (349ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] [instance: 561928fb-3c41-4937-8050-9125614c0641] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG nova.compute.manager [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqCxSyTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '561928fb-3c41-4937-8050-9125614c0641', 'attached_at': '', 'detached_at': '', 'volume_id': '4b87db97-7516-42d7-86af-a488fdca6032', 'serial'} {{(pid=72504) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 01 19:52:36 user nova-compute[72504]: DEBUG nova.compute.manager [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] [instance: 561928fb-3c41-4937-8050-9125614c0641] swap_volume: removing Cinder connection for volume 3564d168-3fb7-4b49-b507-e271adbb541e {{(pid=72504) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 01 19:52:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:37 user nova-compute[72504]: DEBUG nova.network.neutron [req-5ed8258e-1a9c-436d-b43d-4c1b42f9a5d7 req-ec2d4aa7-5d93-406c-a9f0-b1351ec52dc5 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Updated VIF entry in instance network info cache for port 5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:52:37 user nova-compute[72504]: DEBUG nova.network.neutron [req-5ed8258e-1a9c-436d-b43d-4c1b42f9a5d7 req-ec2d4aa7-5d93-406c-a9f0-b1351ec52dc5 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Updating instance_info_cache with network_info: [{"id": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "address": "fa:16:3e:b5:fc:7c", "network": {"id": "8ac53e2b-6d51-4d2e-b457-6b26a63bf383", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1111786338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d16fa4f-b0", "ovs_interfaceid": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "423f358a-b722-4561-8f80-0c53f295e565", "address": "fa:16:3e:9a:f0:25", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423f358a-b7", "ovs_interfaceid": "423f358a-b722-4561-8f80-0c53f295e565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16a739aa-8e59-4e49-9d81-2242527d12ab", "address": "fa:16:3e:6e:4f:3e", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a739aa-8e", "ovs_interfaceid": "16a739aa-8e59-4e49-9d81-2242527d12ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "97484d3b-3fdd-4ad3-8125-12117341441c", "address": "fa:16:3e:32:75:5c", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97484d3b-3f", "ovs_interfaceid": "97484d3b-3fdd-4ad3-8125-12117341441c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69b8504c-b89b-44af-9324-d6d096960909", "address": "fa:16:3e:5a:c6:3d", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8504c-b8", "ovs_interfaceid": "69b8504c-b89b-44af-9324-d6d096960909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "462a6ab8-f964-4dda-9286-2fca0955907b", "address": "fa:16:3e:10:19:52", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462a6ab8-f9", "ovs_interfaceid": "462a6ab8-f964-4dda-9286-2fca0955907b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f8fdda48-16be-4318-a84d-79d50154eec0", "address": "fa:16:3e:e0:ce:00", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8fdda48-16", "ovs_interfaceid": "f8fdda48-16be-4318-a84d-79d50154eec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:52:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5ed8258e-1a9c-436d-b43d-4c1b42f9a5d7 req-ec2d4aa7-5d93-406c-a9f0-b1351ec52dc5 service nova] Releasing lock "refresh_cache-6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:52:37 user nova-compute[72504]: DEBUG nova.compute.manager [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] [instance: 561928fb-3c41-4937-8050-9125614c0641] swap_volume: Updating volume 3564d168-3fb7-4b49-b507-e271adbb541e BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "PqCxSyTX", "auth_password": "cbv5ZiIX7Vqma1", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "4b87db97-7516-42d7-86af-a488fdca6032"}, "status": "reserved", "instance": "561928fb-3c41-4937-8050-9125614c0641", "attached_at": "", "detached_at": "", "volume_id": "4b87db97-7516-42d7-86af-a488fdca6032", "serial": "4b87db97-7516-42d7-86af-a488fdca6032"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '4b87db97-7516-42d7-86af-a488fdca6032', 'no_device': None, 'attachment_id': '4a8c6215-ecb5-4eee-be5a-cde07bac4ebc'} {{(pid=72504) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 01 19:52:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0dcb62c4-c922-43e7-a89b-4828bf71c01a tempest-TestVolumeSwap-230343222 tempest-TestVolumeSwap-230343222-project-admin] Lock "561928fb-3c41-4937-8050-9125614c0641" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.198s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:38 user nova-compute[72504]: INFO nova.compute.manager [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Terminating instance
Aug 01 19:52:38 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Acquiring lock "561928fb-3c41-4937-8050-9125614c0641" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lock "561928fb-3c41-4937-8050-9125614c0641" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:38 user nova-compute[72504]: INFO nova.compute.manager [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Detaching volume 4b87db97-7516-42d7-86af-a488fdca6032
Aug 01 19:52:38 user nova-compute[72504]: INFO nova.virt.block_device [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Attempting to driver detach volume 4b87db97-7516-42d7-86af-a488fdca6032 from mountpoint /dev/vdb
Aug 01 19:52:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Attempting to detach device vdb from instance 561928fb-3c41-4937-8050-9125614c0641 from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:52:38 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:52:38 user nova-compute[72504]:   <source dev="/dev/sdi"/>
Aug 01 19:52:38 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:52:38 user nova-compute[72504]:   <serial>4b87db97-7516-42d7-86af-a488fdca6032</serial>
Aug 01 19:52:38 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 19:52:38 user nova-compute[72504]: </disk>
Aug 01 19:52:38 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:38 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Successfully detached device vdb from instance 561928fb-3c41-4937-8050-9125614c0641 from the persistent domain config.
Aug 01 19:52:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 561928fb-3c41-4937-8050-9125614c0641 from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:52:38 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:52:38 user nova-compute[72504]:   <source dev="/dev/sdi"/>
Aug 01 19:52:38 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:52:38 user nova-compute[72504]:   <serial>4b87db97-7516-42d7-86af-a488fdca6032</serial>
Aug 01 19:52:38 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 19:52:38 user nova-compute[72504]: </disk>
Aug 01 19:52:38 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG nova.compute.manager [req-83bc7969-2abc-4904-becb-535ccbc3a3ad req-9a474ba8-db62-4fe6-8e85-2881046744d7 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-unplugged-423f358a-b722-4561-8f80-0c53f295e565 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-83bc7969-2abc-4904-becb-535ccbc3a3ad req-9a474ba8-db62-4fe6-8e85-2881046744d7 service nova] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-83bc7969-2abc-4904-becb-535ccbc3a3ad req-9a474ba8-db62-4fe6-8e85-2881046744d7 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-83bc7969-2abc-4904-becb-535ccbc3a3ad req-9a474ba8-db62-4fe6-8e85-2881046744d7 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG nova.compute.manager [req-83bc7969-2abc-4904-becb-535ccbc3a3ad req-9a474ba8-db62-4fe6-8e85-2881046744d7 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] No waiting events found dispatching network-vif-unplugged-423f358a-b722-4561-8f80-0c53f295e565 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG nova.compute.manager [req-83bc7969-2abc-4904-becb-535ccbc3a3ad req-9a474ba8-db62-4fe6-8e85-2881046744d7 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-unplugged-423f358a-b722-4561-8f80-0c53f295e565 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG nova.compute.manager [req-aca6e32d-3ea1-41ac-bda9-393bddfc9890 req-db2c7b6e-6a96-4d64-bb92-354222335b81 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-unplugged-5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-aca6e32d-3ea1-41ac-bda9-393bddfc9890 req-db2c7b6e-6a96-4d64-bb92-354222335b81 service nova] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-aca6e32d-3ea1-41ac-bda9-393bddfc9890 req-db2c7b6e-6a96-4d64-bb92-354222335b81 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-aca6e32d-3ea1-41ac-bda9-393bddfc9890 req-db2c7b6e-6a96-4d64-bb92-354222335b81 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG nova.compute.manager [req-aca6e32d-3ea1-41ac-bda9-393bddfc9890 req-db2c7b6e-6a96-4d64-bb92-354222335b81 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] No waiting events found dispatching network-vif-unplugged-5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG nova.compute.manager [req-aca6e32d-3ea1-41ac-bda9-393bddfc9890 req-db2c7b6e-6a96-4d64-bb92-354222335b81 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-unplugged-5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690919558.9843886, 561928fb-3c41-4937-8050-9125614c0641 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 561928fb-3c41-4937-8050-9125614c0641 {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 19:52:38 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Successfully detached device vdb from instance 561928fb-3c41-4937-8050-9125614c0641 from the live domain config.
Aug 01 19:52:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqCxSyTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '4b87db97-7516-42d7-86af-a488fdca6032'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:52:38 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:52:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:52:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[419f9de1-9818-42ed-9822-e2ad82556a9c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5489ee7-631b-4830-8798-a8552360f7f8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)
Aug 01 19:52:39 user nova-compute[72504]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:52:39 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:52:39 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:52:39 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:39 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:39 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:39 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:39 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 (non-flash)
Aug 01 19:52:39 user nova-compute[72504]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:52:39 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:52:39 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:52:39 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:39 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:39 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:39 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:39 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff4142dba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032'): ({'sdi'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Removing single pathed devices sdi {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[161ee99d-44fc-4e13-9976-c56da18f56af]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[86471c87-d116-404f-a85b-11cfc7193117]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Flushing IO for device /dev/sdi {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd88e4f8-5039-4d1d-ae72-f0977ade35ce]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG nova.compute.manager [req-bf7ea42f-9025-40bc-bd8a-f263f1b8e635 req-87dd4a9f-ac32-4808-92ea-c9c834007900 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-unplugged-97484d3b-3fdd-4ad3-8125-12117341441c {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-bf7ea42f-9025-40bc-bd8a-f263f1b8e635 req-87dd4a9f-ac32-4808-92ea-c9c834007900 service nova] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-bf7ea42f-9025-40bc-bd8a-f263f1b8e635 req-87dd4a9f-ac32-4808-92ea-c9c834007900 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-bf7ea42f-9025-40bc-bd8a-f263f1b8e635 req-87dd4a9f-ac32-4808-92ea-c9c834007900 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG nova.compute.manager [req-bf7ea42f-9025-40bc-bd8a-f263f1b8e635 req-87dd4a9f-ac32-4808-92ea-c9c834007900 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] No waiting events found dispatching network-vif-unplugged-97484d3b-3fdd-4ad3-8125-12117341441c {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG nova.compute.manager [req-bf7ea42f-9025-40bc-bd8a-f263f1b8e635 req-87dd4a9f-ac32-4808-92ea-c9c834007900 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-unplugged-97484d3b-3fdd-4ad3-8125-12117341441c for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.049s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[624fcf2c-96db-4a8f-9be9-084184599911]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] SCSI volumes sdi have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[955ce29b-d0fd-4365-8f54-e79a2b4f83b5]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --logout" returned: 0 in 0.110s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7039f24-1f14-40b2-a482-cf3c4700df48]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032, portal: 172.16.0.220,3260]
Aug 01 19:52:39 user nova-compute[72504]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032, portal: 172.16.0.220,3260] successful.
Aug 01 19:52:39 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b87db97-7516-42d7-86af-a488fdca6032 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2017603-d86c-429a-b3dd-0998054ffef1]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.426s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] <== disconnect_volume: return (427ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:40 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Instance destroyed successfully.
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lazy-loading 'resources' on Instance uuid 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1242188617',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1242188617',id=9,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeFvsHYdJBNEbcxV4XXAiRnx+5sL87PKC5LnKhGGASCKmKVu4R47G5S+DRgHjKuQT8IHEwuFJNtLjOfV+3XJegm5cY0CWqKT4tpTvGrm284xrF0t3PnSDzim3EkK6piIQ==',key_name='tempest-keypair-1162904154',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:51:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f84d6702f394a86be93c8b569d31698',ramdisk_id='',reservation_id='r-k1hnrgis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1761881347',owner_user_name='tempest-TaggedBootDevicesTest-1761881347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:51:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82b31b1cbe344ff587c86d89c57b9325',uuid=6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "address": "fa:16:3e:b5:fc:7c", "network": {"id": "8ac53e2b-6d51-4d2e-b457-6b26a63bf383", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1111786338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d16fa4f-b0", "ovs_interfaceid": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converting VIF {"id": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "address": "fa:16:3e:b5:fc:7c", "network": {"id": "8ac53e2b-6d51-4d2e-b457-6b26a63bf383", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1111786338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d16fa4f-b0", "ovs_interfaceid": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:fc:7c,bridge_name='br-int',has_traffic_filtering=True,id=5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828,network=Network(8ac53e2b-6d51-4d2e-b457-6b26a63bf383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d16fa4f-b0') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG os_vif [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:fc:7c,bridge_name='br-int',has_traffic_filtering=True,id=5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828,network=Network(8ac53e2b-6d51-4d2e-b457-6b26a63bf383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d16fa4f-b0') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d16fa4f-b0, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:40 user nova-compute[72504]: INFO os_vif [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:fc:7c,bridge_name='br-int',has_traffic_filtering=True,id=5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828,network=Network(8ac53e2b-6d51-4d2e-b457-6b26a63bf383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d16fa4f-b0')
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1242188617',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1242188617',id=9,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeFvsHYdJBNEbcxV4XXAiRnx+5sL87PKC5LnKhGGASCKmKVu4R47G5S+DRgHjKuQT8IHEwuFJNtLjOfV+3XJegm5cY0CWqKT4tpTvGrm284xrF0t3PnSDzim3EkK6piIQ==',key_name='tempest-keypair-1162904154',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:51:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f84d6702f394a86be93c8b569d31698',ramdisk_id='',reservation_id='r-k1hnrgis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1761881347',owner_user_name='tempest-TaggedBootDevicesTest-1761881347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:51:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82b31b1cbe344ff587c86d89c57b9325',uuid=6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "423f358a-b722-4561-8f80-0c53f295e565", "address": "fa:16:3e:9a:f0:25", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423f358a-b7", "ovs_interfaceid": "423f358a-b722-4561-8f80-0c53f295e565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converting VIF {"id": "423f358a-b722-4561-8f80-0c53f295e565", "address": "fa:16:3e:9a:f0:25", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423f358a-b7", "ovs_interfaceid": "423f358a-b722-4561-8f80-0c53f295e565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:f0:25,bridge_name='br-int',has_traffic_filtering=True,id=423f358a-b722-4561-8f80-0c53f295e565,network=Network(a7129b01-9ed6-480f-972a-f95db79263ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap423f358a-b7') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG os_vif [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:f0:25,bridge_name='br-int',has_traffic_filtering=True,id=423f358a-b722-4561-8f80-0c53f295e565,network=Network(a7129b01-9ed6-480f-972a-f95db79263ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap423f358a-b7') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap423f358a-b7, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.objects.instance [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lazy-loading 'flavor' on Instance uuid 561928fb-3c41-4937-8050-9125614c0641 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:52:40 user nova-compute[72504]: INFO os_vif [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:f0:25,bridge_name='br-int',has_traffic_filtering=True,id=423f358a-b722-4561-8f80-0c53f295e565,network=Network(a7129b01-9ed6-480f-972a-f95db79263ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap423f358a-b7')
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1242188617',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1242188617',id=9,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeFvsHYdJBNEbcxV4XXAiRnx+5sL87PKC5LnKhGGASCKmKVu4R47G5S+DRgHjKuQT8IHEwuFJNtLjOfV+3XJegm5cY0CWqKT4tpTvGrm284xrF0t3PnSDzim3EkK6piIQ==',key_name='tempest-keypair-1162904154',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:51:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f84d6702f394a86be93c8b569d31698',ramdisk_id='',reservation_id='r-k1hnrgis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1761881347',owner_user_name='tempest-TaggedBootDevicesTest-1761881347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:51:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82b31b1cbe344ff587c86d89c57b9325',uuid=6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16a739aa-8e59-4e49-9d81-2242527d12ab", "address": "fa:16:3e:6e:4f:3e", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a739aa-8e", "ovs_interfaceid": "16a739aa-8e59-4e49-9d81-2242527d12ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converting VIF {"id": "16a739aa-8e59-4e49-9d81-2242527d12ab", "address": "fa:16:3e:6e:4f:3e", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a739aa-8e", "ovs_interfaceid": "16a739aa-8e59-4e49-9d81-2242527d12ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:4f:3e,bridge_name='br-int',has_traffic_filtering=True,id=16a739aa-8e59-4e49-9d81-2242527d12ab,network=Network(a7129b01-9ed6-480f-972a-f95db79263ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap16a739aa-8e') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG os_vif [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:4f:3e,bridge_name='br-int',has_traffic_filtering=True,id=16a739aa-8e59-4e49-9d81-2242527d12ab,network=Network(a7129b01-9ed6-480f-972a-f95db79263ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap16a739aa-8e') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16a739aa-8e, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:40 user nova-compute[72504]: INFO os_vif [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:4f:3e,bridge_name='br-int',has_traffic_filtering=True,id=16a739aa-8e59-4e49-9d81-2242527d12ab,network=Network(a7129b01-9ed6-480f-972a-f95db79263ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap16a739aa-8e')
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1242188617',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1242188617',id=9,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeFvsHYdJBNEbcxV4XXAiRnx+5sL87PKC5LnKhGGASCKmKVu4R47G5S+DRgHjKuQT8IHEwuFJNtLjOfV+3XJegm5cY0CWqKT4tpTvGrm284xrF0t3PnSDzim3EkK6piIQ==',key_name='tempest-keypair-1162904154',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:51:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f84d6702f394a86be93c8b569d31698',ramdisk_id='',reservation_id='r-k1hnrgis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1761881347',owner_user_name='tempest-TaggedBootDevicesTest-1761881347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:51:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82b31b1cbe344ff587c86d89c57b9325',uuid=6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97484d3b-3fdd-4ad3-8125-12117341441c", "address": "fa:16:3e:32:75:5c", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97484d3b-3f", "ovs_interfaceid": "97484d3b-3fdd-4ad3-8125-12117341441c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converting VIF {"id": "97484d3b-3fdd-4ad3-8125-12117341441c", "address": "fa:16:3e:32:75:5c", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97484d3b-3f", "ovs_interfaceid": "97484d3b-3fdd-4ad3-8125-12117341441c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:75:5c,bridge_name='br-int',has_traffic_filtering=True,id=97484d3b-3fdd-4ad3-8125-12117341441c,network=Network(a7129b01-9ed6-480f-972a-f95db79263ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97484d3b-3f') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG os_vif [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:75:5c,bridge_name='br-int',has_traffic_filtering=True,id=97484d3b-3fdd-4ad3-8125-12117341441c,network=Network(a7129b01-9ed6-480f-972a-f95db79263ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97484d3b-3f') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f604fbb8-c1ed-4a4d-9aed-0509a924cbc7 tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lock "561928fb-3c41-4937-8050-9125614c0641" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.203s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97484d3b-3f, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:40 user nova-compute[72504]: INFO os_vif [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:75:5c,bridge_name='br-int',has_traffic_filtering=True,id=97484d3b-3fdd-4ad3-8125-12117341441c,network=Network(a7129b01-9ed6-480f-972a-f95db79263ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97484d3b-3f')
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1242188617',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1242188617',id=9,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeFvsHYdJBNEbcxV4XXAiRnx+5sL87PKC5LnKhGGASCKmKVu4R47G5S+DRgHjKuQT8IHEwuFJNtLjOfV+3XJegm5cY0CWqKT4tpTvGrm284xrF0t3PnSDzim3EkK6piIQ==',key_name='tempest-keypair-1162904154',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:51:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f84d6702f394a86be93c8b569d31698',ramdisk_id='',reservation_id='r-k1hnrgis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1761881347',owner_user_name='tempest-TaggedBootDevicesTest-1761881347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:51:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82b31b1cbe344ff587c86d89c57b9325',uuid=6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69b8504c-b89b-44af-9324-d6d096960909", "address": "fa:16:3e:5a:c6:3d", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8504c-b8", "ovs_interfaceid": "69b8504c-b89b-44af-9324-d6d096960909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converting VIF {"id": "69b8504c-b89b-44af-9324-d6d096960909", "address": "fa:16:3e:5a:c6:3d", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8504c-b8", "ovs_interfaceid": "69b8504c-b89b-44af-9324-d6d096960909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:c6:3d,bridge_name='br-int',has_traffic_filtering=True,id=69b8504c-b89b-44af-9324-d6d096960909,network=Network(a7129b01-9ed6-480f-972a-f95db79263ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b8504c-b8') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG os_vif [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:c6:3d,bridge_name='br-int',has_traffic_filtering=True,id=69b8504c-b89b-44af-9324-d6d096960909,network=Network(a7129b01-9ed6-480f-972a-f95db79263ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b8504c-b8') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69b8504c-b8, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:40 user nova-compute[72504]: INFO os_vif [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:c6:3d,bridge_name='br-int',has_traffic_filtering=True,id=69b8504c-b89b-44af-9324-d6d096960909,network=Network(a7129b01-9ed6-480f-972a-f95db79263ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b8504c-b8')
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1242188617',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1242188617',id=9,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeFvsHYdJBNEbcxV4XXAiRnx+5sL87PKC5LnKhGGASCKmKVu4R47G5S+DRgHjKuQT8IHEwuFJNtLjOfV+3XJegm5cY0CWqKT4tpTvGrm284xrF0t3PnSDzim3EkK6piIQ==',key_name='tempest-keypair-1162904154',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:51:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f84d6702f394a86be93c8b569d31698',ramdisk_id='',reservation_id='r-k1hnrgis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1761881347',owner_user_name='tempest-TaggedBootDevicesTest-1761881347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:51:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82b31b1cbe344ff587c86d89c57b9325',uuid=6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "462a6ab8-f964-4dda-9286-2fca0955907b", "address": "fa:16:3e:10:19:52", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462a6ab8-f9", "ovs_interfaceid": "462a6ab8-f964-4dda-9286-2fca0955907b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converting VIF {"id": "462a6ab8-f964-4dda-9286-2fca0955907b", "address": "fa:16:3e:10:19:52", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462a6ab8-f9", "ovs_interfaceid": "462a6ab8-f964-4dda-9286-2fca0955907b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:19:52,bridge_name='br-int',has_traffic_filtering=True,id=462a6ab8-f964-4dda-9286-2fca0955907b,network=Network(65137d48-c682-48b0-9317-84ee3d9bc51d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462a6ab8-f9') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG os_vif [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:19:52,bridge_name='br-int',has_traffic_filtering=True,id=462a6ab8-f964-4dda-9286-2fca0955907b,network=Network(65137d48-c682-48b0-9317-84ee3d9bc51d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462a6ab8-f9') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap462a6ab8-f9, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:40 user nova-compute[72504]: INFO os_vif [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:19:52,bridge_name='br-int',has_traffic_filtering=True,id=462a6ab8-f964-4dda-9286-2fca0955907b,network=Network(65137d48-c682-48b0-9317-84ee3d9bc51d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462a6ab8-f9')
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1242188617',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1242188617',id=9,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeFvsHYdJBNEbcxV4XXAiRnx+5sL87PKC5LnKhGGASCKmKVu4R47G5S+DRgHjKuQT8IHEwuFJNtLjOfV+3XJegm5cY0CWqKT4tpTvGrm284xrF0t3PnSDzim3EkK6piIQ==',key_name='tempest-keypair-1162904154',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:51:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f84d6702f394a86be93c8b569d31698',ramdisk_id='',reservation_id='r-k1hnrgis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1761881347',owner_user_name='tempest-TaggedBootDevicesTest-1761881347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:51:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82b31b1cbe344ff587c86d89c57b9325',uuid=6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8fdda48-16be-4318-a84d-79d50154eec0", "address": "fa:16:3e:e0:ce:00", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8fdda48-16", "ovs_interfaceid": "f8fdda48-16be-4318-a84d-79d50154eec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converting VIF {"id": "f8fdda48-16be-4318-a84d-79d50154eec0", "address": "fa:16:3e:e0:ce:00", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8fdda48-16", "ovs_interfaceid": "f8fdda48-16be-4318-a84d-79d50154eec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ce:00,bridge_name='br-int',has_traffic_filtering=True,id=f8fdda48-16be-4318-a84d-79d50154eec0,network=Network(65137d48-c682-48b0-9317-84ee3d9bc51d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8fdda48-16') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG os_vif [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ce:00,bridge_name='br-int',has_traffic_filtering=True,id=f8fdda48-16be-4318-a84d-79d50154eec0,network=Network(65137d48-c682-48b0-9317-84ee3d9bc51d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8fdda48-16') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8fdda48-16, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:40 user nova-compute[72504]: INFO os_vif [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ce:00,bridge_name='br-int',has_traffic_filtering=True,id=f8fdda48-16be-4318-a84d-79d50154eec0,network=Network(65137d48-c682-48b0-9317-84ee3d9bc51d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8fdda48-16')
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hCHkDiuf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:52:40 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:52:40 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5280dfc6-547f-48ea-9822-07ec44ee9bb6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb8f756-8375-4138-b59a-e26285bee64d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:52:40 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:52:40 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:52:40 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:40 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:40 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:40 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:40 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:52:40 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:52:40 user nova-compute[72504]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b (non-flash)
Aug 01 19:52:40 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:40 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:40 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:40 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:40 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff40c34beb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b'): ({'sdd'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Removing single pathed devices sdd {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7592a339-178e-430a-92a2-a5e90cd80582]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-plugged-423f358a-b722-4561-8f80-0c53f295e565 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] No waiting events found dispatching network-vif-plugged-423f358a-b722-4561-8f80-0c53f295e565 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:52:40 user nova-compute[72504]: WARNING nova.compute.manager [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received unexpected event network-vif-plugged-423f358a-b722-4561-8f80-0c53f295e565 for instance with vm_state active and task_state deleting.
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-unplugged-16a739aa-8e59-4e49-9d81-2242527d12ab {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] No waiting events found dispatching network-vif-unplugged-16a739aa-8e59-4e49-9d81-2242527d12ab {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-unplugged-16a739aa-8e59-4e49-9d81-2242527d12ab for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-plugged-16a739aa-8e59-4e49-9d81-2242527d12ab {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] No waiting events found dispatching network-vif-plugged-16a739aa-8e59-4e49-9d81-2242527d12ab {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:52:40 user nova-compute[72504]: WARNING nova.compute.manager [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received unexpected event network-vif-plugged-16a739aa-8e59-4e49-9d81-2242527d12ab for instance with vm_state active and task_state deleting.
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-unplugged-69b8504c-b89b-44af-9324-d6d096960909 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] No waiting events found dispatching network-vif-unplugged-69b8504c-b89b-44af-9324-d6d096960909 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-unplugged-69b8504c-b89b-44af-9324-d6d096960909 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-plugged-69b8504c-b89b-44af-9324-d6d096960909 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] No waiting events found dispatching network-vif-plugged-69b8504c-b89b-44af-9324-d6d096960909 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:52:40 user nova-compute[72504]: WARNING nova.compute.manager [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received unexpected event network-vif-plugged-69b8504c-b89b-44af-9324-d6d096960909 for instance with vm_state active and task_state deleting.
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-unplugged-462a6ab8-f964-4dda-9286-2fca0955907b {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] No waiting events found dispatching network-vif-unplugged-462a6ab8-f964-4dda-9286-2fca0955907b {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-unplugged-462a6ab8-f964-4dda-9286-2fca0955907b for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-plugged-462a6ab8-f964-4dda-9286-2fca0955907b {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] No waiting events found dispatching network-vif-plugged-462a6ab8-f964-4dda-9286-2fca0955907b {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:52:40 user nova-compute[72504]: WARNING nova.compute.manager [req-c0e05d82-c236-4b75-8a93-4ca029a50517 req-6d2da15e-5393-4128-ac2a-546450d20ee3 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received unexpected event network-vif-plugged-462a6ab8-f964-4dda-9286-2fca0955907b for instance with vm_state active and task_state deleting.
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.030s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2da2913-cd6a-440f-9d0d-4a0997fa8109]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Flushing IO for device /dev/sdd {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-548861cf-1205-4336-a42e-789644e5c973 req-b74e137a-b85d-4800-8bf4-87d95fd1bef3 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-plugged-5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-548861cf-1205-4336-a42e-789644e5c973 req-b74e137a-b85d-4800-8bf4-87d95fd1bef3 service nova] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-548861cf-1205-4336-a42e-789644e5c973 req-b74e137a-b85d-4800-8bf4-87d95fd1bef3 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-548861cf-1205-4336-a42e-789644e5c973 req-b74e137a-b85d-4800-8bf4-87d95fd1bef3 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-548861cf-1205-4336-a42e-789644e5c973 req-b74e137a-b85d-4800-8bf4-87d95fd1bef3 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] No waiting events found dispatching network-vif-plugged-5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:52:40 user nova-compute[72504]: WARNING nova.compute.manager [req-548861cf-1205-4336-a42e-789644e5c973 req-b74e137a-b85d-4800-8bf4-87d95fd1bef3 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received unexpected event network-vif-plugged-5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828 for instance with vm_state active and task_state deleting.
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee2386e-3cd9-4cc9-95fb-7794f53d74fd]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[60eb9dcb-7a3c-43e2-8fa7-15647691f933]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] SCSI volumes sdd have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d3d76a-1131-41fa-bdcb-c949045fc904]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4509f103-c54e-46b0-86fb-5f57aba996f0]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b, portal: 172.16.0.220,3260]
Aug 01 19:52:41 user nova-compute[72504]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b, portal: 172.16.0.220,3260] successful.
Aug 01 19:52:41 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d7f593f-5ffb-4c62-bfc3-51cb2c24977b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b401f8b4-f8f6-4fd0-96a2-9d0bee3217fe]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] <== disconnect_volume: return (368ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JVcNuqHZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:52:41 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f6372b-f5d8-4c2e-9377-ac28861b0203]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[014d2007-25ae-47de-b713-cacf6e233334]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:52:41 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:52:41 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:41 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:41 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:41 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:41 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:52:41 user nova-compute[72504]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 (non-flash)
Aug 01 19:52:41 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:41 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:41 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:41 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:41 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff4142fb010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25'): ({'sdc'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Removing single pathed devices sdc {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8463a438-36de-4d4b-85a1-5cae46376ae4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[650dfd65-4d47-4411-9d28-03674e5fa3d2]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Flushing IO for device /dev/sdc {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a2ec9c-6864-4d51-9feb-66aa49851a20]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-e769e857-bae0-41fd-89d9-c01046e2a7ad req-00dd3322-ca13-4a1d-819d-a67e94ff5c95 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-plugged-97484d3b-3fdd-4ad3-8125-12117341441c {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e769e857-bae0-41fd-89d9-c01046e2a7ad req-00dd3322-ca13-4a1d-819d-a67e94ff5c95 service nova] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e769e857-bae0-41fd-89d9-c01046e2a7ad req-00dd3322-ca13-4a1d-819d-a67e94ff5c95 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e769e857-bae0-41fd-89d9-c01046e2a7ad req-00dd3322-ca13-4a1d-819d-a67e94ff5c95 service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-e769e857-bae0-41fd-89d9-c01046e2a7ad req-00dd3322-ca13-4a1d-819d-a67e94ff5c95 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] No waiting events found dispatching network-vif-plugged-97484d3b-3fdd-4ad3-8125-12117341441c {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:52:41 user nova-compute[72504]: WARNING nova.compute.manager [req-e769e857-bae0-41fd-89d9-c01046e2a7ad req-00dd3322-ca13-4a1d-819d-a67e94ff5c95 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received unexpected event network-vif-plugged-97484d3b-3fdd-4ad3-8125-12117341441c for instance with vm_state active and task_state deleting.
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1b9746-d710-4b54-b910-4845bcaf434a]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[497de49e-6485-4e9b-88bc-c4e3183284ca]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6679bc71-358d-464b-90c9-62999dc406aa]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25, portal: 172.16.0.220,3260]
Aug 01 19:52:41 user nova-compute[72504]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25, portal: 172.16.0.220,3260] successful.
Aug 01 19:52:41 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84390bb0-1665-494a-88a9-0e106017df25 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4c4d83-6123-4a60-b2ce-17427ae6777b]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] <== disconnect_volume: return (338ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMwHWqfN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:52:41 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c17bea-0c59-4e57-af6f-642b261216d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0373a5db-a584-4eea-8c5d-49e209008534]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:52:41 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:41 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:41 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:41 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:41 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 (non-flash)
Aug 01 19:52:41 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:41 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:41 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:41 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:41 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff41aa2fb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65'): ({'sdb'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Removing single pathed devices sdb {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e954e275-89b4-4a91-9867-60a9d6e1295f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0095091f-63eb-403d-9616-b264f7322360]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Flushing IO for device /dev/sdb {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[011ea91c-cdbd-4fe1-b87a-821f82e75ce1]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7771de26-7414-43dd-9540-c037ab09e70d]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fe331e-f27a-43e8-ba94-28fc95533780]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a17c967-7422-4710-811f-4474de77a44b]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65, portal: 172.16.0.220,3260]
Aug 01 19:52:41 user nova-compute[72504]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65, portal: 172.16.0.220,3260] successful.
Aug 01 19:52:41 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e233d7c5-9e36-461b-850b-774fcad75f65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[21949c0d-9ec0-4935-b47d-45cd43029fc3]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] <== disconnect_volume: return (309ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:52:41 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Deleting instance files /opt/stack/data/nova/instances/6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f_del
Aug 01 19:52:41 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Deletion of /opt/stack/data/nova/instances/6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f_del complete
Aug 01 19:52:41 user nova-compute[72504]: INFO nova.compute.manager [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Took 3.48 seconds to destroy the instance on the hypervisor.
Aug 01 19:52:41 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 19:52:41 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 19:52:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:42 user nova-compute[72504]: DEBUG nova.compute.manager [req-e3a7ec04-40b8-4b18-a99d-cee8210bd352 req-0d3030e8-1e8c-4e30-8a10-fceb8bbc532b service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-unplugged-f8fdda48-16be-4318-a84d-79d50154eec0 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e3a7ec04-40b8-4b18-a99d-cee8210bd352 req-0d3030e8-1e8c-4e30-8a10-fceb8bbc532b service nova] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e3a7ec04-40b8-4b18-a99d-cee8210bd352 req-0d3030e8-1e8c-4e30-8a10-fceb8bbc532b service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e3a7ec04-40b8-4b18-a99d-cee8210bd352 req-0d3030e8-1e8c-4e30-8a10-fceb8bbc532b service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:42 user nova-compute[72504]: DEBUG nova.compute.manager [req-e3a7ec04-40b8-4b18-a99d-cee8210bd352 req-0d3030e8-1e8c-4e30-8a10-fceb8bbc532b service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] No waiting events found dispatching network-vif-unplugged-f8fdda48-16be-4318-a84d-79d50154eec0 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:52:42 user nova-compute[72504]: DEBUG nova.compute.manager [req-e3a7ec04-40b8-4b18-a99d-cee8210bd352 req-0d3030e8-1e8c-4e30-8a10-fceb8bbc532b service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-unplugged-f8fdda48-16be-4318-a84d-79d50154eec0 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:52:42 user nova-compute[72504]: DEBUG nova.compute.manager [req-e3a7ec04-40b8-4b18-a99d-cee8210bd352 req-0d3030e8-1e8c-4e30-8a10-fceb8bbc532b service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-plugged-f8fdda48-16be-4318-a84d-79d50154eec0 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e3a7ec04-40b8-4b18-a99d-cee8210bd352 req-0d3030e8-1e8c-4e30-8a10-fceb8bbc532b service nova] Acquiring lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e3a7ec04-40b8-4b18-a99d-cee8210bd352 req-0d3030e8-1e8c-4e30-8a10-fceb8bbc532b service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e3a7ec04-40b8-4b18-a99d-cee8210bd352 req-0d3030e8-1e8c-4e30-8a10-fceb8bbc532b service nova] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:42 user nova-compute[72504]: DEBUG nova.compute.manager [req-e3a7ec04-40b8-4b18-a99d-cee8210bd352 req-0d3030e8-1e8c-4e30-8a10-fceb8bbc532b service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] No waiting events found dispatching network-vif-plugged-f8fdda48-16be-4318-a84d-79d50154eec0 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:52:42 user nova-compute[72504]: WARNING nova.compute.manager [req-e3a7ec04-40b8-4b18-a99d-cee8210bd352 req-0d3030e8-1e8c-4e30-8a10-fceb8bbc532b service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received unexpected event network-vif-plugged-f8fdda48-16be-4318-a84d-79d50154eec0 for instance with vm_state active and task_state deleting.
Aug 01 19:52:43 user nova-compute[72504]: DEBUG nova.compute.manager [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:52:43 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Creating image(s)
Aug 01 19:52:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Did not create local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Ensure instance console log exists: /opt/stack/data/nova/instances/7391a8ce-7ce5-47ec-97f6-6159645688ea/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Start _get_guest_xml network_info=[{"id": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "address": "fa:16:3e:08:82:e6", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd06cd7-81", "ovs_interfaceid": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcdXAqpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7391a8ce-7ce5-47ec-97f6-6159645688ea', 'attached_at': '', 'detached_at': '', 'volume_id': '6a4682cd-8a63-4b10-9857-1ea601c38ba9', 'serial': '6a4682cd-8a63-4b10-9857-1ea601c38ba9'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': '2ceec72f-cb71-4c09-a6ce-c4b18ff336dd', 'volume_type': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:52:43 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:52:43 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:52:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcdXAqpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:52:43 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:52:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:52:43 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:52:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:52:43 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:52:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e9c6d3-f9ac-4d0b-82cd-fb9404181786]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:52:43 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e004c016-3457-4962-87f9-f3c732f2951b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9] added
Aug 01 19:52:43 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91ab7d0-f397-4668-8089-fc827b1b2ebb]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[098b75db-0068-4b0a-b408-6d2a796e29ad]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LcdXAqpw {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LcdXAqpw" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[01583d54-94bf-4abe-a356-9e2b0705d299]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LcdXAqpw'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2717da07-be33-4eb2-aeec-aaa8ff619225]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f35ea04-fc00-4ca9-af32-0b6bfbf0b1ae]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:43 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:43 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:43 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:43 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:43 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:43 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:43 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:43 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:52:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:44 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5663c4b-7db4-4611-bae7-5d5c51adbee6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9, portal: 172.16.0.220,3260]
Aug 01 19:52:44 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9, portal: 172.16.0.220,3260] successful.
Aug 01 19:52:44 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.050s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:44 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1d2961-9116-459f-9ea9-c0e666af20e5]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:52:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:44 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[993eb79b-db6b-481a-8bf9-0ec1c1b8fd81]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:52:44 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:44 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:44 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:44 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:44 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:52:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:52:44 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:52:44 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:52:44 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:52:44 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:52:44 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:52:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.419s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:52:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:52:44 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:52:44 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:52:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:52:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:52:44 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[481801d5-644c-4e9d-b28d-20e2f0fab445]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:52:44 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:52:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcdXAqpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:52:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-cd43d080-9185-45c7-8990-d948d110b6ba req-ec5f7022-0c8e-4a08-9201-dd11119b7715 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-deleted-97484d3b-3fdd-4ad3-8125-12117341441c {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:44 user nova-compute[72504]: INFO nova.compute.manager [req-cd43d080-9185-45c7-8990-d948d110b6ba req-ec5f7022-0c8e-4a08-9201-dd11119b7715 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Neutron deleted interface 97484d3b-3fdd-4ad3-8125-12117341441c; detaching it from the instance and deleting it from the info cache
Aug 01 19:52:44 user nova-compute[72504]: DEBUG nova.network.neutron [req-cd43d080-9185-45c7-8990-d948d110b6ba req-ec5f7022-0c8e-4a08-9201-dd11119b7715 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Updating instance_info_cache with network_info: [{"id": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "address": "fa:16:3e:b5:fc:7c", "network": {"id": "8ac53e2b-6d51-4d2e-b457-6b26a63bf383", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1111786338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d16fa4f-b0", "ovs_interfaceid": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "423f358a-b722-4561-8f80-0c53f295e565", "address": "fa:16:3e:9a:f0:25", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423f358a-b7", "ovs_interfaceid": "423f358a-b722-4561-8f80-0c53f295e565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16a739aa-8e59-4e49-9d81-2242527d12ab", "address": "fa:16:3e:6e:4f:3e", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a739aa-8e", "ovs_interfaceid": "16a739aa-8e59-4e49-9d81-2242527d12ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "69b8504c-b89b-44af-9324-d6d096960909", "address": "fa:16:3e:5a:c6:3d", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8504c-b8", "ovs_interfaceid": "69b8504c-b89b-44af-9324-d6d096960909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "462a6ab8-f964-4dda-9286-2fca0955907b", "address": "fa:16:3e:10:19:52", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462a6ab8-f9", "ovs_interfaceid": "462a6ab8-f964-4dda-9286-2fca0955907b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f8fdda48-16be-4318-a84d-79d50154eec0", "address": "fa:16:3e:e0:ce:00", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8fdda48-16", "ovs_interfaceid": "f8fdda48-16be-4318-a84d-79d50154eec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:52:45 user nova-compute[72504]: DEBUG nova.compute.manager [req-cd43d080-9185-45c7-8990-d948d110b6ba req-ec5f7022-0c8e-4a08-9201-dd11119b7715 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Detach interface failed, port_id=97484d3b-3fdd-4ad3-8125-12117341441c, reason: Instance 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f could not be found. {{(pid=72504) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 19:52:45 user nova-compute[72504]: DEBUG nova.compute.manager [req-cd43d080-9185-45c7-8990-d948d110b6ba req-ec5f7022-0c8e-4a08-9201-dd11119b7715 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-deleted-69b8504c-b89b-44af-9324-d6d096960909 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:45 user nova-compute[72504]: INFO nova.compute.manager [req-cd43d080-9185-45c7-8990-d948d110b6ba req-ec5f7022-0c8e-4a08-9201-dd11119b7715 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Neutron deleted interface 69b8504c-b89b-44af-9324-d6d096960909; detaching it from the instance and deleting it from the info cache
Aug 01 19:52:45 user nova-compute[72504]: DEBUG nova.network.neutron [req-cd43d080-9185-45c7-8990-d948d110b6ba req-ec5f7022-0c8e-4a08-9201-dd11119b7715 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Updating instance_info_cache with network_info: [{"id": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "address": "fa:16:3e:b5:fc:7c", "network": {"id": "8ac53e2b-6d51-4d2e-b457-6b26a63bf383", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1111786338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d16fa4f-b0", "ovs_interfaceid": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "423f358a-b722-4561-8f80-0c53f295e565", "address": "fa:16:3e:9a:f0:25", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423f358a-b7", "ovs_interfaceid": "423f358a-b722-4561-8f80-0c53f295e565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16a739aa-8e59-4e49-9d81-2242527d12ab", "address": "fa:16:3e:6e:4f:3e", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a739aa-8e", "ovs_interfaceid": "16a739aa-8e59-4e49-9d81-2242527d12ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "462a6ab8-f964-4dda-9286-2fca0955907b", "address": "fa:16:3e:10:19:52", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462a6ab8-f9", "ovs_interfaceid": "462a6ab8-f964-4dda-9286-2fca0955907b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f8fdda48-16be-4318-a84d-79d50154eec0", "address": "fa:16:3e:e0:ce:00", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8fdda48-16", "ovs_interfaceid": "f8fdda48-16be-4318-a84d-79d50154eec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:52:45 user nova-compute[72504]: DEBUG nova.compute.manager [req-cd43d080-9185-45c7-8990-d948d110b6ba req-ec5f7022-0c8e-4a08-9201-dd11119b7715 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Detach interface failed, port_id=69b8504c-b89b-44af-9324-d6d096960909, reason: Instance 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f could not be found. {{(pid=72504) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 19:52:45 user nova-compute[72504]: DEBUG nova.compute.manager [req-cd43d080-9185-45c7-8990-d948d110b6ba req-ec5f7022-0c8e-4a08-9201-dd11119b7715 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-deleted-462a6ab8-f964-4dda-9286-2fca0955907b {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:45 user nova-compute[72504]: INFO nova.compute.manager [req-cd43d080-9185-45c7-8990-d948d110b6ba req-ec5f7022-0c8e-4a08-9201-dd11119b7715 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Neutron deleted interface 462a6ab8-f964-4dda-9286-2fca0955907b; detaching it from the instance and deleting it from the info cache
Aug 01 19:52:45 user nova-compute[72504]: DEBUG nova.network.neutron [req-cd43d080-9185-45c7-8990-d948d110b6ba req-ec5f7022-0c8e-4a08-9201-dd11119b7715 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Updating instance_info_cache with network_info: [{"id": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "address": "fa:16:3e:b5:fc:7c", "network": {"id": "8ac53e2b-6d51-4d2e-b457-6b26a63bf383", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1111786338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d16fa4f-b0", "ovs_interfaceid": "5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "423f358a-b722-4561-8f80-0c53f295e565", "address": "fa:16:3e:9a:f0:25", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423f358a-b7", "ovs_interfaceid": "423f358a-b722-4561-8f80-0c53f295e565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16a739aa-8e59-4e49-9d81-2242527d12ab", "address": "fa:16:3e:6e:4f:3e", "network": {"id": "a7129b01-9ed6-480f-972a-f95db79263ed", "bridge": "br-int", "label": "tempest-device-tagging-net1-538971778", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a739aa-8e", "ovs_interfaceid": "16a739aa-8e59-4e49-9d81-2242527d12ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8fdda48-16be-4318-a84d-79d50154eec0", "address": "fa:16:3e:e0:ce:00", "network": {"id": "65137d48-c682-48b0-9317-84ee3d9bc51d", "bridge": "br-int", "label": "tempest-device-tagging-net2-325253445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f84d6702f394a86be93c8b569d31698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8fdda48-16", "ovs_interfaceid": "f8fdda48-16be-4318-a84d-79d50154eec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:52:45 user nova-compute[72504]: DEBUG nova.compute.manager [req-cd43d080-9185-45c7-8990-d948d110b6ba req-ec5f7022-0c8e-4a08-9201-dd11119b7715 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Detach interface failed, port_id=462a6ab8-f964-4dda-9286-2fca0955907b, reason: Instance 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f could not be found. {{(pid=72504) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 19:52:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.462s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:52:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] <== connect_volume: return (1464ms) {'type': 'block', 'scsi_wwn': '26539376333396562', 'path': '/dev/sdb'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:52:45 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539376333396562', 'path': '/dev/sdb'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:52:45 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:52:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1918672849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1918672849',id=12,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b82898c99bce4f04afda7e9ff6e4d5db',ramdisk_id='',reservation_id='r-l7bz59oe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-519115368',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:52:28Z,user_data=None,user_id='01263cb2c1874026be1c735abc966b45',uuid=7391a8ce-7ce5-47ec-97f6-6159645688ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "address": "fa:16:3e:08:82:e6", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd06cd7-81", "ovs_interfaceid": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:52:45 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Converting VIF {"id": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "address": "fa:16:3e:08:82:e6", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd06cd7-81", "ovs_interfaceid": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:52:45 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:82:e6,bridge_name='br-int',has_traffic_filtering=True,id=2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bd06cd7-81') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:52:45 user nova-compute[72504]: DEBUG nova.objects.instance [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lazy-loading 'pci_devices' on Instance uuid 7391a8ce-7ce5-47ec-97f6-6159645688ea {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:52:45 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:52:45 user nova-compute[72504]:   <uuid>7391a8ce-7ce5-47ec-97f6-6159645688ea</uuid>
Aug 01 19:52:45 user nova-compute[72504]:   <name>instance-0000000c</name>
Aug 01 19:52:45 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:52:45 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:52:45 user nova-compute[72504]:   <metadata>
Aug 01 19:52:45 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:52:45 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:52:45 user nova-compute[72504]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1918672849</nova:name>
Aug 01 19:52:45 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:52:43</nova:creationTime>
Aug 01 19:52:45 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:52:45 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:52:45 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:52:45 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:52:45 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:52:45 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:52:45 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:52:45 user nova-compute[72504]:       <nova:owner>
Aug 01 19:52:45 user nova-compute[72504]:         <nova:user uuid="01263cb2c1874026be1c735abc966b45">tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member</nova:user>
Aug 01 19:52:45 user nova-compute[72504]:         <nova:project uuid="b82898c99bce4f04afda7e9ff6e4d5db">tempest-ServerBootFromVolumeStableRescueTest-519115368</nova:project>
Aug 01 19:52:45 user nova-compute[72504]:       </nova:owner>
Aug 01 19:52:45 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:52:45 user nova-compute[72504]:       <nova:ports>
Aug 01 19:52:45 user nova-compute[72504]:         <nova:port uuid="2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66">
Aug 01 19:52:45 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 19:52:45 user nova-compute[72504]:         </nova:port>
Aug 01 19:52:45 user nova-compute[72504]:       </nova:ports>
Aug 01 19:52:45 user nova-compute[72504]:     </nova:instance>
Aug 01 19:52:45 user nova-compute[72504]:   </metadata>
Aug 01 19:52:45 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:52:45 user nova-compute[72504]:     <system>
Aug 01 19:52:45 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:52:45 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:52:45 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:52:45 user nova-compute[72504]:       <entry name="serial">7391a8ce-7ce5-47ec-97f6-6159645688ea</entry>
Aug 01 19:52:45 user nova-compute[72504]:       <entry name="uuid">7391a8ce-7ce5-47ec-97f6-6159645688ea</entry>
Aug 01 19:52:45 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:52:45 user nova-compute[72504]:     </system>
Aug 01 19:52:45 user nova-compute[72504]:   </sysinfo>
Aug 01 19:52:45 user nova-compute[72504]:   <os>
Aug 01 19:52:45 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:52:45 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:52:45 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:52:45 user nova-compute[72504]:   </os>
Aug 01 19:52:45 user nova-compute[72504]:   <features>
Aug 01 19:52:45 user nova-compute[72504]:     <acpi/>
Aug 01 19:52:45 user nova-compute[72504]:     <apic/>
Aug 01 19:52:45 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:52:45 user nova-compute[72504]:   </features>
Aug 01 19:52:45 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:52:45 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:52:45 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:52:45 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:52:45 user nova-compute[72504]:   </clock>
Aug 01 19:52:45 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:52:45 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:52:45 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:52:45 user nova-compute[72504]:   </cpu>
Aug 01 19:52:45 user nova-compute[72504]:   <devices>
Aug 01 19:52:45 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 19:52:45 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:52:45 user nova-compute[72504]:       <source dev="/dev/sdb"/>
Aug 01 19:52:45 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:52:45 user nova-compute[72504]:       <serial>6a4682cd-8a63-4b10-9857-1ea601c38ba9</serial>
Aug 01 19:52:45 user nova-compute[72504]:     </disk>
Aug 01 19:52:45 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:52:45 user nova-compute[72504]:       <mac address="fa:16:3e:08:82:e6"/>
Aug 01 19:52:45 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:52:45 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:52:45 user nova-compute[72504]:       <target dev="tap2bd06cd7-81"/>
Aug 01 19:52:45 user nova-compute[72504]:     </interface>
Aug 01 19:52:45 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:52:45 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/7391a8ce-7ce5-47ec-97f6-6159645688ea/console.log" append="off"/>
Aug 01 19:52:45 user nova-compute[72504]:     </serial>
Aug 01 19:52:45 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:52:45 user nova-compute[72504]:     <video>
Aug 01 19:52:45 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:52:45 user nova-compute[72504]:     </video>
Aug 01 19:52:45 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:52:45 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:52:45 user nova-compute[72504]:     </rng>
Aug 01 19:52:45 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:52:45 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:52:45 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:52:45 user nova-compute[72504]:     </memballoon>
Aug 01 19:52:45 user nova-compute[72504]:   </devices>
Aug 01 19:52:45 user nova-compute[72504]: </domain>
Aug 01 19:52:45 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:52:45 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:52:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1918672849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1918672849',id=12,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b82898c99bce4f04afda7e9ff6e4d5db',ramdisk_id='',reservation_id='r-l7bz59oe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-519115368',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:52:28Z,user_data=None,user_id='01263cb2c1874026be1c735abc966b45',uuid=7391a8ce-7ce5-47ec-97f6-6159645688ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "address": "fa:16:3e:08:82:e6", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd06cd7-81", "ovs_interfaceid": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:52:45 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Converting VIF {"id": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "address": "fa:16:3e:08:82:e6", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd06cd7-81", "ovs_interfaceid": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:52:45 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:82:e6,bridge_name='br-int',has_traffic_filtering=True,id=2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bd06cd7-81') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:52:45 user nova-compute[72504]: DEBUG os_vif [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:82:e6,bridge_name='br-int',has_traffic_filtering=True,id=2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bd06cd7-81') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:52:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:52:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:52:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2bd06cd7-81, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:52:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2bd06cd7-81, col_values=(('external_ids', {'iface-id': '2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:82:e6', 'vm-uuid': '7391a8ce-7ce5-47ec-97f6-6159645688ea'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:52:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:52:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:45 user nova-compute[72504]: INFO os_vif [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:82:e6,bridge_name='br-int',has_traffic_filtering=True,id=2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bd06cd7-81')
Aug 01 19:52:45 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:52:45 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] No VIF found with MAC fa:16:3e:08:82:e6, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:52:46 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:52:46 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Took 4.23 seconds to deallocate network for instance.
Aug 01 19:52:47 user nova-compute[72504]: DEBUG nova.compute.manager [req-5986c8bb-05b5-46c0-baea-ee7b8a8049c1 req-d88205a9-445d-41c0-bbff-cac68b9d1aa8 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-deleted-5d16fa4f-b0ef-44bd-9bb1-a62d2e7b2828 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:47 user nova-compute[72504]: DEBUG nova.compute.manager [req-5986c8bb-05b5-46c0-baea-ee7b8a8049c1 req-d88205a9-445d-41c0-bbff-cac68b9d1aa8 service nova] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Received event network-vif-deleted-f8fdda48-16be-4318-a84d-79d50154eec0 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:47 user nova-compute[72504]: DEBUG nova.compute.manager [req-798c6a39-2fe8-4270-b468-259e6e0d6608 req-3fff6a02-39e6-4f82-b2d8-70e700d578a2 service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Received event network-vif-plugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-798c6a39-2fe8-4270-b468-259e6e0d6608 req-3fff6a02-39e6-4f82-b2d8-70e700d578a2 service nova] Acquiring lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-798c6a39-2fe8-4270-b468-259e6e0d6608 req-3fff6a02-39e6-4f82-b2d8-70e700d578a2 service nova] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-798c6a39-2fe8-4270-b468-259e6e0d6608 req-3fff6a02-39e6-4f82-b2d8-70e700d578a2 service nova] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:47 user nova-compute[72504]: DEBUG nova.compute.manager [req-798c6a39-2fe8-4270-b468-259e6e0d6608 req-3fff6a02-39e6-4f82-b2d8-70e700d578a2 service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] No waiting events found dispatching network-vif-plugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:52:47 user nova-compute[72504]: WARNING nova.compute.manager [req-798c6a39-2fe8-4270-b468-259e6e0d6608 req-3fff6a02-39e6-4f82-b2d8-70e700d578a2 service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Received unexpected event network-vif-plugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 for instance with vm_state building and task_state spawning.
Aug 01 19:52:48 user nova-compute[72504]: INFO nova.compute.manager [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Took 2.88 seconds to detach 3 volumes for instance.
Aug 01 19:52:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:49 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:52:49 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:52:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:49 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Deleted allocations for instance 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f
Aug 01 19:52:49 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919569.5522861, 7391a8ce-7ce5-47ec-97f6-6159645688ea => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:52:49 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] VM Resumed (Lifecycle Event)
Aug 01 19:52:49 user nova-compute[72504]: DEBUG nova.compute.manager [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:52:49 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:52:49 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Instance spawned successfully.
Aug 01 19:52:49 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 19:52:49 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:52:49 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:52:49 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:52:49 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:52:49 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:52:49 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:52:49 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:52:49 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:52:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e34fe6e7-c088-4a0f-82e3-edbfad1a80e7 tempest-TaggedBootDevicesTest-1761881347 tempest-TaggedBootDevicesTest-1761881347-project-member] Lock "6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.258s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:49 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:52:49 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919569.5558727, 7391a8ce-7ce5-47ec-97f6-6159645688ea => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:52:49 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] VM Started (Lifecycle Event)
Aug 01 19:52:49 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:52:49 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:52:49 user nova-compute[72504]: DEBUG nova.compute.manager [req-1db52fa5-8e63-49dc-b29a-d38c21b1b3dc req-09ce8b45-1081-4af5-9892-3ffce5bf5aa5 service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Received event network-vif-plugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:52:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1db52fa5-8e63-49dc-b29a-d38c21b1b3dc req-09ce8b45-1081-4af5-9892-3ffce5bf5aa5 service nova] Acquiring lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1db52fa5-8e63-49dc-b29a-d38c21b1b3dc req-09ce8b45-1081-4af5-9892-3ffce5bf5aa5 service nova] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1db52fa5-8e63-49dc-b29a-d38c21b1b3dc req-09ce8b45-1081-4af5-9892-3ffce5bf5aa5 service nova] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:49 user nova-compute[72504]: DEBUG nova.compute.manager [req-1db52fa5-8e63-49dc-b29a-d38c21b1b3dc req-09ce8b45-1081-4af5-9892-3ffce5bf5aa5 service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] No waiting events found dispatching network-vif-plugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:52:49 user nova-compute[72504]: WARNING nova.compute.manager [req-1db52fa5-8e63-49dc-b29a-d38c21b1b3dc req-09ce8b45-1081-4af5-9892-3ffce5bf5aa5 service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Received unexpected event network-vif-plugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 for instance with vm_state building and task_state spawning.
Aug 01 19:52:49 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:52:49 user nova-compute[72504]: INFO nova.compute.manager [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Took 6.06 seconds to spawn the instance on the hypervisor.
Aug 01 19:52:49 user nova-compute[72504]: DEBUG nova.compute.manager [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:52:49 user nova-compute[72504]: INFO nova.compute.manager [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Took 22.80 seconds to build instance.
Aug 01 19:52:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-09fec367-e6fb-4e69-a1b8-945dc67bcab9 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.957s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:55 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690919560.2688813, 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:52:55 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] VM Stopped (Lifecycle Event)
Aug 01 19:52:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:52:55 user nova-compute[72504]: DEBUG nova.compute.manager [None req-aa27014f-6d92-4d1c-aaad-b794ae07596c None None] [instance: 6a6dae5e-6661-4fb2-bb2b-61b3fae77e1f] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:52:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Acquiring lock "ab6496ff-6f53-4617-9f99-e932d7267fda" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "ab6496ff-6f53-4617-9f99-e932d7267fda" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:59 user nova-compute[72504]: DEBUG nova.compute.manager [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 19:52:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:52:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:52:59 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:52:59 user nova-compute[72504]: INFO nova.compute.claims [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Claim successful on node user
Aug 01 19:52:59 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:52:59 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:52:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:52:59 user nova-compute[72504]: DEBUG nova.compute.manager [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 19:52:59 user nova-compute[72504]: DEBUG nova.compute.manager [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 19:52:59 user nova-compute[72504]: DEBUG nova.network.neutron [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 19:52:59 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 19:52:59 user nova-compute[72504]: DEBUG nova.compute.manager [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 19:53:00 user nova-compute[72504]: DEBUG nova.policy [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0602032d5a34a83a13a4888436b689e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd6112c6db747f297455ca969783d11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 19:53:00 user nova-compute[72504]: DEBUG nova.compute.manager [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 19:53:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:53:00 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Creating image(s)
Aug 01 19:53:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Acquiring lock "/opt/stack/data/nova/instances/ab6496ff-6f53-4617-9f99-e932d7267fda/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "/opt/stack/data/nova/instances/ab6496ff-6f53-4617-9f99-e932d7267fda/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "/opt/stack/data/nova/instances/ab6496ff-6f53-4617-9f99-e932d7267fda/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.159s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:53:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.167s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/ab6496ff-6f53-4617-9f99-e932d7267fda/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/ab6496ff-6f53-4617-9f99-e932d7267fda/disk 1073741824" returned: 0 in 0.067s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.160s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:00 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ab6496ff-6f53-4617-9f99-e932d7267fda/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 19:53:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6496ff-6f53-4617-9f99-e932d7267fda/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:00 user nova-compute[72504]: DEBUG nova.network.neutron [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Successfully created port: 035a0311-c451-45b2-9959-772d998e248d {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:53:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6496ff-6f53-4617-9f99-e932d7267fda/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:00 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Cannot resize image /opt/stack/data/nova/instances/ab6496ff-6f53-4617-9f99-e932d7267fda/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 19:53:00 user nova-compute[72504]: DEBUG nova.objects.instance [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lazy-loading 'migration_context' on Instance uuid ab6496ff-6f53-4617-9f99-e932d7267fda {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:53:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 19:53:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Ensure instance console log exists: /opt/stack/data/nova/instances/ab6496ff-6f53-4617-9f99-e932d7267fda/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:53:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:01 user nova-compute[72504]: DEBUG nova.network.neutron [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Successfully updated port: 035a0311-c451-45b2-9959-772d998e248d {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:53:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Acquiring lock "refresh_cache-ab6496ff-6f53-4617-9f99-e932d7267fda" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:53:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Acquired lock "refresh_cache-ab6496ff-6f53-4617-9f99-e932d7267fda" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:53:01 user nova-compute[72504]: DEBUG nova.network.neutron [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:53:01 user nova-compute[72504]: DEBUG nova.compute.manager [req-43d6ab58-396e-4b6a-8bbd-fb04b5518949 req-52e67933-9403-45fa-8019-e9bd59c6e4b8 service nova] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Received event network-changed-035a0311-c451-45b2-9959-772d998e248d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:01 user nova-compute[72504]: DEBUG nova.compute.manager [req-43d6ab58-396e-4b6a-8bbd-fb04b5518949 req-52e67933-9403-45fa-8019-e9bd59c6e4b8 service nova] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Refreshing instance network info cache due to event network-changed-035a0311-c451-45b2-9959-772d998e248d. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:53:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-43d6ab58-396e-4b6a-8bbd-fb04b5518949 req-52e67933-9403-45fa-8019-e9bd59c6e4b8 service nova] Acquiring lock "refresh_cache-ab6496ff-6f53-4617-9f99-e932d7267fda" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:53:01 user nova-compute[72504]: DEBUG nova.network.neutron [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.network.neutron [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Updating instance_info_cache with network_info: [{"id": "035a0311-c451-45b2-9959-772d998e248d", "address": "fa:16:3e:28:58:89", "network": {"id": "b2c62156-50c6-4f54-b857-961843d14579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-554746486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd6112c6db747f297455ca969783d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035a0311-c4", "ovs_interfaceid": "035a0311-c451-45b2-9959-772d998e248d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Releasing lock "refresh_cache-ab6496ff-6f53-4617-9f99-e932d7267fda" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.compute.manager [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Instance network_info: |[{"id": "035a0311-c451-45b2-9959-772d998e248d", "address": "fa:16:3e:28:58:89", "network": {"id": "b2c62156-50c6-4f54-b857-961843d14579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-554746486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd6112c6db747f297455ca969783d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035a0311-c4", "ovs_interfaceid": "035a0311-c451-45b2-9959-772d998e248d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-43d6ab58-396e-4b6a-8bbd-fb04b5518949 req-52e67933-9403-45fa-8019-e9bd59c6e4b8 service nova] Acquired lock "refresh_cache-ab6496ff-6f53-4617-9f99-e932d7267fda" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.network.neutron [req-43d6ab58-396e-4b6a-8bbd-fb04b5518949 req-52e67933-9403-45fa-8019-e9bd59c6e4b8 service nova] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Refreshing network info cache for port 035a0311-c451-45b2-9959-772d998e248d {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Start _get_guest_xml network_info=[{"id": "035a0311-c451-45b2-9959-772d998e248d", "address": "fa:16:3e:28:58:89", "network": {"id": "b2c62156-50c6-4f54-b857-961843d14579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-554746486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd6112c6db747f297455ca969783d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035a0311-c4", "ovs_interfaceid": "035a0311-c451-45b2-9959-772d998e248d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:53:02 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:53:02 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1384458212',display_name='tempest-VolumesAdminNegativeTest-server-1384458212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1384458212',id=13,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4bd6112c6db747f297455ca969783d11',ramdisk_id='',reservation_id='r-u57087pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1986244634',owner_user_name='tempest-VolumesAdminNegativeTest-1986244634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:53:00Z,user_data=None,user_id='d0602032d5a34a83a13a4888436b689e',uuid=ab6496ff-6f53-4617-9f99-e932d7267fda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "035a0311-c451-45b2-9959-772d998e248d", "address": "fa:16:3e:28:58:89", "network": {"id": "b2c62156-50c6-4f54-b857-961843d14579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-554746486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd6112c6db747f297455ca969783d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035a0311-c4", "ovs_interfaceid": "035a0311-c451-45b2-9959-772d998e248d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Converting VIF {"id": "035a0311-c451-45b2-9959-772d998e248d", "address": "fa:16:3e:28:58:89", "network": {"id": "b2c62156-50c6-4f54-b857-961843d14579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-554746486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd6112c6db747f297455ca969783d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035a0311-c4", "ovs_interfaceid": "035a0311-c451-45b2-9959-772d998e248d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:58:89,bridge_name='br-int',has_traffic_filtering=True,id=035a0311-c451-45b2-9959-772d998e248d,network=Network(b2c62156-50c6-4f54-b857-961843d14579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035a0311-c4') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.objects.instance [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lazy-loading 'pci_devices' on Instance uuid ab6496ff-6f53-4617-9f99-e932d7267fda {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:53:02 user nova-compute[72504]:   <uuid>ab6496ff-6f53-4617-9f99-e932d7267fda</uuid>
Aug 01 19:53:02 user nova-compute[72504]:   <name>instance-0000000d</name>
Aug 01 19:53:02 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:53:02 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:53:02 user nova-compute[72504]:   <metadata>
Aug 01 19:53:02 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:53:02 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:53:02 user nova-compute[72504]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1384458212</nova:name>
Aug 01 19:53:02 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:53:02</nova:creationTime>
Aug 01 19:53:02 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:53:02 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:53:02 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:53:02 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:53:02 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:53:02 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:53:02 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:53:02 user nova-compute[72504]:       <nova:owner>
Aug 01 19:53:02 user nova-compute[72504]:         <nova:user uuid="d0602032d5a34a83a13a4888436b689e">tempest-VolumesAdminNegativeTest-1986244634-project-member</nova:user>
Aug 01 19:53:02 user nova-compute[72504]:         <nova:project uuid="4bd6112c6db747f297455ca969783d11">tempest-VolumesAdminNegativeTest-1986244634</nova:project>
Aug 01 19:53:02 user nova-compute[72504]:       </nova:owner>
Aug 01 19:53:02 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:53:02 user nova-compute[72504]:       <nova:ports>
Aug 01 19:53:02 user nova-compute[72504]:         <nova:port uuid="035a0311-c451-45b2-9959-772d998e248d">
Aug 01 19:53:02 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 19:53:02 user nova-compute[72504]:         </nova:port>
Aug 01 19:53:02 user nova-compute[72504]:       </nova:ports>
Aug 01 19:53:02 user nova-compute[72504]:     </nova:instance>
Aug 01 19:53:02 user nova-compute[72504]:   </metadata>
Aug 01 19:53:02 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:53:02 user nova-compute[72504]:     <system>
Aug 01 19:53:02 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:53:02 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:53:02 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:53:02 user nova-compute[72504]:       <entry name="serial">ab6496ff-6f53-4617-9f99-e932d7267fda</entry>
Aug 01 19:53:02 user nova-compute[72504]:       <entry name="uuid">ab6496ff-6f53-4617-9f99-e932d7267fda</entry>
Aug 01 19:53:02 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:53:02 user nova-compute[72504]:     </system>
Aug 01 19:53:02 user nova-compute[72504]:   </sysinfo>
Aug 01 19:53:02 user nova-compute[72504]:   <os>
Aug 01 19:53:02 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:53:02 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:53:02 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:53:02 user nova-compute[72504]:   </os>
Aug 01 19:53:02 user nova-compute[72504]:   <features>
Aug 01 19:53:02 user nova-compute[72504]:     <acpi/>
Aug 01 19:53:02 user nova-compute[72504]:     <apic/>
Aug 01 19:53:02 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:53:02 user nova-compute[72504]:   </features>
Aug 01 19:53:02 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:53:02 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:53:02 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:53:02 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:53:02 user nova-compute[72504]:   </clock>
Aug 01 19:53:02 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:53:02 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:53:02 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:53:02 user nova-compute[72504]:   </cpu>
Aug 01 19:53:02 user nova-compute[72504]:   <devices>
Aug 01 19:53:02 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:53:02 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:53:02 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/ab6496ff-6f53-4617-9f99-e932d7267fda/disk"/>
Aug 01 19:53:02 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:53:02 user nova-compute[72504]:     </disk>
Aug 01 19:53:02 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:53:02 user nova-compute[72504]:       <mac address="fa:16:3e:28:58:89"/>
Aug 01 19:53:02 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:53:02 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:53:02 user nova-compute[72504]:       <target dev="tap035a0311-c4"/>
Aug 01 19:53:02 user nova-compute[72504]:     </interface>
Aug 01 19:53:02 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:53:02 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/ab6496ff-6f53-4617-9f99-e932d7267fda/console.log" append="off"/>
Aug 01 19:53:02 user nova-compute[72504]:     </serial>
Aug 01 19:53:02 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:53:02 user nova-compute[72504]:     <video>
Aug 01 19:53:02 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:53:02 user nova-compute[72504]:     </video>
Aug 01 19:53:02 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:53:02 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:53:02 user nova-compute[72504]:     </rng>
Aug 01 19:53:02 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:53:02 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:53:02 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:53:02 user nova-compute[72504]:     </memballoon>
Aug 01 19:53:02 user nova-compute[72504]:   </devices>
Aug 01 19:53:02 user nova-compute[72504]: </domain>
Aug 01 19:53:02 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1384458212',display_name='tempest-VolumesAdminNegativeTest-server-1384458212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1384458212',id=13,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4bd6112c6db747f297455ca969783d11',ramdisk_id='',reservation_id='r-u57087pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1986244634',owner_user_name='tempest-VolumesAdminNegativeTest-1986244634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:53:00Z,user_data=None,user_id='d0602032d5a34a83a13a4888436b689e',uuid=ab6496ff-6f53-4617-9f99-e932d7267fda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "035a0311-c451-45b2-9959-772d998e248d", "address": "fa:16:3e:28:58:89", "network": {"id": "b2c62156-50c6-4f54-b857-961843d14579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-554746486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd6112c6db747f297455ca969783d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035a0311-c4", "ovs_interfaceid": "035a0311-c451-45b2-9959-772d998e248d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Converting VIF {"id": "035a0311-c451-45b2-9959-772d998e248d", "address": "fa:16:3e:28:58:89", "network": {"id": "b2c62156-50c6-4f54-b857-961843d14579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-554746486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd6112c6db747f297455ca969783d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035a0311-c4", "ovs_interfaceid": "035a0311-c451-45b2-9959-772d998e248d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:58:89,bridge_name='br-int',has_traffic_filtering=True,id=035a0311-c451-45b2-9959-772d998e248d,network=Network(b2c62156-50c6-4f54-b857-961843d14579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035a0311-c4') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG os_vif [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:58:89,bridge_name='br-int',has_traffic_filtering=True,id=035a0311-c451-45b2-9959-772d998e248d,network=Network(b2c62156-50c6-4f54-b857-961843d14579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035a0311-c4') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap035a0311-c4, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap035a0311-c4, col_values=(('external_ids', {'iface-id': '035a0311-c451-45b2-9959-772d998e248d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:58:89', 'vm-uuid': 'ab6496ff-6f53-4617-9f99-e932d7267fda'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:02 user nova-compute[72504]: INFO os_vif [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:58:89,bridge_name='br-int',has_traffic_filtering=True,id=035a0311-c451-45b2-9959-772d998e248d,network=Network(b2c62156-50c6-4f54-b857-961843d14579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035a0311-c4')
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] No VIF found with MAC fa:16:3e:28:58:89, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.network.neutron [req-43d6ab58-396e-4b6a-8bbd-fb04b5518949 req-52e67933-9403-45fa-8019-e9bd59c6e4b8 service nova] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Updated VIF entry in instance network info cache for port 035a0311-c451-45b2-9959-772d998e248d. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG nova.network.neutron [req-43d6ab58-396e-4b6a-8bbd-fb04b5518949 req-52e67933-9403-45fa-8019-e9bd59c6e4b8 service nova] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Updating instance_info_cache with network_info: [{"id": "035a0311-c451-45b2-9959-772d998e248d", "address": "fa:16:3e:28:58:89", "network": {"id": "b2c62156-50c6-4f54-b857-961843d14579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-554746486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd6112c6db747f297455ca969783d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035a0311-c4", "ovs_interfaceid": "035a0311-c451-45b2-9959-772d998e248d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:53:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-43d6ab58-396e-4b6a-8bbd-fb04b5518949 req-52e67933-9403-45fa-8019-e9bd59c6e4b8 service nova] Releasing lock "refresh_cache-ab6496ff-6f53-4617-9f99-e932d7267fda" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:53:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-f0cd8cb6-e14e-4b97-911a-301da3f8ddc7 req-fa5646e3-d527-4263-89d9-13008d36b813 service nova] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Received event network-vif-plugged-035a0311-c451-45b2-9959-772d998e248d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f0cd8cb6-e14e-4b97-911a-301da3f8ddc7 req-fa5646e3-d527-4263-89d9-13008d36b813 service nova] Acquiring lock "ab6496ff-6f53-4617-9f99-e932d7267fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f0cd8cb6-e14e-4b97-911a-301da3f8ddc7 req-fa5646e3-d527-4263-89d9-13008d36b813 service nova] Lock "ab6496ff-6f53-4617-9f99-e932d7267fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f0cd8cb6-e14e-4b97-911a-301da3f8ddc7 req-fa5646e3-d527-4263-89d9-13008d36b813 service nova] Lock "ab6496ff-6f53-4617-9f99-e932d7267fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-f0cd8cb6-e14e-4b97-911a-301da3f8ddc7 req-fa5646e3-d527-4263-89d9-13008d36b813 service nova] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] No waiting events found dispatching network-vif-plugged-035a0311-c451-45b2-9959-772d998e248d {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:04 user nova-compute[72504]: WARNING nova.compute.manager [req-f0cd8cb6-e14e-4b97-911a-301da3f8ddc7 req-fa5646e3-d527-4263-89d9-13008d36b813 service nova] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Received unexpected event network-vif-plugged-035a0311-c451-45b2-9959-772d998e248d for instance with vm_state building and task_state spawning.
Aug 01 19:53:06 user nova-compute[72504]: DEBUG nova.compute.manager [req-dcefcbe7-04d1-43fc-bde8-323f010d8f00 req-5102d942-792e-4269-b3bd-18ce82b0bc2d service nova] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Received event network-vif-plugged-035a0311-c451-45b2-9959-772d998e248d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-dcefcbe7-04d1-43fc-bde8-323f010d8f00 req-5102d942-792e-4269-b3bd-18ce82b0bc2d service nova] Acquiring lock "ab6496ff-6f53-4617-9f99-e932d7267fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-dcefcbe7-04d1-43fc-bde8-323f010d8f00 req-5102d942-792e-4269-b3bd-18ce82b0bc2d service nova] Lock "ab6496ff-6f53-4617-9f99-e932d7267fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-dcefcbe7-04d1-43fc-bde8-323f010d8f00 req-5102d942-792e-4269-b3bd-18ce82b0bc2d service nova] Lock "ab6496ff-6f53-4617-9f99-e932d7267fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:06 user nova-compute[72504]: DEBUG nova.compute.manager [req-dcefcbe7-04d1-43fc-bde8-323f010d8f00 req-5102d942-792e-4269-b3bd-18ce82b0bc2d service nova] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] No waiting events found dispatching network-vif-plugged-035a0311-c451-45b2-9959-772d998e248d {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:06 user nova-compute[72504]: WARNING nova.compute.manager [req-dcefcbe7-04d1-43fc-bde8-323f010d8f00 req-5102d942-792e-4269-b3bd-18ce82b0bc2d service nova] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Received unexpected event network-vif-plugged-035a0311-c451-45b2-9959-772d998e248d for instance with vm_state building and task_state spawning.
Aug 01 19:53:06 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919586.9287841, ab6496ff-6f53-4617-9f99-e932d7267fda => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:53:06 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] VM Resumed (Lifecycle Event)
Aug 01 19:53:06 user nova-compute[72504]: DEBUG nova.compute.manager [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:53:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:53:06 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Instance spawned successfully.
Aug 01 19:53:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 19:53:06 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:53:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:53:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:53:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:53:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:53:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:53:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:53:06 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:53:07 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:53:07 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919586.9327016, ab6496ff-6f53-4617-9f99-e932d7267fda => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:53:07 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] VM Started (Lifecycle Event)
Aug 01 19:53:07 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:53:07 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:53:07 user nova-compute[72504]: INFO nova.compute.manager [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Took 7.02 seconds to spawn the instance on the hypervisor.
Aug 01 19:53:07 user nova-compute[72504]: DEBUG nova.compute.manager [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:53:07 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:53:07 user nova-compute[72504]: INFO nova.compute.manager [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Took 7.77 seconds to build instance.
Aug 01 19:53:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d5f7f216-0bce-4ffe-ab9b-a81f9436df5d tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "ab6496ff-6f53-4617-9f99-e932d7267fda" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.870s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:11 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:53:11 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:53:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:12 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:53:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "5193c770-80ca-44c3-9950-cb25c65e94e8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:14 user nova-compute[72504]: DEBUG nova.objects.instance [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lazy-loading 'flavor' on Instance uuid 5193c770-80ca-44c3-9950-cb25c65e94e8 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:53:14 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:53:14 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:53:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:14 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "5193c770-80ca-44c3-9950-cb25c65e94e8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:15 user nova-compute[72504]: INFO nova.compute.manager [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Attaching volume fd436d31-78dd-4044-b044-840d1853718d to /dev/vdb
Aug 01 19:53:15 user nova-compute[72504]: DEBUG os_brick.utils [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1661ac9-2e24-4bc7-b626-96c835d36de4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[565a397f-aa6c-4150-a2d2-fa6792ded4a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a76e88-d437-4549-8e06-e27fd91e57f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc67612a-8fe9-4b3f-90ff-3d013631e01b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:53:15 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:53:15 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c1af7d-b654-4005-aaae-1d40f56e2158]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG os_brick.utils [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] <== get_connector_properties: return (203ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Updating existing volume attachment record: 2487fd13-a827-4490-a1f3-3ff1a4385ce5 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/840f652e-bd31-4cb0-bd52-2873a641d876/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/840f652e-bd31-4cb0-bd52-2873a641d876/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/840f652e-bd31-4cb0-bd52-2873a641d876/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/840f652e-bd31-4cb0-bd52-2873a641d876/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6496ff-6f53-4617-9f99-e932d7267fda/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6496ff-6f53-4617-9f99-e932d7267fda/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6496ff-6f53-4617-9f99-e932d7267fda/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6496ff-6f53-4617-9f99-e932d7267fda/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:53:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:53:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:53:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:53:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:53:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:18 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:53:18 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:53:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=7652MB free_disk=25.5311279296875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:53:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:53:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 5193c770-80ca-44c3-9950-cb25c65e94e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:53:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1de87977-532f-45f7-856b-84df41b2a567 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:53:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 561928fb-3c41-4937-8050-9125614c0641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:53:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance c9fd391d-51c0-4ef9-86cc-5ce2c76c177a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:53:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 85816260-b37b-4b9e-9b52-f823120645aa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:53:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 840f652e-bd31-4cb0-bd52-2873a641d876 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:53:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 7391a8ce-7ce5-47ec-97f6-6159645688ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:53:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance ab6496ff-6f53-4617-9f99-e932d7267fda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:53:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:53:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:53:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:18 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:53:18 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:53:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:53:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.656s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:20 user nova-compute[72504]: DEBUG nova.compute.manager [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 19:53:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:20 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:53:20 user nova-compute[72504]: INFO nova.compute.claims [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Claim successful on node user
Aug 01 19:53:20 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:53:20 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:53:20 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:53:20 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Skipping network cache update for instance because it has been migrated to another host. {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-1de87977-532f-45f7-856b-84df41b2a567" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-1de87977-532f-45f7-856b-84df41b2a567" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.637s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG nova.compute.manager [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG nova.compute.manager [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG nova.network.neutron [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 19:53:21 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 19:53:21 user nova-compute[72504]: DEBUG nova.compute.manager [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG nova.compute.manager [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG nova.policy [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be219e31095441269a1f140a77ad0d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274aed6773224c4fb534aac970d6bb34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG nova.compute.manager [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:53:21 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Creating image(s)
Aug 01 19:53:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "/opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "/opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "/opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:53:21 user nova-compute[72504]: INFO nova.compute.claims [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Claim successful on node user
Aug 01 19:53:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.145s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Updating instance_info_cache with network_info: [{"id": "5ecd0d2b-2f55-49b1-8858-3ab96e942b4f", "address": "fa:16:3e:45:cb:79", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ecd0d2b-2f", "ovs_interfaceid": "5ecd0d2b-2f55-49b1-8858-3ab96e942b4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-1de87977-532f-45f7-856b-84df41b2a567" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:53:21 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk 1073741824" returned: 0 in 0.121s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.173s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Cannot resize image /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG nova.objects.instance [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'migration_context' on Instance uuid 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Ensure instance console log exists: /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG nova.network.neutron [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Successfully created port: f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.921s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG nova.compute.manager [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG nova.compute.manager [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG nova.network.neutron [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 19:53:22 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 19:53:22 user nova-compute[72504]: DEBUG nova.compute.manager [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG nova.compute.manager [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:53:22 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Creating image(s)
Aug 01 19:53:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "/opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "/opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "/opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG nova.policy [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be219e31095441269a1f140a77ad0d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274aed6773224c4fb534aac970d6bb34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.169s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk 1073741824" returned: 0 in 0.051s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:23 user nova-compute[72504]: INFO nova.compute.manager [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Unshelving
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.network.neutron [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Successfully updated port: f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "refresh_cache-1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquired lock "refresh_cache-1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.network.neutron [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.compute.manager [req-b391de3d-75f1-47ab-bb8a-fc7a5b08ba35 req-637afdbb-21e6-4bdb-b9c0-0e6c670f5633 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received event network-changed-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.compute.manager [req-b391de3d-75f1-47ab-bb8a-fc7a5b08ba35 req-637afdbb-21e6-4bdb-b9c0-0e6c670f5633 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Refreshing instance network info cache due to event network-changed-f0cefd5c-7285-4f5e-b771-61f61039f900. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b391de3d-75f1-47ab-bb8a-fc7a5b08ba35 req-637afdbb-21e6-4bdb-b9c0-0e6c670f5633 service nova] Acquiring lock "refresh_cache-1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.152s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Checking if we can resize image /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.network.neutron [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:53:23 user nova-compute[72504]: INFO nova.virt.block_device [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Booting with volume 0d7d6bd1-a0f4-42f6-9e43-b73af451d960 at /dev/vdc
Aug 01 19:53:23 user nova-compute[72504]: DEBUG os_brick.utils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Cannot resize image /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.objects.instance [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'migration_context' on Instance uuid 128c2981-363c-4ae9-b46d-15b5e5d9cac6 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[61438c7b-a95c-493a-880d-3d11c7ad4d8c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Ensure instance console log exists: /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b1f26e-2624-483a-9244-ad50cb88482e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[727aba53-71d4-455c-9bd4-960e7f574dbb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[692ddfbc-5e6f-4afa-b6ce-07f37358f660]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.network.neutron [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Successfully created port: 88a4a208-7192-4e81-b9b2-1e07e7e307d1 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:53:23 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[62518e48-62bf-40e1-af8e-677944eb4bfb]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG os_brick.utils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Updating existing volume attachment record: b6623a75-16c1-4eb7-89b5-686972a12859 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.network.neutron [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Updating instance_info_cache with network_info: [{"id": "f0cefd5c-7285-4f5e-b771-61f61039f900", "address": "fa:16:3e:9a:5b:08", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cefd5c-72", "ovs_interfaceid": "f0cefd5c-7285-4f5e-b771-61f61039f900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Releasing lock "refresh_cache-1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Instance network_info: |[{"id": "f0cefd5c-7285-4f5e-b771-61f61039f900", "address": "fa:16:3e:9a:5b:08", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cefd5c-72", "ovs_interfaceid": "f0cefd5c-7285-4f5e-b771-61f61039f900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b391de3d-75f1-47ab-bb8a-fc7a5b08ba35 req-637afdbb-21e6-4bdb-b9c0-0e6c670f5633 service nova] Acquired lock "refresh_cache-1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.network.neutron [req-b391de3d-75f1-47ab-bb8a-fc7a5b08ba35 req-637afdbb-21e6-4bdb-b9c0-0e6c670f5633 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Refreshing network info cache for port f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Start _get_guest_xml network_info=[{"id": "f0cefd5c-7285-4f5e-b771-61f61039f900", "address": "fa:16:3e:9a:5b:08", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cefd5c-72", "ovs_interfaceid": "f0cefd5c-7285-4f5e-b771-61f61039f900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:53:23 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:53:23 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:53:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1870540243',display_name='tempest-ServerRescueNegativeTestJSON-server-1870540243',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1870540243',id=14,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='274aed6773224c4fb534aac970d6bb34',ramdisk_id='',reservation_id='r-lhs9qo3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-897201375',owner_user_name='tempest-ServerRescueNegativeTestJSON-897201375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:53:21Z,user_data=None,user_id='be219e31095441269a1f140a77ad0d57',uuid=1cb0bb6e-66b2-4b74-ae9b-c447b764ec91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0cefd5c-7285-4f5e-b771-61f61039f900", "address": "fa:16:3e:9a:5b:08", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cefd5c-72", "ovs_interfaceid": "f0cefd5c-7285-4f5e-b771-61f61039f900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Converting VIF {"id": "f0cefd5c-7285-4f5e-b771-61f61039f900", "address": "fa:16:3e:9a:5b:08", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cefd5c-72", "ovs_interfaceid": "f0cefd5c-7285-4f5e-b771-61f61039f900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:5b:08,bridge_name='br-int',has_traffic_filtering=True,id=f0cefd5c-7285-4f5e-b771-61f61039f900,network=Network(9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0cefd5c-72') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.objects.instance [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'pci_devices' on Instance uuid 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:53:23 user nova-compute[72504]:   <uuid>1cb0bb6e-66b2-4b74-ae9b-c447b764ec91</uuid>
Aug 01 19:53:23 user nova-compute[72504]:   <name>instance-0000000e</name>
Aug 01 19:53:23 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:53:23 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:53:23 user nova-compute[72504]:   <metadata>
Aug 01 19:53:23 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:53:23 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:53:23 user nova-compute[72504]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1870540243</nova:name>
Aug 01 19:53:23 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:53:23</nova:creationTime>
Aug 01 19:53:23 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:53:23 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:53:23 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:53:23 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:53:23 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:53:23 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:53:23 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:53:23 user nova-compute[72504]:       <nova:owner>
Aug 01 19:53:23 user nova-compute[72504]:         <nova:user uuid="be219e31095441269a1f140a77ad0d57">tempest-ServerRescueNegativeTestJSON-897201375-project-member</nova:user>
Aug 01 19:53:23 user nova-compute[72504]:         <nova:project uuid="274aed6773224c4fb534aac970d6bb34">tempest-ServerRescueNegativeTestJSON-897201375</nova:project>
Aug 01 19:53:23 user nova-compute[72504]:       </nova:owner>
Aug 01 19:53:23 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:53:23 user nova-compute[72504]:       <nova:ports>
Aug 01 19:53:23 user nova-compute[72504]:         <nova:port uuid="f0cefd5c-7285-4f5e-b771-61f61039f900">
Aug 01 19:53:23 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 19:53:23 user nova-compute[72504]:         </nova:port>
Aug 01 19:53:23 user nova-compute[72504]:       </nova:ports>
Aug 01 19:53:23 user nova-compute[72504]:     </nova:instance>
Aug 01 19:53:23 user nova-compute[72504]:   </metadata>
Aug 01 19:53:23 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:53:23 user nova-compute[72504]:     <system>
Aug 01 19:53:23 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:53:23 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:53:23 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:53:23 user nova-compute[72504]:       <entry name="serial">1cb0bb6e-66b2-4b74-ae9b-c447b764ec91</entry>
Aug 01 19:53:23 user nova-compute[72504]:       <entry name="uuid">1cb0bb6e-66b2-4b74-ae9b-c447b764ec91</entry>
Aug 01 19:53:23 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:53:23 user nova-compute[72504]:     </system>
Aug 01 19:53:23 user nova-compute[72504]:   </sysinfo>
Aug 01 19:53:23 user nova-compute[72504]:   <os>
Aug 01 19:53:23 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:53:23 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:53:23 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:53:23 user nova-compute[72504]:   </os>
Aug 01 19:53:23 user nova-compute[72504]:   <features>
Aug 01 19:53:23 user nova-compute[72504]:     <acpi/>
Aug 01 19:53:23 user nova-compute[72504]:     <apic/>
Aug 01 19:53:23 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:53:23 user nova-compute[72504]:   </features>
Aug 01 19:53:23 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:53:23 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:53:23 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:53:23 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:53:23 user nova-compute[72504]:   </clock>
Aug 01 19:53:23 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:53:23 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:53:23 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:53:23 user nova-compute[72504]:   </cpu>
Aug 01 19:53:23 user nova-compute[72504]:   <devices>
Aug 01 19:53:23 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:53:23 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:53:23 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk"/>
Aug 01 19:53:23 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:53:23 user nova-compute[72504]:     </disk>
Aug 01 19:53:23 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:53:23 user nova-compute[72504]:       <mac address="fa:16:3e:9a:5b:08"/>
Aug 01 19:53:23 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:53:23 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:53:23 user nova-compute[72504]:       <target dev="tapf0cefd5c-72"/>
Aug 01 19:53:23 user nova-compute[72504]:     </interface>
Aug 01 19:53:23 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:53:23 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/console.log" append="off"/>
Aug 01 19:53:23 user nova-compute[72504]:     </serial>
Aug 01 19:53:23 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:53:23 user nova-compute[72504]:     <video>
Aug 01 19:53:23 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:53:23 user nova-compute[72504]:     </video>
Aug 01 19:53:23 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:53:23 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:53:23 user nova-compute[72504]:     </rng>
Aug 01 19:53:23 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:53:23 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:53:23 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:53:23 user nova-compute[72504]:     </memballoon>
Aug 01 19:53:23 user nova-compute[72504]:   </devices>
Aug 01 19:53:23 user nova-compute[72504]: </domain>
Aug 01 19:53:23 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:53:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1870540243',display_name='tempest-ServerRescueNegativeTestJSON-server-1870540243',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1870540243',id=14,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='274aed6773224c4fb534aac970d6bb34',ramdisk_id='',reservation_id='r-lhs9qo3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-897201375',owner_user_name='tempest-ServerRescueNegativeTestJSON-897201375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:53:21Z,user_data=None,user_id='be219e31095441269a1f140a77ad0d57',uuid=1cb0bb6e-66b2-4b74-ae9b-c447b764ec91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0cefd5c-7285-4f5e-b771-61f61039f900", "address": "fa:16:3e:9a:5b:08", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cefd5c-72", "ovs_interfaceid": "f0cefd5c-7285-4f5e-b771-61f61039f900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Converting VIF {"id": "f0cefd5c-7285-4f5e-b771-61f61039f900", "address": "fa:16:3e:9a:5b:08", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cefd5c-72", "ovs_interfaceid": "f0cefd5c-7285-4f5e-b771-61f61039f900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:5b:08,bridge_name='br-int',has_traffic_filtering=True,id=f0cefd5c-7285-4f5e-b771-61f61039f900,network=Network(9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0cefd5c-72') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG os_vif [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:5b:08,bridge_name='br-int',has_traffic_filtering=True,id=f0cefd5c-7285-4f5e-b771-61f61039f900,network=Network(9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0cefd5c-72') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0cefd5c-72, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf0cefd5c-72, col_values=(('external_ids', {'iface-id': 'f0cefd5c-7285-4f5e-b771-61f61039f900', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:5b:08', 'vm-uuid': '1cb0bb6e-66b2-4b74-ae9b-c447b764ec91'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:23 user nova-compute[72504]: INFO os_vif [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:5b:08,bridge_name='br-int',has_traffic_filtering=True,id=f0cefd5c-7285-4f5e-b771-61f61039f900,network=Network(9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0cefd5c-72')
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:53:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] No VIF found with MAC fa:16:3e:9a:5b:08, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:53:24 user nova-compute[72504]: DEBUG nova.network.neutron [req-b391de3d-75f1-47ab-bb8a-fc7a5b08ba35 req-637afdbb-21e6-4bdb-b9c0-0e6c670f5633 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Updated VIF entry in instance network info cache for port f0cefd5c-7285-4f5e-b771-61f61039f900. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:53:24 user nova-compute[72504]: DEBUG nova.network.neutron [req-b391de3d-75f1-47ab-bb8a-fc7a5b08ba35 req-637afdbb-21e6-4bdb-b9c0-0e6c670f5633 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Updating instance_info_cache with network_info: [{"id": "f0cefd5c-7285-4f5e-b771-61f61039f900", "address": "fa:16:3e:9a:5b:08", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cefd5c-72", "ovs_interfaceid": "f0cefd5c-7285-4f5e-b771-61f61039f900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:53:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b391de3d-75f1-47ab-bb8a-fc7a5b08ba35 req-637afdbb-21e6-4bdb-b9c0-0e6c670f5633 service nova] Releasing lock "refresh_cache-1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:53:24 user nova-compute[72504]: DEBUG nova.network.neutron [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Successfully updated port: 88a4a208-7192-4e81-b9b2-1e07e7e307d1 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:53:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "refresh_cache-128c2981-363c-4ae9-b46d-15b5e5d9cac6" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:53:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquired lock "refresh_cache-128c2981-363c-4ae9-b46d-15b5e5d9cac6" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:53:24 user nova-compute[72504]: DEBUG nova.network.neutron [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:53:24 user nova-compute[72504]: DEBUG nova.compute.manager [req-cec0f2a7-ff33-42f6-af96-0305d3c2c568 req-4d402ced-e385-43fe-8057-e88888feec0c service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Received event network-changed-88a4a208-7192-4e81-b9b2-1e07e7e307d1 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:24 user nova-compute[72504]: DEBUG nova.compute.manager [req-cec0f2a7-ff33-42f6-af96-0305d3c2c568 req-4d402ced-e385-43fe-8057-e88888feec0c service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Refreshing instance network info cache due to event network-changed-88a4a208-7192-4e81-b9b2-1e07e7e307d1. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:53:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cec0f2a7-ff33-42f6-af96-0305d3c2c568 req-4d402ced-e385-43fe-8057-e88888feec0c service nova] Acquiring lock "refresh_cache-128c2981-363c-4ae9-b46d-15b5e5d9cac6" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:53:24 user nova-compute[72504]: DEBUG nova.network.neutron [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:53:24 user nova-compute[72504]: DEBUG nova.network.neutron [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Updating instance_info_cache with network_info: [{"id": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "address": "fa:16:3e:c0:3a:dc", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88a4a208-71", "ovs_interfaceid": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Releasing lock "refresh_cache-128c2981-363c-4ae9-b46d-15b5e5d9cac6" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.compute.manager [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Instance network_info: |[{"id": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "address": "fa:16:3e:c0:3a:dc", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88a4a208-71", "ovs_interfaceid": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cec0f2a7-ff33-42f6-af96-0305d3c2c568 req-4d402ced-e385-43fe-8057-e88888feec0c service nova] Acquired lock "refresh_cache-128c2981-363c-4ae9-b46d-15b5e5d9cac6" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.network.neutron [req-cec0f2a7-ff33-42f6-af96-0305d3c2c568 req-4d402ced-e385-43fe-8057-e88888feec0c service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Refreshing network info cache for port 88a4a208-7192-4e81-b9b2-1e07e7e307d1 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Start _get_guest_xml network_info=[{"id": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "address": "fa:16:3e:c0:3a:dc", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88a4a208-71", "ovs_interfaceid": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:53:25 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:53:25 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:53:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2007920168',display_name='tempest-ServerRescueNegativeTestJSON-server-2007920168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2007920168',id=15,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='274aed6773224c4fb534aac970d6bb34',ramdisk_id='',reservation_id='r-dg8uckty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-897201375',owner_user_name='tempest-ServerRescueNegativeTestJSON-897201375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:53:23Z,user_data=None,user_id='be219e31095441269a1f140a77ad0d57',uuid=128c2981-363c-4ae9-b46d-15b5e5d9cac6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "address": "fa:16:3e:c0:3a:dc", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88a4a208-71", "ovs_interfaceid": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Converting VIF {"id": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "address": "fa:16:3e:c0:3a:dc", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88a4a208-71", "ovs_interfaceid": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:3a:dc,bridge_name='br-int',has_traffic_filtering=True,id=88a4a208-7192-4e81-b9b2-1e07e7e307d1,network=Network(9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88a4a208-71') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.objects.instance [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'pci_devices' on Instance uuid 128c2981-363c-4ae9-b46d-15b5e5d9cac6 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:53:25 user nova-compute[72504]:   <uuid>128c2981-363c-4ae9-b46d-15b5e5d9cac6</uuid>
Aug 01 19:53:25 user nova-compute[72504]:   <name>instance-0000000f</name>
Aug 01 19:53:25 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:53:25 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:53:25 user nova-compute[72504]:   <metadata>
Aug 01 19:53:25 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:53:25 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:53:25 user nova-compute[72504]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2007920168</nova:name>
Aug 01 19:53:25 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:53:25</nova:creationTime>
Aug 01 19:53:25 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:53:25 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:53:25 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:53:25 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:53:25 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:53:25 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:53:25 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:53:25 user nova-compute[72504]:       <nova:owner>
Aug 01 19:53:25 user nova-compute[72504]:         <nova:user uuid="be219e31095441269a1f140a77ad0d57">tempest-ServerRescueNegativeTestJSON-897201375-project-member</nova:user>
Aug 01 19:53:25 user nova-compute[72504]:         <nova:project uuid="274aed6773224c4fb534aac970d6bb34">tempest-ServerRescueNegativeTestJSON-897201375</nova:project>
Aug 01 19:53:25 user nova-compute[72504]:       </nova:owner>
Aug 01 19:53:25 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:53:25 user nova-compute[72504]:       <nova:ports>
Aug 01 19:53:25 user nova-compute[72504]:         <nova:port uuid="88a4a208-7192-4e81-b9b2-1e07e7e307d1">
Aug 01 19:53:25 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 19:53:25 user nova-compute[72504]:         </nova:port>
Aug 01 19:53:25 user nova-compute[72504]:       </nova:ports>
Aug 01 19:53:25 user nova-compute[72504]:     </nova:instance>
Aug 01 19:53:25 user nova-compute[72504]:   </metadata>
Aug 01 19:53:25 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:53:25 user nova-compute[72504]:     <system>
Aug 01 19:53:25 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:53:25 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:53:25 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:53:25 user nova-compute[72504]:       <entry name="serial">128c2981-363c-4ae9-b46d-15b5e5d9cac6</entry>
Aug 01 19:53:25 user nova-compute[72504]:       <entry name="uuid">128c2981-363c-4ae9-b46d-15b5e5d9cac6</entry>
Aug 01 19:53:25 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:53:25 user nova-compute[72504]:     </system>
Aug 01 19:53:25 user nova-compute[72504]:   </sysinfo>
Aug 01 19:53:25 user nova-compute[72504]:   <os>
Aug 01 19:53:25 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:53:25 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:53:25 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:53:25 user nova-compute[72504]:   </os>
Aug 01 19:53:25 user nova-compute[72504]:   <features>
Aug 01 19:53:25 user nova-compute[72504]:     <acpi/>
Aug 01 19:53:25 user nova-compute[72504]:     <apic/>
Aug 01 19:53:25 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:53:25 user nova-compute[72504]:   </features>
Aug 01 19:53:25 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:53:25 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:53:25 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:53:25 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:53:25 user nova-compute[72504]:   </clock>
Aug 01 19:53:25 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:53:25 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:53:25 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:53:25 user nova-compute[72504]:   </cpu>
Aug 01 19:53:25 user nova-compute[72504]:   <devices>
Aug 01 19:53:25 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:53:25 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:53:25 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk"/>
Aug 01 19:53:25 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:53:25 user nova-compute[72504]:     </disk>
Aug 01 19:53:25 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:53:25 user nova-compute[72504]:       <mac address="fa:16:3e:c0:3a:dc"/>
Aug 01 19:53:25 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:53:25 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:53:25 user nova-compute[72504]:       <target dev="tap88a4a208-71"/>
Aug 01 19:53:25 user nova-compute[72504]:     </interface>
Aug 01 19:53:25 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:53:25 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/console.log" append="off"/>
Aug 01 19:53:25 user nova-compute[72504]:     </serial>
Aug 01 19:53:25 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:53:25 user nova-compute[72504]:     <video>
Aug 01 19:53:25 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:53:25 user nova-compute[72504]:     </video>
Aug 01 19:53:25 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:53:25 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:53:25 user nova-compute[72504]:     </rng>
Aug 01 19:53:25 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:53:25 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:53:25 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:53:25 user nova-compute[72504]:     </memballoon>
Aug 01 19:53:25 user nova-compute[72504]:   </devices>
Aug 01 19:53:25 user nova-compute[72504]: </domain>
Aug 01 19:53:25 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:53:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2007920168',display_name='tempest-ServerRescueNegativeTestJSON-server-2007920168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2007920168',id=15,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='274aed6773224c4fb534aac970d6bb34',ramdisk_id='',reservation_id='r-dg8uckty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-897201375',owner_user_name='tempest-ServerRescueNegativeTestJSON-897201375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:53:23Z,user_data=None,user_id='be219e31095441269a1f140a77ad0d57',uuid=128c2981-363c-4ae9-b46d-15b5e5d9cac6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "address": "fa:16:3e:c0:3a:dc", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88a4a208-71", "ovs_interfaceid": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Converting VIF {"id": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "address": "fa:16:3e:c0:3a:dc", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88a4a208-71", "ovs_interfaceid": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:3a:dc,bridge_name='br-int',has_traffic_filtering=True,id=88a4a208-7192-4e81-b9b2-1e07e7e307d1,network=Network(9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88a4a208-71') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG os_vif [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:3a:dc,bridge_name='br-int',has_traffic_filtering=True,id=88a4a208-7192-4e81-b9b2-1e07e7e307d1,network=Network(9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88a4a208-71') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88a4a208-71, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap88a4a208-71, col_values=(('external_ids', {'iface-id': '88a4a208-7192-4e81-b9b2-1e07e7e307d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:3a:dc', 'vm-uuid': '128c2981-363c-4ae9-b46d-15b5e5d9cac6'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAHmLCZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:53:25 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:53:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:53:25 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:53:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:53:25 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:25 user nova-compute[72504]: INFO os_vif [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:3a:dc,bridge_name='br-int',has_traffic_filtering=True,id=88a4a208-7192-4e81-b9b2-1e07e7e307d1,network=Network(9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88a4a208-71')
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[baaa5d5a-3a61-4936-9b93-b520d347f3d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:53:25 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd780b6-a1e5-4b5d-b352-9ec8f93b9752]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d] added
Aug 01 19:53:25 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] No VIF found with MAC fa:16:3e:c0:3a:dc, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[beba0c01-bbb1-48df-a831-cdf81363ec82]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[276d8dd3-cbc8-4c47-9635-9ff379d53bab]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nAHmLCZD {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nAHmLCZD" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9164c46f-e664-4583-b75f-e5b9725bd5b6]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nAHmLCZD'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cded5ff-4c82-49f3-b85b-c5bda836b16c]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c03f247-13ab-4967-b185-54c9c124de4a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:53:25 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:53:25 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:53:25 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:53:25 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:53:25 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:53:25 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:53:25 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:53:25 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:53:25 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:53:25 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90956d7-3a2f-478c-9eaf-bf055dabd02b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d, portal: 172.16.0.220,3260]
Aug 01 19:53:25 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d, portal: 172.16.0.220,3260] successful.
Aug 01 19:53:25 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06310ff-b9ee-440f-aa16-ca87f5f1f92b]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b8ddea-59b8-47fd-b8a3-d58d4bf8cda4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:53:25 user nova-compute[72504]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)
Aug 01 19:53:25 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:53:25 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:53:25 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:53:25 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:53:25 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:53:25 user nova-compute[72504]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)
Aug 01 19:53:25 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:53:25 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:53:25 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:53:25 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:53:25 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5a84e3-f796-49bd-abfe-daa4ebc63a49]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAHmLCZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.network.neutron [req-cec0f2a7-ff33-42f6-af96-0305d3c2c568 req-4d402ced-e385-43fe-8057-e88888feec0c service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Updated VIF entry in instance network info cache for port 88a4a208-7192-4e81-b9b2-1e07e7e307d1. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.network.neutron [req-cec0f2a7-ff33-42f6-af96-0305d3c2c568 req-4d402ced-e385-43fe-8057-e88888feec0c service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Updating instance_info_cache with network_info: [{"id": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "address": "fa:16:3e:c0:3a:dc", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88a4a208-71", "ovs_interfaceid": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cec0f2a7-ff33-42f6-af96-0305d3c2c568 req-4d402ced-e385-43fe-8057-e88888feec0c service nova] Releasing lock "refresh_cache-128c2981-363c-4ae9-b46d-15b5e5d9cac6" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.compute.manager [req-e511d2c6-a785-4cc2-9ea7-22c60003fad5 req-0e38d312-fb88-48fc-ad7e-f61e37a1d784 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received event network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e511d2c6-a785-4cc2-9ea7-22c60003fad5 req-0e38d312-fb88-48fc-ad7e-f61e37a1d784 service nova] Acquiring lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e511d2c6-a785-4cc2-9ea7-22c60003fad5 req-0e38d312-fb88-48fc-ad7e-f61e37a1d784 service nova] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e511d2c6-a785-4cc2-9ea7-22c60003fad5 req-0e38d312-fb88-48fc-ad7e-f61e37a1d784 service nova] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:25 user nova-compute[72504]: DEBUG nova.compute.manager [req-e511d2c6-a785-4cc2-9ea7-22c60003fad5 req-0e38d312-fb88-48fc-ad7e-f61e37a1d784 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] No waiting events found dispatching network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:25 user nova-compute[72504]: WARNING nova.compute.manager [req-e511d2c6-a785-4cc2-9ea7-22c60003fad5 req-0e38d312-fb88-48fc-ad7e-f61e37a1d784 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received unexpected event network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 for instance with vm_state building and task_state spawning.
Aug 01 19:53:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:26 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:53:26 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '23637646439626230', 'path': '/dev/sdc'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:53:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637646439626230', 'path': '/dev/sdc'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:53:26 user nova-compute[72504]: DEBUG nova.objects.instance [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lazy-loading 'flavor' on Instance uuid 5193c770-80ca-44c3-9950-cb25c65e94e8 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:53:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 19:53:26 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:53:26 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 19:53:26 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:53:26 user nova-compute[72504]:   <serial>fd436d31-78dd-4044-b044-840d1853718d</serial>
Aug 01 19:53:26 user nova-compute[72504]: </disk>
Aug 01 19:53:26 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 19:53:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:53:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:53:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] No VIF found with MAC fa:16:3e:46:8a:a8, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:53:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-80964b0c-4d03-4462-a7c6-3b6310c58517 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.347s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:27 user nova-compute[72504]: DEBUG nova.compute.manager [req-b5588708-01a4-465c-8c14-50b07d75e4d1 req-ecd43c86-be08-4d18-8ace-e69086face85 service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Received event network-vif-plugged-88a4a208-7192-4e81-b9b2-1e07e7e307d1 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b5588708-01a4-465c-8c14-50b07d75e4d1 req-ecd43c86-be08-4d18-8ace-e69086face85 service nova] Acquiring lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b5588708-01a4-465c-8c14-50b07d75e4d1 req-ecd43c86-be08-4d18-8ace-e69086face85 service nova] Lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b5588708-01a4-465c-8c14-50b07d75e4d1 req-ecd43c86-be08-4d18-8ace-e69086face85 service nova] Lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:27 user nova-compute[72504]: DEBUG nova.compute.manager [req-b5588708-01a4-465c-8c14-50b07d75e4d1 req-ecd43c86-be08-4d18-8ace-e69086face85 service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] No waiting events found dispatching network-vif-plugged-88a4a208-7192-4e81-b9b2-1e07e7e307d1 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:27 user nova-compute[72504]: WARNING nova.compute.manager [req-b5588708-01a4-465c-8c14-50b07d75e4d1 req-ecd43c86-be08-4d18-8ace-e69086face85 service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Received unexpected event network-vif-plugged-88a4a208-7192-4e81-b9b2-1e07e7e307d1 for instance with vm_state building and task_state spawning.
Aug 01 19:53:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:27 user nova-compute[72504]: DEBUG nova.compute.manager [req-d0651e7a-f2ed-4f1c-b998-af19af827bde req-9b8cddc5-2963-431f-82a8-af3ffc86eb02 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received event network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d0651e7a-f2ed-4f1c-b998-af19af827bde req-9b8cddc5-2963-431f-82a8-af3ffc86eb02 service nova] Acquiring lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d0651e7a-f2ed-4f1c-b998-af19af827bde req-9b8cddc5-2963-431f-82a8-af3ffc86eb02 service nova] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d0651e7a-f2ed-4f1c-b998-af19af827bde req-9b8cddc5-2963-431f-82a8-af3ffc86eb02 service nova] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:27 user nova-compute[72504]: DEBUG nova.compute.manager [req-d0651e7a-f2ed-4f1c-b998-af19af827bde req-9b8cddc5-2963-431f-82a8-af3ffc86eb02 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] No waiting events found dispatching network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:27 user nova-compute[72504]: WARNING nova.compute.manager [req-d0651e7a-f2ed-4f1c-b998-af19af827bde req-9b8cddc5-2963-431f-82a8-af3ffc86eb02 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received unexpected event network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 for instance with vm_state building and task_state spawning.
Aug 01 19:53:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-270f73b5-95ae-4530-a9bd-68a0ead9829a tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Acquiring lock "561928fb-3c41-4937-8050-9125614c0641" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-270f73b5-95ae-4530-a9bd-68a0ead9829a tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lock "561928fb-3c41-4937-8050-9125614c0641" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-270f73b5-95ae-4530-a9bd-68a0ead9829a tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Acquiring lock "561928fb-3c41-4937-8050-9125614c0641-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-270f73b5-95ae-4530-a9bd-68a0ead9829a tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lock "561928fb-3c41-4937-8050-9125614c0641-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-270f73b5-95ae-4530-a9bd-68a0ead9829a tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lock "561928fb-3c41-4937-8050-9125614c0641-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:28 user nova-compute[72504]: INFO nova.compute.manager [None req-270f73b5-95ae-4530-a9bd-68a0ead9829a tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Terminating instance
Aug 01 19:53:28 user nova-compute[72504]: DEBUG nova.compute.manager [None req-270f73b5-95ae-4530-a9bd-68a0ead9829a tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 19:53:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG nova.compute.manager [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919609.6659594, 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:53:29 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] VM Resumed (Lifecycle Event)
Aug 01 19:53:29 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Instance spawned successfully.
Aug 01 19:53:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:53:29 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 561928fb-3c41-4937-8050-9125614c0641] Instance destroyed successfully.
Aug 01 19:53:29 user nova-compute[72504]: DEBUG nova.objects.instance [None req-270f73b5-95ae-4530-a9bd-68a0ead9829a tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lazy-loading 'resources' on Instance uuid 561928fb-3c41-4937-8050-9125614c0641 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:53:29 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:53:29 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919609.6696944, 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:53:29 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] VM Started (Lifecycle Event)
Aug 01 19:53:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-270f73b5-95ae-4530-a9bd-68a0ead9829a tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:49:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-170433704',display_name='tempest-TestVolumeSwap-server-170433704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-170433704',id=7,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdArI2BI+w4OIKAh15lONV9nLC241WS/+xg+KkRdU3FJ6JUxowpmCmivlbwXNGHqYkx1nd2zKGUUnS6kTTXrhL4FLCki3F9ONJWjaVBs6IE2lcRsMdiiJg0Dj/uGvGGWA==',key_name='tempest-keypair-601182215',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:50:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d50a77655071466db7143ff1850d3272',ramdisk_id='',reservation_id='r-61l3jvmf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1100350241',owner_user_name='tempest-TestVolumeSwap-1100350241-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dceab608a5664f638e7b0a3cdfac854a',uuid=561928fb-3c41-4937-8050-9125614c0641,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0a2194f-e3b8-48c4-9157-a35a3f66165b", "address": "fa:16:3e:dc:6f:47", "network": {"id": "40216131-7be3-423d-84ca-9d603526db4b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1648510237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50a77655071466db7143ff1850d3272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a2194f-e3", "ovs_interfaceid": "f0a2194f-e3b8-48c4-9157-a35a3f66165b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-270f73b5-95ae-4530-a9bd-68a0ead9829a tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Converting VIF {"id": "f0a2194f-e3b8-48c4-9157-a35a3f66165b", "address": "fa:16:3e:dc:6f:47", "network": {"id": "40216131-7be3-423d-84ca-9d603526db4b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1648510237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50a77655071466db7143ff1850d3272", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a2194f-e3", "ovs_interfaceid": "f0a2194f-e3b8-48c4-9157-a35a3f66165b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-270f73b5-95ae-4530-a9bd-68a0ead9829a tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:6f:47,bridge_name='br-int',has_traffic_filtering=True,id=f0a2194f-e3b8-48c4-9157-a35a3f66165b,network=Network(40216131-7be3-423d-84ca-9d603526db4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0a2194f-e3') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG os_vif [None req-270f73b5-95ae-4530-a9bd-68a0ead9829a tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:6f:47,bridge_name='br-int',has_traffic_filtering=True,id=f0a2194f-e3b8-48c4-9157-a35a3f66165b,network=Network(40216131-7be3-423d-84ca-9d603526db4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0a2194f-e3') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0a2194f-e3, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:53:29 user nova-compute[72504]: INFO os_vif [None req-270f73b5-95ae-4530-a9bd-68a0ead9829a tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:6f:47,bridge_name='br-int',has_traffic_filtering=True,id=f0a2194f-e3b8-48c4-9157-a35a3f66165b,network=Network(40216131-7be3-423d-84ca-9d603526db4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0a2194f-e3')
Aug 01 19:53:29 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-270f73b5-95ae-4530-a9bd-68a0ead9829a tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Deleting instance files /opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641_del
Aug 01 19:53:29 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-270f73b5-95ae-4530-a9bd-68a0ead9829a tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Deletion of /opt/stack/data/nova/instances/561928fb-3c41-4937-8050-9125614c0641_del complete
Aug 01 19:53:29 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG nova.compute.manager [req-b7cace08-161b-46f1-b66a-9169b5fd1456 req-5a00d165-5627-425f-8118-84d4fa7d6e01 service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Received event network-vif-plugged-88a4a208-7192-4e81-b9b2-1e07e7e307d1 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b7cace08-161b-46f1-b66a-9169b5fd1456 req-5a00d165-5627-425f-8118-84d4fa7d6e01 service nova] Acquiring lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b7cace08-161b-46f1-b66a-9169b5fd1456 req-5a00d165-5627-425f-8118-84d4fa7d6e01 service nova] Lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b7cace08-161b-46f1-b66a-9169b5fd1456 req-5a00d165-5627-425f-8118-84d4fa7d6e01 service nova] Lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG nova.compute.manager [req-b7cace08-161b-46f1-b66a-9169b5fd1456 req-5a00d165-5627-425f-8118-84d4fa7d6e01 service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] No waiting events found dispatching network-vif-plugged-88a4a208-7192-4e81-b9b2-1e07e7e307d1 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:29 user nova-compute[72504]: WARNING nova.compute.manager [req-b7cace08-161b-46f1-b66a-9169b5fd1456 req-5a00d165-5627-425f-8118-84d4fa7d6e01 service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Received unexpected event network-vif-plugged-88a4a208-7192-4e81-b9b2-1e07e7e307d1 for instance with vm_state building and task_state spawning.
Aug 01 19:53:29 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:53:29 user nova-compute[72504]: INFO nova.compute.manager [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Took 8.28 seconds to spawn the instance on the hypervisor.
Aug 01 19:53:29 user nova-compute[72504]: DEBUG nova.compute.manager [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:53:29 user nova-compute[72504]: INFO nova.compute.manager [None req-270f73b5-95ae-4530-a9bd-68a0ead9829a tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] [instance: 561928fb-3c41-4937-8050-9125614c0641] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 01 19:53:29 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-270f73b5-95ae-4530-a9bd-68a0ead9829a tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 561928fb-3c41-4937-8050-9125614c0641] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 19:53:29 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 561928fb-3c41-4937-8050-9125614c0641] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 19:53:29 user nova-compute[72504]: INFO nova.compute.manager [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Took 9.37 seconds to build instance.
Aug 01 19:53:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a6211941-2bf5-4411-8d93-d3b4a69c8fde tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.517s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:30 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919610.2049005, 128c2981-363c-4ae9-b46d-15b5e5d9cac6 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:53:30 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] VM Resumed (Lifecycle Event)
Aug 01 19:53:30 user nova-compute[72504]: DEBUG nova.compute.manager [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:53:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:53:30 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Instance spawned successfully.
Aug 01 19:53:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 19:53:30 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:53:30 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:53:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:53:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:53:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:53:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:53:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:53:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:53:30 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:53:30 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919610.2061555, 128c2981-363c-4ae9-b46d-15b5e5d9cac6 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:53:30 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] VM Started (Lifecycle Event)
Aug 01 19:53:30 user nova-compute[72504]: DEBUG nova.compute.manager [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Stashing vm_state: active {{(pid=72504) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 01 19:53:30 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:53:30 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:53:30 user nova-compute[72504]: INFO nova.compute.manager [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Took 7.67 seconds to spawn the instance on the hypervisor.
Aug 01 19:53:30 user nova-compute[72504]: DEBUG nova.compute.manager [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:53:30 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:53:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:30 user nova-compute[72504]: INFO nova.compute.manager [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Took 9.01 seconds to build instance.
Aug 01 19:53:30 user nova-compute[72504]: DEBUG nova.objects.instance [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lazy-loading 'pci_requests' on Instance uuid 5193c770-80ca-44c3-9950-cb25c65e94e8 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:53:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ae70d127-8bc6-493b-9845-cb92642d3873 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.151s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:30 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:53:30 user nova-compute[72504]: INFO nova.compute.claims [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Claim successful on node user
Aug 01 19:53:30 user nova-compute[72504]: DEBUG nova.objects.instance [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lazy-loading 'resources' on Instance uuid 5193c770-80ca-44c3-9950-cb25c65e94e8 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:53:30 user nova-compute[72504]: DEBUG nova.objects.instance [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lazy-loading 'pci_devices' on Instance uuid 5193c770-80ca-44c3-9950-cb25c65e94e8 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:53:30 user nova-compute[72504]: INFO nova.compute.resource_tracker [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Updating resource usage from migration 4901761c-b8c7-43c6-ae23-07943cf903e4
Aug 01 19:53:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:31 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:53:31 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:53:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.868s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:31 user nova-compute[72504]: INFO nova.compute.manager [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Migrating
Aug 01 19:53:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:53:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:53:31 user nova-compute[72504]: INFO nova.compute.rpcapi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 01 19:53:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:53:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "refresh_cache-5193c770-80ca-44c3-9950-cb25c65e94e8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:53:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquired lock "refresh_cache-5193c770-80ca-44c3-9950-cb25c65e94e8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:53:31 user nova-compute[72504]: DEBUG nova.network.neutron [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:53:31 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 561928fb-3c41-4937-8050-9125614c0641] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:53:31 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 561928fb-3c41-4937-8050-9125614c0641] Took 1.64 seconds to deallocate network for instance.
Aug 01 19:53:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-270f73b5-95ae-4530-a9bd-68a0ead9829a tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-270f73b5-95ae-4530-a9bd-68a0ead9829a tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:31 user nova-compute[72504]: DEBUG nova.compute.manager [req-8b40ab54-cb7e-4559-9d26-2c433d25a004 req-5aa45c78-abb3-43c8-bbaa-0304c93150d6 service nova] [instance: 561928fb-3c41-4937-8050-9125614c0641] Received event network-vif-unplugged-f0a2194f-e3b8-48c4-9157-a35a3f66165b {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-8b40ab54-cb7e-4559-9d26-2c433d25a004 req-5aa45c78-abb3-43c8-bbaa-0304c93150d6 service nova] Acquiring lock "561928fb-3c41-4937-8050-9125614c0641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-8b40ab54-cb7e-4559-9d26-2c433d25a004 req-5aa45c78-abb3-43c8-bbaa-0304c93150d6 service nova] Lock "561928fb-3c41-4937-8050-9125614c0641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-8b40ab54-cb7e-4559-9d26-2c433d25a004 req-5aa45c78-abb3-43c8-bbaa-0304c93150d6 service nova] Lock "561928fb-3c41-4937-8050-9125614c0641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:31 user nova-compute[72504]: DEBUG nova.compute.manager [req-8b40ab54-cb7e-4559-9d26-2c433d25a004 req-5aa45c78-abb3-43c8-bbaa-0304c93150d6 service nova] [instance: 561928fb-3c41-4937-8050-9125614c0641] No waiting events found dispatching network-vif-unplugged-f0a2194f-e3b8-48c4-9157-a35a3f66165b {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:31 user nova-compute[72504]: WARNING nova.compute.manager [req-8b40ab54-cb7e-4559-9d26-2c433d25a004 req-5aa45c78-abb3-43c8-bbaa-0304c93150d6 service nova] [instance: 561928fb-3c41-4937-8050-9125614c0641] Received unexpected event network-vif-unplugged-f0a2194f-e3b8-48c4-9157-a35a3f66165b for instance with vm_state deleted and task_state None.
Aug 01 19:53:31 user nova-compute[72504]: DEBUG nova.compute.manager [req-8b40ab54-cb7e-4559-9d26-2c433d25a004 req-5aa45c78-abb3-43c8-bbaa-0304c93150d6 service nova] [instance: 561928fb-3c41-4937-8050-9125614c0641] Received event network-vif-plugged-f0a2194f-e3b8-48c4-9157-a35a3f66165b {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-8b40ab54-cb7e-4559-9d26-2c433d25a004 req-5aa45c78-abb3-43c8-bbaa-0304c93150d6 service nova] Acquiring lock "561928fb-3c41-4937-8050-9125614c0641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-8b40ab54-cb7e-4559-9d26-2c433d25a004 req-5aa45c78-abb3-43c8-bbaa-0304c93150d6 service nova] Lock "561928fb-3c41-4937-8050-9125614c0641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-8b40ab54-cb7e-4559-9d26-2c433d25a004 req-5aa45c78-abb3-43c8-bbaa-0304c93150d6 service nova] Lock "561928fb-3c41-4937-8050-9125614c0641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:31 user nova-compute[72504]: DEBUG nova.compute.manager [req-8b40ab54-cb7e-4559-9d26-2c433d25a004 req-5aa45c78-abb3-43c8-bbaa-0304c93150d6 service nova] [instance: 561928fb-3c41-4937-8050-9125614c0641] No waiting events found dispatching network-vif-plugged-f0a2194f-e3b8-48c4-9157-a35a3f66165b {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:31 user nova-compute[72504]: WARNING nova.compute.manager [req-8b40ab54-cb7e-4559-9d26-2c433d25a004 req-5aa45c78-abb3-43c8-bbaa-0304c93150d6 service nova] [instance: 561928fb-3c41-4937-8050-9125614c0641] Received unexpected event network-vif-plugged-f0a2194f-e3b8-48c4-9157-a35a3f66165b for instance with vm_state deleted and task_state None.
Aug 01 19:53:31 user nova-compute[72504]: DEBUG nova.compute.manager [req-8b40ab54-cb7e-4559-9d26-2c433d25a004 req-5aa45c78-abb3-43c8-bbaa-0304c93150d6 service nova] [instance: 561928fb-3c41-4937-8050-9125614c0641] Received event network-vif-deleted-f0a2194f-e3b8-48c4-9157-a35a3f66165b {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:32 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-270f73b5-95ae-4530-a9bd-68a0ead9829a tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:53:32 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-270f73b5-95ae-4530-a9bd-68a0ead9829a tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:53:32 user nova-compute[72504]: DEBUG nova.network.neutron [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Updating instance_info_cache with network_info: [{"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:53:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Releasing lock "refresh_cache-5193c770-80ca-44c3-9950-cb25c65e94e8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:53:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-270f73b5-95ae-4530-a9bd-68a0ead9829a tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.548s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:32 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-270f73b5-95ae-4530-a9bd-68a0ead9829a tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Deleted allocations for instance 561928fb-3c41-4937-8050-9125614c0641
Aug 01 19:53:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-270f73b5-95ae-4530-a9bd-68a0ead9829a tempest-TestVolumeSwap-1100350241 tempest-TestVolumeSwap-1100350241-project-member] Lock "561928fb-3c41-4937-8050-9125614c0641" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.481s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Starting migrate_disk_and_power_off {{(pid=72504) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 01 19:53:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:32 user nova-compute[72504]: DEBUG nova.compute.manager [req-384a99d4-2282-45c1-8032-445274f5ad21 req-02f4bb76-f51b-4312-a0ac-506f3bb15a02 service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Received event network-vif-unplugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-384a99d4-2282-45c1-8032-445274f5ad21 req-02f4bb76-f51b-4312-a0ac-506f3bb15a02 service nova] Acquiring lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-384a99d4-2282-45c1-8032-445274f5ad21 req-02f4bb76-f51b-4312-a0ac-506f3bb15a02 service nova] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-384a99d4-2282-45c1-8032-445274f5ad21 req-02f4bb76-f51b-4312-a0ac-506f3bb15a02 service nova] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:32 user nova-compute[72504]: DEBUG nova.compute.manager [req-384a99d4-2282-45c1-8032-445274f5ad21 req-02f4bb76-f51b-4312-a0ac-506f3bb15a02 service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] No waiting events found dispatching network-vif-unplugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:32 user nova-compute[72504]: WARNING nova.compute.manager [req-384a99d4-2282-45c1-8032-445274f5ad21 req-02f4bb76-f51b-4312-a0ac-506f3bb15a02 service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Received unexpected event network-vif-unplugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 for instance with vm_state active and task_state resize_migrating.
Aug 01 19:53:33 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Instance destroyed successfully.
Aug 01 19:53:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:49:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1940907332',display_name='tempest-ServerActionsTestOtherB-server-1940907332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1940907332',id=3,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzhjBwv/fwyuXjW1x6h8vd/kIx1PP+lp3UGnSLHNEmFgbtKuVpQ2lyUbVPsnNcWUwbyAFXlofeww/O420ZBkncMBF2kewUMxpZllUL90MSl7NE91UoBCSbwKPcmnMcunA==',key_name='tempest-keypair-1272671103',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:49:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b6958054d48748c68942fb4d36d5ca8b',ramdisk_id='',reservation_id='r-uhmjifqg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1731713993',owner_user_name='tempest-ServerActionsTestOtherB-1731713993-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:53:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98fd620d741b433ba699e5bbbc5ae1c0',uuid=5193c770-80ca-44c3-9950-cb25c65e94e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-542724405-network", "vif_mac": "fa:16:3e:46:8a:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Converting VIF {"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-542724405-network", "vif_mac": "fa:16:3e:46:8a:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:8a:a8,bridge_name='br-int',has_traffic_filtering=True,id=8f1cca03-e1f6-44db-b8d3-d7a305fc1461,network=Network(a1278c28-de03-4929-8689-60655553da2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cca03-e1') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG os_vif [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:8a:a8,bridge_name='br-int',has_traffic_filtering=True,id=8f1cca03-e1f6-44db-b8d3-d7a305fc1461,network=Network(a1278c28-de03-4929-8689-60655553da2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cca03-e1') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f1cca03-e1, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:33 user nova-compute[72504]: INFO os_vif [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:8a:a8,bridge_name='br-int',has_traffic_filtering=True,id=8f1cca03-e1f6-44db-b8d3-d7a305fc1461,network=Network(a1278c28-de03-4929-8689-60655553da2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cca03-e1')
Aug 01 19:53:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAHmLCZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:53:33 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:53:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ff2678-23e2-441e-8518-8a4d19c2832a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e7fb1c-0f44-4f62-8b9d-22d896c2d1a2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:53:33 user nova-compute[72504]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)
Aug 01 19:53:33 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:53:33 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:53:33 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:53:33 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:53:33 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:53:33 user nova-compute[72504]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)
Aug 01 19:53:33 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:53:33 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:53:33 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:53:33 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:53:33 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff4141c35b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d'): ({'sdc'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Removing single pathed devices sdc {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f2eeee-81d4-44a7-960a-5cbcdf1eae96]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ae174f-e7b2-4db9-8aa5-6d7fd57e66ef]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Flushing IO for device /dev/sdc {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e621b8b8-1143-4258-bc89-449c5bcec667]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e2b69b-c4bd-433d-a4a8-42c0ebf1f25f]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cab2ae9-994e-47f6-acbe-eb4534465da4]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2820fc6-d7d6-4835-b45b-61e2e789807b]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d, portal: 172.16.0.220,3260]
Aug 01 19:53:33 user nova-compute[72504]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d, portal: 172.16.0.220,3260] successful.
Aug 01 19:53:33 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f417120-d6aa-4f94-8ca6-f1f73b31b6a1]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] <== disconnect_volume: return (314ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:53:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8_resize/disk /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:34 user nova-compute[72504]: DEBUG nova.objects.instance [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lazy-loading 'pci_requests' on Instance uuid 76aa3861-0ca1-4e7f-9a15-9219037bc1ee {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:53:34 user nova-compute[72504]: DEBUG nova.objects.instance [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lazy-loading 'numa_topology' on Instance uuid 76aa3861-0ca1-4e7f-9a15-9219037bc1ee {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:53:34 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:53:34 user nova-compute[72504]: INFO nova.compute.claims [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Claim successful on node user
Aug 01 19:53:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] CMD "cp -r /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8_resize/disk /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk" returned: 0 in 0.544s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8_resize/disk.info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk.info {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] CMD "cp -r /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8_resize/disk.info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk.info" returned: 0 in 0.044s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:34 user nova-compute[72504]: DEBUG nova.compute.manager [req-703a5c18-eb8b-42a2-9078-89bf853fbc91 req-f57f7f0e-9971-4225-8e79-2c9a0d059799 service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Received event network-vif-plugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-703a5c18-eb8b-42a2-9078-89bf853fbc91 req-f57f7f0e-9971-4225-8e79-2c9a0d059799 service nova] Acquiring lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-703a5c18-eb8b-42a2-9078-89bf853fbc91 req-f57f7f0e-9971-4225-8e79-2c9a0d059799 service nova] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-703a5c18-eb8b-42a2-9078-89bf853fbc91 req-f57f7f0e-9971-4225-8e79-2c9a0d059799 service nova] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:34 user nova-compute[72504]: DEBUG nova.compute.manager [req-703a5c18-eb8b-42a2-9078-89bf853fbc91 req-f57f7f0e-9971-4225-8e79-2c9a0d059799 service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] No waiting events found dispatching network-vif-plugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:34 user nova-compute[72504]: WARNING nova.compute.manager [req-703a5c18-eb8b-42a2-9078-89bf853fbc91 req-f57f7f0e-9971-4225-8e79-2c9a0d059799 service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Received unexpected event network-vif-plugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 for instance with vm_state active and task_state resize_migrating.
Aug 01 19:53:34 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:53:35 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:53:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.828s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:35 user nova-compute[72504]: INFO nova.network.neutron [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Updating port 2edbeaad-cd66-4a79-9fae-544f2a33e922 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 01 19:53:35 user nova-compute[72504]: DEBUG nova.network.neutron [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Port 8f1cca03-e1f6-44db-b8d3-d7a305fc1461 binding to destination host user is already ACTIVE {{(pid=72504) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 01 19:53:35 user nova-compute[72504]: DEBUG nova.compute.manager [req-b42e070c-9104-4f31-b5dc-c76ec166cd42 req-7a34fe1e-2f3a-4ca0-8e21-9e97586400ef service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-changed-1898db0f-13d0-443c-a15f-bcb85039ecdd {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:35 user nova-compute[72504]: DEBUG nova.compute.manager [req-b42e070c-9104-4f31-b5dc-c76ec166cd42 req-7a34fe1e-2f3a-4ca0-8e21-9e97586400ef service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Refreshing instance network info cache due to event network-changed-1898db0f-13d0-443c-a15f-bcb85039ecdd. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:53:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b42e070c-9104-4f31-b5dc-c76ec166cd42 req-7a34fe1e-2f3a-4ca0-8e21-9e97586400ef service nova] Acquiring lock "refresh_cache-85816260-b37b-4b9e-9b52-f823120645aa" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:53:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b42e070c-9104-4f31-b5dc-c76ec166cd42 req-7a34fe1e-2f3a-4ca0-8e21-9e97586400ef service nova] Acquired lock "refresh_cache-85816260-b37b-4b9e-9b52-f823120645aa" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:53:35 user nova-compute[72504]: DEBUG nova.network.neutron [req-b42e070c-9104-4f31-b5dc-c76ec166cd42 req-7a34fe1e-2f3a-4ca0-8e21-9e97586400ef service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Refreshing network info cache for port 1898db0f-13d0-443c-a15f-bcb85039ecdd {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:53:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "refresh_cache-5193c770-80ca-44c3-9950-cb25c65e94e8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:53:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquired lock "refresh_cache-5193c770-80ca-44c3-9950-cb25c65e94e8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:53:36 user nova-compute[72504]: DEBUG nova.network.neutron [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:53:36 user nova-compute[72504]: DEBUG nova.network.neutron [req-b42e070c-9104-4f31-b5dc-c76ec166cd42 req-7a34fe1e-2f3a-4ca0-8e21-9e97586400ef service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Updated VIF entry in instance network info cache for port 1898db0f-13d0-443c-a15f-bcb85039ecdd. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:53:36 user nova-compute[72504]: DEBUG nova.network.neutron [req-b42e070c-9104-4f31-b5dc-c76ec166cd42 req-7a34fe1e-2f3a-4ca0-8e21-9e97586400ef service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Updating instance_info_cache with network_info: [{"id": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "address": "fa:16:3e:c2:7b:99", "network": {"id": "9ccd7c4b-5d10-4ec8-9f00-f4b269b82d04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1560588778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1898db0f-13", "ovs_interfaceid": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "address": "fa:16:3e:71:06:4f", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d17a5cc-0f", "ovs_interfaceid": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "address": "fa:16:3e:52:80:5a", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769dacee-eb", "ovs_interfaceid": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a5b6139-7885-46c7-9210-676227003327", "address": "fa:16:3e:84:ab:7b", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a5b6139-78", "ovs_interfaceid": "4a5b6139-7885-46c7-9210-676227003327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4fc53eb7-bc35-49cd-af26-52ec96aa2008", "address": "fa:16:3e:ee:80:d5", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc53eb7-bc", "ovs_interfaceid": "4fc53eb7-bc35-49cd-af26-52ec96aa2008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "022ea9fb-47cd-4a25-8217-4dd5f379b522", "address": "fa:16:3e:79:55:d8", "network": {"id": "749ff417-d2f9-4311-b2f7-bbdf0cfd37a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-178411316", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022ea9fb-47", "ovs_interfaceid": "022ea9fb-47cd-4a25-8217-4dd5f379b522", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "address": "fa:16:3e:2a:6f:04", "network": {"id": "749ff417-d2f9-4311-b2f7-bbdf0cfd37a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-178411316", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd0b585f-55", "ovs_interfaceid": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:53:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b42e070c-9104-4f31-b5dc-c76ec166cd42 req-7a34fe1e-2f3a-4ca0-8e21-9e97586400ef service nova] Releasing lock "refresh_cache-85816260-b37b-4b9e-9b52-f823120645aa" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "refresh_cache-76aa3861-0ca1-4e7f-9a15-9219037bc1ee" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquired lock "refresh_cache-76aa3861-0ca1-4e7f-9a15-9219037bc1ee" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG nova.network.neutron [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG nova.network.neutron [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Updating instance_info_cache with network_info: [{"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Releasing lock "refresh_cache-5193c770-80ca-44c3-9950-cb25c65e94e8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG os_brick.utils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dd4470-8d79-4765-a0f1-775047926fea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[027d6548-8ff1-4d34-ab9c-0d253929519b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dda143-493d-40e7-ade5-b32f1d886917]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1a3721-1d58-450c-8918-c2ec45f9c028]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:53:37 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:53:37 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c47be2-e6e1-4af5-b207-5c4b0ce91a47]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG os_brick.utils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG nova.compute.manager [req-2030c2ad-fd38-4812-804b-15f26d57a3a9 req-5afbdd46-386e-4a32-a1a6-88ae725498a1 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Received event network-changed-2edbeaad-cd66-4a79-9fae-544f2a33e922 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG nova.compute.manager [req-2030c2ad-fd38-4812-804b-15f26d57a3a9 req-5afbdd46-386e-4a32-a1a6-88ae725498a1 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Refreshing instance network info cache due to event network-changed-2edbeaad-cd66-4a79-9fae-544f2a33e922. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:53:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2030c2ad-fd38-4812-804b-15f26d57a3a9 req-5afbdd46-386e-4a32-a1a6-88ae725498a1 service nova] Acquiring lock "refresh_cache-76aa3861-0ca1-4e7f-9a15-9219037bc1ee" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:53:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "85816260-b37b-4b9e-9b52-f823120645aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:38 user nova-compute[72504]: INFO nova.compute.manager [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Terminating instance
Aug 01 19:53:38 user nova-compute[72504]: DEBUG nova.compute.manager [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 19:53:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG nova.compute.manager [req-d983d0d9-2907-4898-8293-4e8a343c0a8c req-e5d3b11d-7ea9-431a-bb0d-7f9c2a9ed81e service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-unplugged-1898db0f-13d0-443c-a15f-bcb85039ecdd {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d983d0d9-2907-4898-8293-4e8a343c0a8c req-e5d3b11d-7ea9-431a-bb0d-7f9c2a9ed81e service nova] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d983d0d9-2907-4898-8293-4e8a343c0a8c req-e5d3b11d-7ea9-431a-bb0d-7f9c2a9ed81e service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d983d0d9-2907-4898-8293-4e8a343c0a8c req-e5d3b11d-7ea9-431a-bb0d-7f9c2a9ed81e service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG nova.compute.manager [req-d983d0d9-2907-4898-8293-4e8a343c0a8c req-e5d3b11d-7ea9-431a-bb0d-7f9c2a9ed81e service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] No waiting events found dispatching network-vif-unplugged-1898db0f-13d0-443c-a15f-bcb85039ecdd {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG nova.compute.manager [req-d983d0d9-2907-4898-8293-4e8a343c0a8c req-e5d3b11d-7ea9-431a-bb0d-7f9c2a9ed81e service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-unplugged-1898db0f-13d0-443c-a15f-bcb85039ecdd for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG nova.compute.manager [req-e43e7f62-0962-4420-a437-e3d3c8a101b2 req-eb02ba2e-7f09-42e2-bf90-6515ad0e9a9b service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-unplugged-4d17a5cc-0fda-4d09-9121-baab1fed85e8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e43e7f62-0962-4420-a437-e3d3c8a101b2 req-eb02ba2e-7f09-42e2-bf90-6515ad0e9a9b service nova] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e43e7f62-0962-4420-a437-e3d3c8a101b2 req-eb02ba2e-7f09-42e2-bf90-6515ad0e9a9b service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e43e7f62-0962-4420-a437-e3d3c8a101b2 req-eb02ba2e-7f09-42e2-bf90-6515ad0e9a9b service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.016s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG nova.compute.manager [req-e43e7f62-0962-4420-a437-e3d3c8a101b2 req-eb02ba2e-7f09-42e2-bf90-6515ad0e9a9b service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] No waiting events found dispatching network-vif-unplugged-4d17a5cc-0fda-4d09-9121-baab1fed85e8 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG nova.compute.manager [req-e43e7f62-0962-4420-a437-e3d3c8a101b2 req-eb02ba2e-7f09-42e2-bf90-6515ad0e9a9b service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-unplugged-4d17a5cc-0fda-4d09-9121-baab1fed85e8 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG nova.network.neutron [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Updating instance_info_cache with network_info: [{"id": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "address": "fa:16:3e:a8:fa:27", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2edbeaad-cd", "ovs_interfaceid": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Releasing lock "refresh_cache-76aa3861-0ca1-4e7f-9a15-9219037bc1ee" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:53:39 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Creating image(s)
Aug 01 19:53:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "/opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "/opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "/opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG nova.objects.instance [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lazy-loading 'trusted_certs' on Instance uuid 76aa3861-0ca1-4e7f-9a15-9219037bc1ee {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2030c2ad-fd38-4812-804b-15f26d57a3a9 req-5afbdd46-386e-4a32-a1a6-88ae725498a1 service nova] Acquired lock "refresh_cache-76aa3861-0ca1-4e7f-9a15-9219037bc1ee" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG nova.network.neutron [req-2030c2ad-fd38-4812-804b-15f26d57a3a9 req-5afbdd46-386e-4a32-a1a6-88ae725498a1 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Refreshing network info cache for port 2edbeaad-cd66-4a79-9fae-544f2a33e922 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "58bddab1984b0b8f716d61b28c9375b6fa2c07aa" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "58bddab1984b0b8f716d61b28c9375b6fa2c07aa" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58bddab1984b0b8f716d61b28c9375b6fa2c07aa.part --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-plugged-1898db0f-13d0-443c-a15f-bcb85039ecdd {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] No waiting events found dispatching network-vif-plugged-1898db0f-13d0-443c-a15f-bcb85039ecdd {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:41 user nova-compute[72504]: WARNING nova.compute.manager [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received unexpected event network-vif-plugged-1898db0f-13d0-443c-a15f-bcb85039ecdd for instance with vm_state active and task_state deleting.
Aug 01 19:53:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-unplugged-769dacee-ebe9-47f8-994f-1d59b15e2a1b {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] No waiting events found dispatching network-vif-unplugged-769dacee-ebe9-47f8-994f-1d59b15e2a1b {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-unplugged-769dacee-ebe9-47f8-994f-1d59b15e2a1b for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-plugged-769dacee-ebe9-47f8-994f-1d59b15e2a1b {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] No waiting events found dispatching network-vif-plugged-769dacee-ebe9-47f8-994f-1d59b15e2a1b {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:41 user nova-compute[72504]: WARNING nova.compute.manager [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received unexpected event network-vif-plugged-769dacee-ebe9-47f8-994f-1d59b15e2a1b for instance with vm_state active and task_state deleting.
Aug 01 19:53:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-unplugged-022ea9fb-47cd-4a25-8217-4dd5f379b522 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] No waiting events found dispatching network-vif-unplugged-022ea9fb-47cd-4a25-8217-4dd5f379b522 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-unplugged-022ea9fb-47cd-4a25-8217-4dd5f379b522 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-plugged-022ea9fb-47cd-4a25-8217-4dd5f379b522 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] No waiting events found dispatching network-vif-plugged-022ea9fb-47cd-4a25-8217-4dd5f379b522 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:41 user nova-compute[72504]: WARNING nova.compute.manager [req-55abbb62-ce1d-438c-b4d1-c6baf972af5a req-595fac83-f0dd-4a6e-ae0f-1e443a3cc547 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received unexpected event network-vif-plugged-022ea9fb-47cd-4a25-8217-4dd5f379b522 for instance with vm_state active and task_state deleting.
Aug 01 19:53:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-55303c41-aa9c-441b-99a7-6d24d4de08fe req-174313d7-e466-4b25-8983-c663ed527173 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-plugged-4d17a5cc-0fda-4d09-9121-baab1fed85e8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-55303c41-aa9c-441b-99a7-6d24d4de08fe req-174313d7-e466-4b25-8983-c663ed527173 service nova] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-55303c41-aa9c-441b-99a7-6d24d4de08fe req-174313d7-e466-4b25-8983-c663ed527173 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-55303c41-aa9c-441b-99a7-6d24d4de08fe req-174313d7-e466-4b25-8983-c663ed527173 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-55303c41-aa9c-441b-99a7-6d24d4de08fe req-174313d7-e466-4b25-8983-c663ed527173 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] No waiting events found dispatching network-vif-plugged-4d17a5cc-0fda-4d09-9121-baab1fed85e8 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:41 user nova-compute[72504]: WARNING nova.compute.manager [req-55303c41-aa9c-441b-99a7-6d24d4de08fe req-174313d7-e466-4b25-8983-c663ed527173 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received unexpected event network-vif-plugged-4d17a5cc-0fda-4d09-9121-baab1fed85e8 for instance with vm_state active and task_state deleting.
Aug 01 19:53:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-55303c41-aa9c-441b-99a7-6d24d4de08fe req-174313d7-e466-4b25-8983-c663ed527173 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-unplugged-4a5b6139-7885-46c7-9210-676227003327 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-55303c41-aa9c-441b-99a7-6d24d4de08fe req-174313d7-e466-4b25-8983-c663ed527173 service nova] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-55303c41-aa9c-441b-99a7-6d24d4de08fe req-174313d7-e466-4b25-8983-c663ed527173 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-55303c41-aa9c-441b-99a7-6d24d4de08fe req-174313d7-e466-4b25-8983-c663ed527173 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-55303c41-aa9c-441b-99a7-6d24d4de08fe req-174313d7-e466-4b25-8983-c663ed527173 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] No waiting events found dispatching network-vif-unplugged-4a5b6139-7885-46c7-9210-676227003327 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-55303c41-aa9c-441b-99a7-6d24d4de08fe req-174313d7-e466-4b25-8983-c663ed527173 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-unplugged-4a5b6139-7885-46c7-9210-676227003327 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-55303c41-aa9c-441b-99a7-6d24d4de08fe req-174313d7-e466-4b25-8983-c663ed527173 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-plugged-4a5b6139-7885-46c7-9210-676227003327 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-55303c41-aa9c-441b-99a7-6d24d4de08fe req-174313d7-e466-4b25-8983-c663ed527173 service nova] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-55303c41-aa9c-441b-99a7-6d24d4de08fe req-174313d7-e466-4b25-8983-c663ed527173 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-55303c41-aa9c-441b-99a7-6d24d4de08fe req-174313d7-e466-4b25-8983-c663ed527173 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-55303c41-aa9c-441b-99a7-6d24d4de08fe req-174313d7-e466-4b25-8983-c663ed527173 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] No waiting events found dispatching network-vif-plugged-4a5b6139-7885-46c7-9210-676227003327 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:41 user nova-compute[72504]: WARNING nova.compute.manager [req-55303c41-aa9c-441b-99a7-6d24d4de08fe req-174313d7-e466-4b25-8983-c663ed527173 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received unexpected event network-vif-plugged-4a5b6139-7885-46c7-9210-676227003327 for instance with vm_state active and task_state deleting.
Aug 01 19:53:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-55303c41-aa9c-441b-99a7-6d24d4de08fe req-174313d7-e466-4b25-8983-c663ed527173 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-unplugged-4fc53eb7-bc35-49cd-af26-52ec96aa2008 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-55303c41-aa9c-441b-99a7-6d24d4de08fe req-174313d7-e466-4b25-8983-c663ed527173 service nova] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-55303c41-aa9c-441b-99a7-6d24d4de08fe req-174313d7-e466-4b25-8983-c663ed527173 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-55303c41-aa9c-441b-99a7-6d24d4de08fe req-174313d7-e466-4b25-8983-c663ed527173 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-55303c41-aa9c-441b-99a7-6d24d4de08fe req-174313d7-e466-4b25-8983-c663ed527173 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] No waiting events found dispatching network-vif-unplugged-4fc53eb7-bc35-49cd-af26-52ec96aa2008 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-55303c41-aa9c-441b-99a7-6d24d4de08fe req-174313d7-e466-4b25-8983-c663ed527173 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-unplugged-4fc53eb7-bc35-49cd-af26-52ec96aa2008 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58bddab1984b0b8f716d61b28c9375b6fa2c07aa.part --force-share --output=json" returned: 0 in 0.170s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG nova.virt.images [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] ea371bc6-8609-46a0-8872-1a045bf33672 was qcow2, converting to raw {{(pid=72504) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG nova.privsep.utils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72504) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 19:53:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/58bddab1984b0b8f716d61b28c9375b6fa2c07aa.part /opt/stack/data/nova/instances/_base/58bddab1984b0b8f716d61b28c9375b6fa2c07aa.converted {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:41 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Instance destroyed successfully.
Aug 01 19:53:41 user nova-compute[72504]: DEBUG nova.objects.instance [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lazy-loading 'resources' on Instance uuid 85816260-b37b-4b9e-9b52-f823120645aa {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957777004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-957777004',id=10,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3fHv2po9fI8JWLJ/STotCC/ZMt1usNvDJY9OhHFX37UU3G4ImUWgVManPneIT3OQbzL9S8YjwTKJ0753XHtgZTG443G0jU6eMV/ruR8/RM1GoV1Hc8J2PbUW4LxIr9KA==',key_name='tempest-keypair-1242269901',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:51:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87a15b5dc83241d9a0bfd3df652e08a5',ramdisk_id='',reservation_id='r-har3d7vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1825089340',owner_user_name='tempest-TaggedBootDevicesTest_v242-1825089340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:51:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2947163cbc44c7b8e0d1a251ec2c906',uuid=85816260-b37b-4b9e-9b52-f823120645aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "address": "fa:16:3e:c2:7b:99", "network": {"id": "9ccd7c4b-5d10-4ec8-9f00-f4b269b82d04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1560588778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1898db0f-13", "ovs_interfaceid": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converting VIF {"id": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "address": "fa:16:3e:c2:7b:99", "network": {"id": "9ccd7c4b-5d10-4ec8-9f00-f4b269b82d04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1560588778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1898db0f-13", "ovs_interfaceid": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:7b:99,bridge_name='br-int',has_traffic_filtering=True,id=1898db0f-13d0-443c-a15f-bcb85039ecdd,network=Network(9ccd7c4b-5d10-4ec8-9f00-f4b269b82d04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1898db0f-13') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG os_vif [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:7b:99,bridge_name='br-int',has_traffic_filtering=True,id=1898db0f-13d0-443c-a15f-bcb85039ecdd,network=Network(9ccd7c4b-5d10-4ec8-9f00-f4b269b82d04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1898db0f-13') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1898db0f-13, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:42 user nova-compute[72504]: INFO os_vif [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:7b:99,bridge_name='br-int',has_traffic_filtering=True,id=1898db0f-13d0-443c-a15f-bcb85039ecdd,network=Network(9ccd7c4b-5d10-4ec8-9f00-f4b269b82d04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1898db0f-13')
Aug 01 19:53:42 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957777004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-957777004',id=10,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3fHv2po9fI8JWLJ/STotCC/ZMt1usNvDJY9OhHFX37UU3G4ImUWgVManPneIT3OQbzL9S8YjwTKJ0753XHtgZTG443G0jU6eMV/ruR8/RM1GoV1Hc8J2PbUW4LxIr9KA==',key_name='tempest-keypair-1242269901',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:51:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87a15b5dc83241d9a0bfd3df652e08a5',ramdisk_id='',reservation_id='r-har3d7vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1825089340',owner_user_name='tempest-TaggedBootDevicesTest_v242-1825089340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:51:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2947163cbc44c7b8e0d1a251ec2c906',uuid=85816260-b37b-4b9e-9b52-f823120645aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "address": "fa:16:3e:71:06:4f", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d17a5cc-0f", "ovs_interfaceid": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converting VIF {"id": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "address": "fa:16:3e:71:06:4f", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d17a5cc-0f", "ovs_interfaceid": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:06:4f,bridge_name='br-int',has_traffic_filtering=True,id=4d17a5cc-0fda-4d09-9121-baab1fed85e8,network=Network(c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4d17a5cc-0f') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG os_vif [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:06:4f,bridge_name='br-int',has_traffic_filtering=True,id=4d17a5cc-0fda-4d09-9121-baab1fed85e8,network=Network(c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4d17a5cc-0f') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d17a5cc-0f, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/58bddab1984b0b8f716d61b28c9375b6fa2c07aa.part /opt/stack/data/nova/instances/_base/58bddab1984b0b8f716d61b28c9375b6fa2c07aa.converted" returned: 0 in 0.333s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58bddab1984b0b8f716d61b28c9375b6fa2c07aa.converted --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:42 user nova-compute[72504]: INFO os_vif [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:06:4f,bridge_name='br-int',has_traffic_filtering=True,id=4d17a5cc-0fda-4d09-9121-baab1fed85e8,network=Network(c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4d17a5cc-0f')
Aug 01 19:53:42 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957777004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-957777004',id=10,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3fHv2po9fI8JWLJ/STotCC/ZMt1usNvDJY9OhHFX37UU3G4ImUWgVManPneIT3OQbzL9S8YjwTKJ0753XHtgZTG443G0jU6eMV/ruR8/RM1GoV1Hc8J2PbUW4LxIr9KA==',key_name='tempest-keypair-1242269901',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:51:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87a15b5dc83241d9a0bfd3df652e08a5',ramdisk_id='',reservation_id='r-har3d7vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1825089340',owner_user_name='tempest-TaggedBootDevicesTest_v242-1825089340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:51:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2947163cbc44c7b8e0d1a251ec2c906',uuid=85816260-b37b-4b9e-9b52-f823120645aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "address": "fa:16:3e:52:80:5a", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769dacee-eb", "ovs_interfaceid": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converting VIF {"id": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "address": "fa:16:3e:52:80:5a", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769dacee-eb", "ovs_interfaceid": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:80:5a,bridge_name='br-int',has_traffic_filtering=True,id=769dacee-ebe9-47f8-994f-1d59b15e2a1b,network=Network(c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap769dacee-eb') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG os_vif [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:80:5a,bridge_name='br-int',has_traffic_filtering=True,id=769dacee-ebe9-47f8-994f-1d59b15e2a1b,network=Network(c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap769dacee-eb') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap769dacee-eb, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:42 user nova-compute[72504]: INFO os_vif [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:80:5a,bridge_name='br-int',has_traffic_filtering=True,id=769dacee-ebe9-47f8-994f-1d59b15e2a1b,network=Network(c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap769dacee-eb')
Aug 01 19:53:42 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957777004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-957777004',id=10,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3fHv2po9fI8JWLJ/STotCC/ZMt1usNvDJY9OhHFX37UU3G4ImUWgVManPneIT3OQbzL9S8YjwTKJ0753XHtgZTG443G0jU6eMV/ruR8/RM1GoV1Hc8J2PbUW4LxIr9KA==',key_name='tempest-keypair-1242269901',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:51:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87a15b5dc83241d9a0bfd3df652e08a5',ramdisk_id='',reservation_id='r-har3d7vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1825089340',owner_user_name='tempest-TaggedBootDevicesTest_v242-1825089340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:51:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2947163cbc44c7b8e0d1a251ec2c906',uuid=85816260-b37b-4b9e-9b52-f823120645aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a5b6139-7885-46c7-9210-676227003327", "address": "fa:16:3e:84:ab:7b", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a5b6139-78", "ovs_interfaceid": "4a5b6139-7885-46c7-9210-676227003327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converting VIF {"id": "4a5b6139-7885-46c7-9210-676227003327", "address": "fa:16:3e:84:ab:7b", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a5b6139-78", "ovs_interfaceid": "4a5b6139-7885-46c7-9210-676227003327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:ab:7b,bridge_name='br-int',has_traffic_filtering=True,id=4a5b6139-7885-46c7-9210-676227003327,network=Network(c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a5b6139-78') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG os_vif [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ab:7b,bridge_name='br-int',has_traffic_filtering=True,id=4a5b6139-7885-46c7-9210-676227003327,network=Network(c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a5b6139-78') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a5b6139-78, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG nova.network.neutron [req-2030c2ad-fd38-4812-804b-15f26d57a3a9 req-5afbdd46-386e-4a32-a1a6-88ae725498a1 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Updated VIF entry in instance network info cache for port 2edbeaad-cd66-4a79-9fae-544f2a33e922. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG nova.network.neutron [req-2030c2ad-fd38-4812-804b-15f26d57a3a9 req-5afbdd46-386e-4a32-a1a6-88ae725498a1 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Updating instance_info_cache with network_info: [{"id": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "address": "fa:16:3e:a8:fa:27", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2edbeaad-cd", "ovs_interfaceid": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58bddab1984b0b8f716d61b28c9375b6fa2c07aa.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "58bddab1984b0b8f716d61b28c9375b6fa2c07aa" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.508s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58bddab1984b0b8f716d61b28c9375b6fa2c07aa --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2030c2ad-fd38-4812-804b-15f26d57a3a9 req-5afbdd46-386e-4a32-a1a6-88ae725498a1 service nova] Releasing lock "refresh_cache-76aa3861-0ca1-4e7f-9a15-9219037bc1ee" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:53:42 user nova-compute[72504]: INFO os_vif [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ab:7b,bridge_name='br-int',has_traffic_filtering=True,id=4a5b6139-7885-46c7-9210-676227003327,network=Network(c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a5b6139-78')
Aug 01 19:53:42 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957777004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-957777004',id=10,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3fHv2po9fI8JWLJ/STotCC/ZMt1usNvDJY9OhHFX37UU3G4ImUWgVManPneIT3OQbzL9S8YjwTKJ0753XHtgZTG443G0jU6eMV/ruR8/RM1GoV1Hc8J2PbUW4LxIr9KA==',key_name='tempest-keypair-1242269901',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:51:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87a15b5dc83241d9a0bfd3df652e08a5',ramdisk_id='',reservation_id='r-har3d7vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1825089340',owner_user_name='tempest-TaggedBootDevicesTest_v242-1825089340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:51:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2947163cbc44c7b8e0d1a251ec2c906',uuid=85816260-b37b-4b9e-9b52-f823120645aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fc53eb7-bc35-49cd-af26-52ec96aa2008", "address": "fa:16:3e:ee:80:d5", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc53eb7-bc", "ovs_interfaceid": "4fc53eb7-bc35-49cd-af26-52ec96aa2008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converting VIF {"id": "4fc53eb7-bc35-49cd-af26-52ec96aa2008", "address": "fa:16:3e:ee:80:d5", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc53eb7-bc", "ovs_interfaceid": "4fc53eb7-bc35-49cd-af26-52ec96aa2008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:80:d5,bridge_name='br-int',has_traffic_filtering=True,id=4fc53eb7-bc35-49cd-af26-52ec96aa2008,network=Network(c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fc53eb7-bc') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG os_vif [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:80:d5,bridge_name='br-int',has_traffic_filtering=True,id=4fc53eb7-bc35-49cd-af26-52ec96aa2008,network=Network(c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fc53eb7-bc') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fc53eb7-bc, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:42 user nova-compute[72504]: INFO os_vif [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:80:d5,bridge_name='br-int',has_traffic_filtering=True,id=4fc53eb7-bc35-49cd-af26-52ec96aa2008,network=Network(c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fc53eb7-bc')
Aug 01 19:53:42 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957777004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-957777004',id=10,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3fHv2po9fI8JWLJ/STotCC/ZMt1usNvDJY9OhHFX37UU3G4ImUWgVManPneIT3OQbzL9S8YjwTKJ0753XHtgZTG443G0jU6eMV/ruR8/RM1GoV1Hc8J2PbUW4LxIr9KA==',key_name='tempest-keypair-1242269901',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:51:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87a15b5dc83241d9a0bfd3df652e08a5',ramdisk_id='',reservation_id='r-har3d7vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1825089340',owner_user_name='tempest-TaggedBootDevicesTest_v242-1825089340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:51:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2947163cbc44c7b8e0d1a251ec2c906',uuid=85816260-b37b-4b9e-9b52-f823120645aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "022ea9fb-47cd-4a25-8217-4dd5f379b522", "address": "fa:16:3e:79:55:d8", "network": {"id": "749ff417-d2f9-4311-b2f7-bbdf0cfd37a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-178411316", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022ea9fb-47", "ovs_interfaceid": "022ea9fb-47cd-4a25-8217-4dd5f379b522", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converting VIF {"id": "022ea9fb-47cd-4a25-8217-4dd5f379b522", "address": "fa:16:3e:79:55:d8", "network": {"id": "749ff417-d2f9-4311-b2f7-bbdf0cfd37a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-178411316", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap022ea9fb-47", "ovs_interfaceid": "022ea9fb-47cd-4a25-8217-4dd5f379b522", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:55:d8,bridge_name='br-int',has_traffic_filtering=True,id=022ea9fb-47cd-4a25-8217-4dd5f379b522,network=Network(749ff417-d2f9-4311-b2f7-bbdf0cfd37a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap022ea9fb-47') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG os_vif [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:55:d8,bridge_name='br-int',has_traffic_filtering=True,id=022ea9fb-47cd-4a25-8217-4dd5f379b522,network=Network(749ff417-d2f9-4311-b2f7-bbdf0cfd37a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap022ea9fb-47') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap022ea9fb-47, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:42 user nova-compute[72504]: INFO os_vif [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:55:d8,bridge_name='br-int',has_traffic_filtering=True,id=022ea9fb-47cd-4a25-8217-4dd5f379b522,network=Network(749ff417-d2f9-4311-b2f7-bbdf0cfd37a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap022ea9fb-47')
Aug 01 19:53:42 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957777004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-957777004',id=10,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3fHv2po9fI8JWLJ/STotCC/ZMt1usNvDJY9OhHFX37UU3G4ImUWgVManPneIT3OQbzL9S8YjwTKJ0753XHtgZTG443G0jU6eMV/ruR8/RM1GoV1Hc8J2PbUW4LxIr9KA==',key_name='tempest-keypair-1242269901',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:51:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87a15b5dc83241d9a0bfd3df652e08a5',ramdisk_id='',reservation_id='r-har3d7vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1825089340',owner_user_name='tempest-TaggedBootDevicesTest_v242-1825089340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:51:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2947163cbc44c7b8e0d1a251ec2c906',uuid=85816260-b37b-4b9e-9b52-f823120645aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "address": "fa:16:3e:2a:6f:04", "network": {"id": "749ff417-d2f9-4311-b2f7-bbdf0cfd37a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-178411316", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd0b585f-55", "ovs_interfaceid": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converting VIF {"id": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "address": "fa:16:3e:2a:6f:04", "network": {"id": "749ff417-d2f9-4311-b2f7-bbdf0cfd37a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-178411316", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd0b585f-55", "ovs_interfaceid": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:6f:04,bridge_name='br-int',has_traffic_filtering=True,id=fd0b585f-558c-44a1-a5a3-24f825aa19e0,network=Network(749ff417-d2f9-4311-b2f7-bbdf0cfd37a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd0b585f-55') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG os_vif [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:6f:04,bridge_name='br-int',has_traffic_filtering=True,id=fd0b585f-558c-44a1-a5a3-24f825aa19e0,network=Network(749ff417-d2f9-4311-b2f7-bbdf0cfd37a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd0b585f-55') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58bddab1984b0b8f716d61b28c9375b6fa2c07aa --force-share --output=json" returned: 0 in 0.161s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd0b585f-55, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "58bddab1984b0b8f716d61b28c9375b6fa2c07aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "58bddab1984b0b8f716d61b28c9375b6fa2c07aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58bddab1984b0b8f716d61b28c9375b6fa2c07aa --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:53:42 user nova-compute[72504]: INFO os_vif [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:6f:04,bridge_name='br-int',has_traffic_filtering=True,id=fd0b585f-558c-44a1-a5a3-24f825aa19e0,network=Network(749ff417-d2f9-4311-b2f7-bbdf0cfd37a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd0b585f-55')
Aug 01 19:53:42 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QusanyjN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:53:42 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:53:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d7facb-0766-4696-812e-a9819844258d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8829159-36e2-4cc9-b229-2b83179813a9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:53:42 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:53:42 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:53:42 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:53:42 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:53:42 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:53:42 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:53:42 user nova-compute[72504]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 (non-flash)
Aug 01 19:53:42 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:53:42 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:53:42 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff40c348dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315'): ({'sdf'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Removing single pathed devices sdf {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58bddab1984b0b8f716d61b28c9375b6fa2c07aa --force-share --output=json" returned: 0 in 0.156s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/58bddab1984b0b8f716d61b28c9375b6fa2c07aa,backing_fmt=raw /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57a856b-5908-4bcc-b613-bbab28c0703f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1d7386-1667-4a13-92fe-5337ebdafe27]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Flushing IO for device /dev/sdf {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:53:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/58bddab1984b0b8f716d61b28c9375b6fa2c07aa,backing_fmt=raw /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk 1073741824" returned: 0 in 0.196s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "58bddab1984b0b8f716d61b28c9375b6fa2c07aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.356s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58bddab1984b0b8f716d61b28c9375b6fa2c07aa --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.109s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[011427b7-99db-4bd8-9947-6e80997e7a2b]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.068s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fdb24b-701b-4503-9e7f-2e83da7c4cfc]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] SCSI volumes sdf have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58bddab1984b0b8f716d61b28c9375b6fa2c07aa --force-share --output=json" returned: 0 in 0.171s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG nova.objects.instance [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lazy-loading 'migration_context' on Instance uuid 76aa3861-0ca1-4e7f-9a15-9219037bc1ee {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.051s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3aa28f8-33df-48cd-be43-4be94c33b04d]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:43 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Rebasing disk image.
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3864dd-0d35-4890-8d29-7ac0d8839238]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315, portal: 172.16.0.220,3260]
Aug 01 19:53:43 user nova-compute[72504]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315, portal: 172.16.0.220,3260] successful.
Aug 01 19:53:43 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2593357d-b560-4929-b260-d3ae1c633315 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[631577aa-c590-49fa-8a92-3190965e1693]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.614s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] <== disconnect_volume: return (617ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BdQpAIvM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:53:43 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a00834-a3c9-46cc-8504-6420975f0548]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.172s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 -F raw /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfa9c91-584b-42bb-84c7-c45d2520ef83]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:53:43 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:53:43 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:53:43 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:53:43 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:53:43 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:53:43 user nova-compute[72504]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 (non-flash)
Aug 01 19:53:43 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:53:43 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff414188310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2'): ({'sdg'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Removing single pathed devices sdg {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a07347-6742-4728-b46e-b1f1627d8eac]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e7c2f1-071d-4764-9289-f6fd1b610859]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Flushing IO for device /dev/sdg {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2886168-72d4-48e9-8c46-603d58b938fa]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.055s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2ff965-f52e-408a-ba08-a63a25ae83fe]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] SCSI volumes sdg have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d98efb-061c-44b1-9a8a-5620b547f869]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb635b61-53c3-4f08-b4de-6b53950e4479]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2, portal: 172.16.0.220,3260]
Aug 01 19:53:43 user nova-compute[72504]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2, portal: 172.16.0.220,3260] successful.
Aug 01 19:53:43 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ef687e5-d914-480f-824a-371a3117d9d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa50232e-c2b3-466c-ac4c-358bec6f79ab]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] <== disconnect_volume: return (396ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTxOgwEu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:53:43 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c018ff-b731-4f09-9ee2-fadc0d5ec7da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b010a6ab-f762-4f57-b10f-4da0d72fbbbc]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:53:43 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:53:43 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:53:43 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:53:43 user nova-compute[72504]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 (non-flash)
Aug 01 19:53:43 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:53:43 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff414188310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4'): ({'sde'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Removing single pathed devices sde {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[65752b57-ebe7-4884-9c8b-cfb44e0ccb52]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.032s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee608b4-c9db-4c3f-8b2f-9f186cfc20ba]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Flushing IO for device /dev/sde {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be31975-91b6-47dc-8e85-b05914adf7db]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG nova.compute.manager [req-4f8db0fc-8f8c-470f-b940-71466080957f req-df2989f5-f727-4c9d-9d9e-099538647fd7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-plugged-4fc53eb7-bc35-49cd-af26-52ec96aa2008 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4f8db0fc-8f8c-470f-b940-71466080957f req-df2989f5-f727-4c9d-9d9e-099538647fd7 service nova] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4f8db0fc-8f8c-470f-b940-71466080957f req-df2989f5-f727-4c9d-9d9e-099538647fd7 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4f8db0fc-8f8c-470f-b940-71466080957f req-df2989f5-f727-4c9d-9d9e-099538647fd7 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG nova.compute.manager [req-4f8db0fc-8f8c-470f-b940-71466080957f req-df2989f5-f727-4c9d-9d9e-099538647fd7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] No waiting events found dispatching network-vif-plugged-4fc53eb7-bc35-49cd-af26-52ec96aa2008 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:43 user nova-compute[72504]: WARNING nova.compute.manager [req-4f8db0fc-8f8c-470f-b940-71466080957f req-df2989f5-f727-4c9d-9d9e-099538647fd7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received unexpected event network-vif-plugged-4fc53eb7-bc35-49cd-af26-52ec96aa2008 for instance with vm_state active and task_state deleting.
Aug 01 19:53:43 user nova-compute[72504]: DEBUG nova.compute.manager [req-4f8db0fc-8f8c-470f-b940-71466080957f req-df2989f5-f727-4c9d-9d9e-099538647fd7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-unplugged-fd0b585f-558c-44a1-a5a3-24f825aa19e0 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4f8db0fc-8f8c-470f-b940-71466080957f req-df2989f5-f727-4c9d-9d9e-099538647fd7 service nova] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4f8db0fc-8f8c-470f-b940-71466080957f req-df2989f5-f727-4c9d-9d9e-099538647fd7 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4f8db0fc-8f8c-470f-b940-71466080957f req-df2989f5-f727-4c9d-9d9e-099538647fd7 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG nova.compute.manager [req-4f8db0fc-8f8c-470f-b940-71466080957f req-df2989f5-f727-4c9d-9d9e-099538647fd7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] No waiting events found dispatching network-vif-unplugged-fd0b585f-558c-44a1-a5a3-24f825aa19e0 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG nova.compute.manager [req-4f8db0fc-8f8c-470f-b940-71466080957f req-df2989f5-f727-4c9d-9d9e-099538647fd7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-unplugged-fd0b585f-558c-44a1-a5a3-24f825aa19e0 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG nova.compute.manager [req-4f8db0fc-8f8c-470f-b940-71466080957f req-df2989f5-f727-4c9d-9d9e-099538647fd7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-plugged-fd0b585f-558c-44a1-a5a3-24f825aa19e0 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4f8db0fc-8f8c-470f-b940-71466080957f req-df2989f5-f727-4c9d-9d9e-099538647fd7 service nova] Acquiring lock "85816260-b37b-4b9e-9b52-f823120645aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4f8db0fc-8f8c-470f-b940-71466080957f req-df2989f5-f727-4c9d-9d9e-099538647fd7 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4f8db0fc-8f8c-470f-b940-71466080957f req-df2989f5-f727-4c9d-9d9e-099538647fd7 service nova] Lock "85816260-b37b-4b9e-9b52-f823120645aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG nova.compute.manager [req-4f8db0fc-8f8c-470f-b940-71466080957f req-df2989f5-f727-4c9d-9d9e-099538647fd7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] No waiting events found dispatching network-vif-plugged-fd0b585f-558c-44a1-a5a3-24f825aa19e0 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:43 user nova-compute[72504]: WARNING nova.compute.manager [req-4f8db0fc-8f8c-470f-b940-71466080957f req-df2989f5-f727-4c9d-9d9e-099538647fd7 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received unexpected event network-vif-plugged-fd0b585f-558c-44a1-a5a3-24f825aa19e0 for instance with vm_state active and task_state deleting.
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.064s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7fa059-66b9-468b-b408-e4fe4cbd0c5e]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:53:43 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] SCSI volumes sde have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df93ad2-e096-48a3-9281-de715911ee29]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-5632de58-04c5-47be-915e-f39a18b5c6d0 req-16065c35-3f96-42e5-87e0-f0d079a3dadc service nova] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Received event network-changed-aee39726-8236-4507-8bec-fc1b40eafbba {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-5632de58-04c5-47be-915e-f39a18b5c6d0 req-16065c35-3f96-42e5-87e0-f0d079a3dadc service nova] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Refreshing instance network info cache due to event network-changed-aee39726-8236-4507-8bec-fc1b40eafbba. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5632de58-04c5-47be-915e-f39a18b5c6d0 req-16065c35-3f96-42e5-87e0-f0d079a3dadc service nova] Acquiring lock "refresh_cache-840f652e-bd31-4cb0-bd52-2873a641d876" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5632de58-04c5-47be-915e-f39a18b5c6d0 req-16065c35-3f96-42e5-87e0-f0d079a3dadc service nova] Acquired lock "refresh_cache-840f652e-bd31-4cb0-bd52-2873a641d876" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG nova.network.neutron [req-5632de58-04c5-47be-915e-f39a18b5c6d0 req-16065c35-3f96-42e5-87e0-f0d079a3dadc service nova] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Refreshing network info cache for port aee39726-8236-4507-8bec-fc1b40eafbba {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9174fa40-56ec-4f4c-a94e-a41b94c052e7]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4, portal: 172.16.0.220,3260]
Aug 01 19:53:44 user nova-compute[72504]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4, portal: 172.16.0.220,3260] successful.
Aug 01 19:53:44 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f573b520-1dce-4ba8-b09f-7234510e28f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c42e89-6b4e-49f2-9b0b-79d945f9af8c]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] <== disconnect_volume: return (421ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:53:44 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Deleting instance files /opt/stack/data/nova/instances/85816260-b37b-4b9e-9b52-f823120645aa_del
Aug 01 19:53:44 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Deletion of /opt/stack/data/nova/instances/85816260-b37b-4b9e-9b52-f823120645aa_del complete
Aug 01 19:53:44 user nova-compute[72504]: INFO nova.compute.manager [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Took 5.44 seconds to destroy the instance on the hypervisor.
Aug 01 19:53:44 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b0611e8a-3731-4a25-a8ce-f6a65f826672 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "840f652e-bd31-4cb0-bd52-2873a641d876" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b0611e8a-3731-4a25-a8ce-f6a65f826672 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "840f652e-bd31-4cb0-bd52-2873a641d876" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b0611e8a-3731-4a25-a8ce-f6a65f826672 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "840f652e-bd31-4cb0-bd52-2873a641d876-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b0611e8a-3731-4a25-a8ce-f6a65f826672 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "840f652e-bd31-4cb0-bd52-2873a641d876-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b0611e8a-3731-4a25-a8ce-f6a65f826672 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "840f652e-bd31-4cb0-bd52-2873a641d876-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:44 user nova-compute[72504]: INFO nova.compute.manager [None req-b0611e8a-3731-4a25-a8ce-f6a65f826672 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Terminating instance
Aug 01 19:53:44 user nova-compute[72504]: DEBUG nova.compute.manager [None req-b0611e8a-3731-4a25-a8ce-f6a65f826672 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:44 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690919609.7207434, 561928fb-3c41-4937-8050-9125614c0641 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:53:44 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 561928fb-3c41-4937-8050-9125614c0641] VM Stopped (Lifecycle Event)
Aug 01 19:53:44 user nova-compute[72504]: DEBUG nova.compute.manager [None req-88b820f0-7db0-4aa1-b363-c9f3c833e76c None None] [instance: 561928fb-3c41-4937-8050-9125614c0641] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:53:45 user nova-compute[72504]: DEBUG nova.network.neutron [req-5632de58-04c5-47be-915e-f39a18b5c6d0 req-16065c35-3f96-42e5-87e0-f0d079a3dadc service nova] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Updated VIF entry in instance network info cache for port aee39726-8236-4507-8bec-fc1b40eafbba. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:53:45 user nova-compute[72504]: DEBUG nova.network.neutron [req-5632de58-04c5-47be-915e-f39a18b5c6d0 req-16065c35-3f96-42e5-87e0-f0d079a3dadc service nova] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Updating instance_info_cache with network_info: [{"id": "aee39726-8236-4507-8bec-fc1b40eafbba", "address": "fa:16:3e:85:04:12", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaee39726-82", "ovs_interfaceid": "aee39726-8236-4507-8bec-fc1b40eafbba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:53:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5632de58-04c5-47be-915e-f39a18b5c6d0 req-16065c35-3f96-42e5-87e0-f0d079a3dadc service nova] Releasing lock "refresh_cache-840f652e-bd31-4cb0-bd52-2873a641d876" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:53:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:45 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Instance destroyed successfully.
Aug 01 19:53:45 user nova-compute[72504]: DEBUG nova.objects.instance [None req-b0611e8a-3731-4a25-a8ce-f6a65f826672 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lazy-loading 'resources' on Instance uuid 840f652e-bd31-4cb0-bd52-2873a641d876 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:53:45 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-b0611e8a-3731-4a25-a8ce-f6a65f826672 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-213349054',display_name='tempest-AttachVolumeNegativeTest-server-213349054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-213349054',id=11,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRxZYaSQKZIQ/Pt5J0BXbm2lRIKONwgYHOC1bhODF0hBOMKdKipZL4fdq6kqFXYzSF9s9Y40ehRtWlIBpjTt52eLemda2o2Eaw7z3ml5hOeJRa5fZIPSsa2CY8ylUu1sA==',key_name='tempest-keypair-944089750',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:52:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15cc01820f324654b0959d5fb2adefc3',ramdisk_id='',reservation_id='r-8la04reb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2109955223',owner_user_name='tempest-AttachVolumeNegativeTest-2109955223-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:52:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='451baacc96384f35bd8bbb87626ac52d',uuid=840f652e-bd31-4cb0-bd52-2873a641d876,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aee39726-8236-4507-8bec-fc1b40eafbba", "address": "fa:16:3e:85:04:12", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaee39726-82", "ovs_interfaceid": "aee39726-8236-4507-8bec-fc1b40eafbba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:53:45 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-b0611e8a-3731-4a25-a8ce-f6a65f826672 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Converting VIF {"id": "aee39726-8236-4507-8bec-fc1b40eafbba", "address": "fa:16:3e:85:04:12", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaee39726-82", "ovs_interfaceid": "aee39726-8236-4507-8bec-fc1b40eafbba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:53:45 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-b0611e8a-3731-4a25-a8ce-f6a65f826672 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:04:12,bridge_name='br-int',has_traffic_filtering=True,id=aee39726-8236-4507-8bec-fc1b40eafbba,network=Network(67292f1d-2643-4cfa-aaf6-0a698d87bfd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaee39726-82') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:53:45 user nova-compute[72504]: DEBUG os_vif [None req-b0611e8a-3731-4a25-a8ce-f6a65f826672 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:04:12,bridge_name='br-int',has_traffic_filtering=True,id=aee39726-8236-4507-8bec-fc1b40eafbba,network=Network(67292f1d-2643-4cfa-aaf6-0a698d87bfd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaee39726-82') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:53:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaee39726-82, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:53:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:53:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:45 user nova-compute[72504]: INFO os_vif [None req-b0611e8a-3731-4a25-a8ce-f6a65f826672 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:04:12,bridge_name='br-int',has_traffic_filtering=True,id=aee39726-8236-4507-8bec-fc1b40eafbba,network=Network(67292f1d-2643-4cfa-aaf6-0a698d87bfd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaee39726-82')
Aug 01 19:53:45 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-b0611e8a-3731-4a25-a8ce-f6a65f826672 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Deleting instance files /opt/stack/data/nova/instances/840f652e-bd31-4cb0-bd52-2873a641d876_del
Aug 01 19:53:45 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-b0611e8a-3731-4a25-a8ce-f6a65f826672 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Deletion of /opt/stack/data/nova/instances/840f652e-bd31-4cb0-bd52-2873a641d876_del complete
Aug 01 19:53:45 user nova-compute[72504]: INFO nova.compute.manager [None req-b0611e8a-3731-4a25-a8ce-f6a65f826672 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Took 1.09 seconds to destroy the instance on the hypervisor.
Aug 01 19:53:45 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-b0611e8a-3731-4a25-a8ce-f6a65f826672 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 19:53:45 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 19:53:45 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG nova.compute.manager [req-dd024f7d-15dc-4b83-baa6-c848e31c40cc req-2d2b926b-7da4-4fdc-ab4e-d925325db062 service nova] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Received event network-vif-unplugged-aee39726-8236-4507-8bec-fc1b40eafbba {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-dd024f7d-15dc-4b83-baa6-c848e31c40cc req-2d2b926b-7da4-4fdc-ab4e-d925325db062 service nova] Acquiring lock "840f652e-bd31-4cb0-bd52-2873a641d876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-dd024f7d-15dc-4b83-baa6-c848e31c40cc req-2d2b926b-7da4-4fdc-ab4e-d925325db062 service nova] Lock "840f652e-bd31-4cb0-bd52-2873a641d876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-dd024f7d-15dc-4b83-baa6-c848e31c40cc req-2d2b926b-7da4-4fdc-ab4e-d925325db062 service nova] Lock "840f652e-bd31-4cb0-bd52-2873a641d876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG nova.compute.manager [req-dd024f7d-15dc-4b83-baa6-c848e31c40cc req-2d2b926b-7da4-4fdc-ab4e-d925325db062 service nova] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] No waiting events found dispatching network-vif-unplugged-aee39726-8236-4507-8bec-fc1b40eafbba {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG nova.compute.manager [req-dd024f7d-15dc-4b83-baa6-c848e31c40cc req-2d2b926b-7da4-4fdc-ab4e-d925325db062 service nova] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Received event network-vif-unplugged-aee39726-8236-4507-8bec-fc1b40eafbba for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG nova.compute.manager [req-dd024f7d-15dc-4b83-baa6-c848e31c40cc req-2d2b926b-7da4-4fdc-ab4e-d925325db062 service nova] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Received event network-vif-plugged-aee39726-8236-4507-8bec-fc1b40eafbba {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-dd024f7d-15dc-4b83-baa6-c848e31c40cc req-2d2b926b-7da4-4fdc-ab4e-d925325db062 service nova] Acquiring lock "840f652e-bd31-4cb0-bd52-2873a641d876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-dd024f7d-15dc-4b83-baa6-c848e31c40cc req-2d2b926b-7da4-4fdc-ab4e-d925325db062 service nova] Lock "840f652e-bd31-4cb0-bd52-2873a641d876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-dd024f7d-15dc-4b83-baa6-c848e31c40cc req-2d2b926b-7da4-4fdc-ab4e-d925325db062 service nova] Lock "840f652e-bd31-4cb0-bd52-2873a641d876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG nova.compute.manager [req-dd024f7d-15dc-4b83-baa6-c848e31c40cc req-2d2b926b-7da4-4fdc-ab4e-d925325db062 service nova] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] No waiting events found dispatching network-vif-plugged-aee39726-8236-4507-8bec-fc1b40eafbba {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:46 user nova-compute[72504]: WARNING nova.compute.manager [req-dd024f7d-15dc-4b83-baa6-c848e31c40cc req-2d2b926b-7da4-4fdc-ab4e-d925325db062 service nova] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Received unexpected event network-vif-plugged-aee39726-8236-4507-8bec-fc1b40eafbba for instance with vm_state active and task_state deleting.
Aug 01 19:53:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 -F raw /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk" returned: 0 in 3.397s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Ensure instance console log exists: /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Start _get_guest_xml network_info=[{"id": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "address": "fa:16:3e:a8:fa:27", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2edbeaad-cd", "ovs_interfaceid": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='0684f32c3356e3610d2e3810bd8f3851',container_format='bare',created_at=2023-08-01T19:51:30Z,direct_url=<?>,disk_format='qcow2',id=ea371bc6-8609-46a0-8872-1a045bf33672,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1959455272-shelved',owner='da04aaa8143b44d5aa21f59a89cd57ee',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-01T19:51:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lHRQqzGf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '76aa3861-0ca1-4e7f-9a15-9219037bc1ee', 'attached_at': '', 'detached_at': '', 'volume_id': '0d7d6bd1-a0f4-42f6-9e43-b73af451d960', 'serial': '0d7d6bd1-a0f4-42f6-9e43-b73af451d960'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'attachment_id': 'b6623a75-16c1-4eb7-89b5-686972a12859', 'volume_type': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:53:46 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:53:46 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:53:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0684f32c3356e3610d2e3810bd8f3851',container_format='bare',created_at=2023-08-01T19:51:30Z,direct_url=<?>,disk_format='qcow2',id=ea371bc6-8609-46a0-8872-1a045bf33672,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1959455272-shelved',owner='da04aaa8143b44d5aa21f59a89cd57ee',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-01T19:51:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG nova.objects.instance [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lazy-loading 'vcpu_model' on Instance uuid 76aa3861-0ca1-4e7f-9a15-9219037bc1ee {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lHRQqzGf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:53:46 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:53:46 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:53:46 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:53:46 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:53:46 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:53:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 -p 172.16.0.220:3260" returned: 21 in 0.069s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5dbf8d-cd99-4e0d-8d35-71dad2a2c202]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:53:46 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf7b441-1e40-46f4-9879-53258ef61141]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960] added
Aug 01 19:53:46 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3db3c45-a4fa-44c9-8852-7221f3682c90]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[974155e4-647c-4e9a-97af-2ab807db4ecd]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lHRQqzGf {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lHRQqzGf" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb91d2cf-6298-4559-9604-c57a44f9f8e4]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lHRQqzGf'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aad7a8a-3a96-4c24-bc56-4daaa169cd9b]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[952df710-960f-4bbd-b1eb-d0a430ee97b8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:53:47 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:53:47 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:53:47 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:53:47 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b889871-b23c-49cc-9c32-a0b01b7330df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960, portal: 172.16.0.220,3260]
Aug 01 19:53:47 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960, portal: 172.16.0.220,3260] successful.
Aug 01 19:53:47 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.109s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca43de06-5f44-48b3-9dbf-a039502e5564]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[797da22b-4a91-4f25-aecb-18057e59f9c3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:53:47 user nova-compute[72504]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 (non-flash)
Aug 01 19:53:47 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:53:47 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:53:47 user nova-compute[72504]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 (non-flash)
Aug 01 19:53:47 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:53:47 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.470s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.061s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f5cfd0-ecfa-47da-8c28-88be9f77ecb9]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lHRQqzGf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:53:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG nova.compute.manager [req-5c8a56b9-eb1b-4e7f-a921-ed2ebda030d1 req-3e244c50-e333-4364-a75a-10b9910f5e16 service nova] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Received event network-vif-deleted-aee39726-8236-4507-8bec-fc1b40eafbba {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:48 user nova-compute[72504]: INFO nova.compute.manager [req-5c8a56b9-eb1b-4e7f-a921-ed2ebda030d1 req-3e244c50-e333-4364-a75a-10b9910f5e16 service nova] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Neutron deleted interface aee39726-8236-4507-8bec-fc1b40eafbba; detaching it from the instance and deleting it from the info cache
Aug 01 19:53:48 user nova-compute[72504]: DEBUG nova.network.neutron [req-5c8a56b9-eb1b-4e7f-a921-ed2ebda030d1 req-3e244c50-e333-4364-a75a-10b9910f5e16 service nova] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:53:48 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Took 2.40 seconds to deallocate network for instance.
Aug 01 19:53:48 user nova-compute[72504]: DEBUG nova.compute.manager [req-5c8a56b9-eb1b-4e7f-a921-ed2ebda030d1 req-3e244c50-e333-4364-a75a-10b9910f5e16 service nova] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Detach interface failed, port_id=aee39726-8236-4507-8bec-fc1b40eafbba, reason: Instance 840f652e-bd31-4cb0-bd52-2873a641d876 could not be found. {{(pid=72504) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690919613.2393305, 5193c770-80ca-44c3-9950-cb25c65e94e8 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:53:48 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] VM Stopped (Lifecycle Event)
Aug 01 19:53:48 user nova-compute[72504]: DEBUG nova.compute.manager [None req-f68afe33-6c5e-4fca-bd0b-51c6787d9482 None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG nova.compute.manager [None req-f68afe33-6c5e-4fca-bd0b-51c6787d9482 None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b0611e8a-3731-4a25-a8ce-f6a65f826672 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b0611e8a-3731-4a25-a8ce-f6a65f826672 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:48 user nova-compute[72504]: INFO nova.compute.manager [None req-f68afe33-6c5e-4fca-bd0b-51c6787d9482 None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 19:53:48 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.556s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] <== connect_volume: return (1558ms) {'type': 'block', 'scsi_wwn': '23238326464663162', 'path': '/dev/sdc'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238326464663162', 'path': '/dev/sdc'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T19:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1959455272',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1959455272',id=4,image_ref='ea371bc6-8609-46a0-8872-1a045bf33672',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1467874797',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:49:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='da04aaa8143b44d5aa21f59a89cd57ee',ramdisk_id='',reservation_id='r-5nw6f64r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-836718209',owner_user_name='tempest-AttachVolumeShelveTestJSON-836718209-project-member',shelved_at='2023-08-01T19:51:34.750039',shelved_host='user',shelved_image_id='ea371bc6-8609-46a0-8872-1a045bf33672'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:53:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6260679430fa4828b07bc890c62878c3',uuid=76aa3861-0ca1-4e7f-9a15-9219037bc1ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "address": "fa:16:3e:a8:fa:27", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2edbeaad-cd", "ovs_interfaceid": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Converting VIF {"id": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "address": "fa:16:3e:a8:fa:27", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2edbeaad-cd", "ovs_interfaceid": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fa:27,bridge_name='br-int',has_traffic_filtering=True,id=2edbeaad-cd66-4a79-9fae-544f2a33e922,network=Network(40b3d49e-3592-411a-93d6-5a44019ef136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2edbeaad-cd') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG nova.objects.instance [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lazy-loading 'pci_devices' on Instance uuid 76aa3861-0ca1-4e7f-9a15-9219037bc1ee {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:53:48 user nova-compute[72504]:   <uuid>76aa3861-0ca1-4e7f-9a15-9219037bc1ee</uuid>
Aug 01 19:53:48 user nova-compute[72504]:   <name>instance-00000004</name>
Aug 01 19:53:48 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:53:48 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:53:48 user nova-compute[72504]:   <metadata>
Aug 01 19:53:48 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:53:48 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:53:48 user nova-compute[72504]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1959455272</nova:name>
Aug 01 19:53:48 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:53:46</nova:creationTime>
Aug 01 19:53:48 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:53:48 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:53:48 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:53:48 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:53:48 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:53:48 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:53:48 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:53:48 user nova-compute[72504]:       <nova:owner>
Aug 01 19:53:48 user nova-compute[72504]:         <nova:user uuid="6260679430fa4828b07bc890c62878c3">tempest-AttachVolumeShelveTestJSON-836718209-project-member</nova:user>
Aug 01 19:53:48 user nova-compute[72504]:         <nova:project uuid="da04aaa8143b44d5aa21f59a89cd57ee">tempest-AttachVolumeShelveTestJSON-836718209</nova:project>
Aug 01 19:53:48 user nova-compute[72504]:       </nova:owner>
Aug 01 19:53:48 user nova-compute[72504]:       <nova:root type="image" uuid="ea371bc6-8609-46a0-8872-1a045bf33672"/>
Aug 01 19:53:48 user nova-compute[72504]:       <nova:ports>
Aug 01 19:53:48 user nova-compute[72504]:         <nova:port uuid="2edbeaad-cd66-4a79-9fae-544f2a33e922">
Aug 01 19:53:48 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 19:53:48 user nova-compute[72504]:         </nova:port>
Aug 01 19:53:48 user nova-compute[72504]:       </nova:ports>
Aug 01 19:53:48 user nova-compute[72504]:     </nova:instance>
Aug 01 19:53:48 user nova-compute[72504]:   </metadata>
Aug 01 19:53:48 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:53:48 user nova-compute[72504]:     <system>
Aug 01 19:53:48 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:53:48 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:53:48 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:53:48 user nova-compute[72504]:       <entry name="serial">76aa3861-0ca1-4e7f-9a15-9219037bc1ee</entry>
Aug 01 19:53:48 user nova-compute[72504]:       <entry name="uuid">76aa3861-0ca1-4e7f-9a15-9219037bc1ee</entry>
Aug 01 19:53:48 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:53:48 user nova-compute[72504]:     </system>
Aug 01 19:53:48 user nova-compute[72504]:   </sysinfo>
Aug 01 19:53:48 user nova-compute[72504]:   <os>
Aug 01 19:53:48 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:53:48 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:53:48 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:53:48 user nova-compute[72504]:   </os>
Aug 01 19:53:48 user nova-compute[72504]:   <features>
Aug 01 19:53:48 user nova-compute[72504]:     <acpi/>
Aug 01 19:53:48 user nova-compute[72504]:     <apic/>
Aug 01 19:53:48 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:53:48 user nova-compute[72504]:   </features>
Aug 01 19:53:48 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:53:48 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:53:48 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:53:48 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:53:48 user nova-compute[72504]:   </clock>
Aug 01 19:53:48 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:53:48 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:53:48 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:53:48 user nova-compute[72504]:   </cpu>
Aug 01 19:53:48 user nova-compute[72504]:   <devices>
Aug 01 19:53:48 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:53:48 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:53:48 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk"/>
Aug 01 19:53:48 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:53:48 user nova-compute[72504]:     </disk>
Aug 01 19:53:48 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 19:53:48 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:53:48 user nova-compute[72504]:       <source dev="/dev/sdc"/>
Aug 01 19:53:48 user nova-compute[72504]:       <target dev="vdc" bus="virtio"/>
Aug 01 19:53:48 user nova-compute[72504]:       <serial>0d7d6bd1-a0f4-42f6-9e43-b73af451d960</serial>
Aug 01 19:53:48 user nova-compute[72504]:     </disk>
Aug 01 19:53:48 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:53:48 user nova-compute[72504]:       <mac address="fa:16:3e:a8:fa:27"/>
Aug 01 19:53:48 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:53:48 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:53:48 user nova-compute[72504]:       <target dev="tap2edbeaad-cd"/>
Aug 01 19:53:48 user nova-compute[72504]:     </interface>
Aug 01 19:53:48 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:53:48 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/console.log" append="off"/>
Aug 01 19:53:48 user nova-compute[72504]:     </serial>
Aug 01 19:53:48 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:53:48 user nova-compute[72504]:     <video>
Aug 01 19:53:48 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:53:48 user nova-compute[72504]:     </video>
Aug 01 19:53:48 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:53:48 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:53:48 user nova-compute[72504]:     </rng>
Aug 01 19:53:48 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:53:48 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:53:48 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:53:48 user nova-compute[72504]:     </memballoon>
Aug 01 19:53:48 user nova-compute[72504]:   </devices>
Aug 01 19:53:48 user nova-compute[72504]: </domain>
Aug 01 19:53:48 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T19:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1959455272',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1959455272',id=4,image_ref='ea371bc6-8609-46a0-8872-1a045bf33672',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1467874797',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:49:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='da04aaa8143b44d5aa21f59a89cd57ee',ramdisk_id='',reservation_id='r-5nw6f64r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-836718209',owner_user_name='tempest-AttachVolumeShelveTestJSON-836718209-project-member',shelved_at='2023-08-01T19:51:34.750039',shelved_host='user',shelved_image_id='ea371bc6-8609-46a0-8872-1a045bf33672'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:53:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6260679430fa4828b07bc890c62878c3',uuid=76aa3861-0ca1-4e7f-9a15-9219037bc1ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "address": "fa:16:3e:a8:fa:27", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2edbeaad-cd", "ovs_interfaceid": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Converting VIF {"id": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "address": "fa:16:3e:a8:fa:27", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2edbeaad-cd", "ovs_interfaceid": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fa:27,bridge_name='br-int',has_traffic_filtering=True,id=2edbeaad-cd66-4a79-9fae-544f2a33e922,network=Network(40b3d49e-3592-411a-93d6-5a44019ef136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2edbeaad-cd') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG os_vif [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fa:27,bridge_name='br-int',has_traffic_filtering=True,id=2edbeaad-cd66-4a79-9fae-544f2a33e922,network=Network(40b3d49e-3592-411a-93d6-5a44019ef136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2edbeaad-cd') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2edbeaad-cd, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2edbeaad-cd, col_values=(('external_ids', {'iface-id': '2edbeaad-cd66-4a79-9fae-544f2a33e922', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:fa:27', 'vm-uuid': '76aa3861-0ca1-4e7f-9a15-9219037bc1ee'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:48 user nova-compute[72504]: INFO os_vif [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fa:27,bridge_name='br-int',has_traffic_filtering=True,id=2edbeaad-cd66-4a79-9fae-544f2a33e922,network=Network(40b3d49e-3592-411a-93d6-5a44019ef136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2edbeaad-cd')
Aug 01 19:53:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Starting finish_migration {{(pid=72504) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Instance directory exists: not creating {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 19:53:48 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Creating image(s)
Aug 01 19:53:48 user nova-compute[72504]: DEBUG nova.objects.instance [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5193c770-80ca-44c3-9950-cb25c65e94e8 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] No VIF found with MAC fa:16:3e:a8:fa:27, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-b0611e8a-3731-4a25-a8ce-f6a65f826672 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-b0611e8a-3731-4a25-a8ce-f6a65f826672 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b0611e8a-3731-4a25-a8ce-f6a65f826672 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.580s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG nova.compute.manager [req-2694758f-5b72-4cde-9011-ec0830322aef req-93479277-9204-4f63-ab5c-70788177017c service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-deleted-022ea9fb-47cd-4a25-8217-4dd5f379b522 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:48 user nova-compute[72504]: INFO nova.compute.manager [req-2694758f-5b72-4cde-9011-ec0830322aef req-93479277-9204-4f63-ab5c-70788177017c service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Neutron deleted interface 022ea9fb-47cd-4a25-8217-4dd5f379b522; detaching it from the instance and deleting it from the info cache
Aug 01 19:53:48 user nova-compute[72504]: DEBUG nova.network.neutron [req-2694758f-5b72-4cde-9011-ec0830322aef req-93479277-9204-4f63-ab5c-70788177017c service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Updating instance_info_cache with network_info: [{"id": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "address": "fa:16:3e:c2:7b:99", "network": {"id": "9ccd7c4b-5d10-4ec8-9f00-f4b269b82d04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1560588778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1898db0f-13", "ovs_interfaceid": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "address": "fa:16:3e:71:06:4f", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d17a5cc-0f", "ovs_interfaceid": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "address": "fa:16:3e:52:80:5a", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769dacee-eb", "ovs_interfaceid": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a5b6139-7885-46c7-9210-676227003327", "address": "fa:16:3e:84:ab:7b", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a5b6139-78", "ovs_interfaceid": "4a5b6139-7885-46c7-9210-676227003327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4fc53eb7-bc35-49cd-af26-52ec96aa2008", "address": "fa:16:3e:ee:80:d5", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc53eb7-bc", "ovs_interfaceid": "4fc53eb7-bc35-49cd-af26-52ec96aa2008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "address": "fa:16:3e:2a:6f:04", "network": {"id": "749ff417-d2f9-4311-b2f7-bbdf0cfd37a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-178411316", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd0b585f-55", "ovs_interfaceid": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:53:48 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-b0611e8a-3731-4a25-a8ce-f6a65f826672 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Deleted allocations for instance 840f652e-bd31-4cb0-bd52-2873a641d876
Aug 01 19:53:48 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.300s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk. size=21474836480 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:48 user nova-compute[72504]: DEBUG nova.compute.manager [req-2694758f-5b72-4cde-9011-ec0830322aef req-93479277-9204-4f63-ab5c-70788177017c service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Detach interface failed, port_id=022ea9fb-47cd-4a25-8217-4dd5f379b522, reason: Instance 85816260-b37b-4b9e-9b52-f823120645aa could not be found. {{(pid=72504) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk 21474836480 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk 21474836480" returned: 0 in 0.081s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b0611e8a-3731-4a25-a8ce-f6a65f826672 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "840f652e-bd31-4cb0-bd52-2873a641d876" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.504s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Did not create local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Ensure instance console log exists: /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Start _get_guest_xml network_info=[{"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-542724405-network", "vif_mac": "fa:16:3e:46:8a:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAHmLCZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '5193c770-80ca-44c3-9950-cb25c65e94e8', 'attached_at': '2023-08-01T19:53:48.000000', 'detached_at': '', 'volume_id': 'fd436d31-78dd-4044-b044-840d1853718d', 'serial': 'fd436d31-78dd-4044-b044-840d1853718d'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': '21433330-40d8-4bd7-bdae-a3719741b489', 'volume_type': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:53:49 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:53:49 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:53:49 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG nova.objects.instance [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5193c770-80ca-44c3-9950-cb25c65e94e8 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAHmLCZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:53:49 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:53:49 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:53:49 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:53:49 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:53:49 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b299a598-685a-471c-a6d1-19d8f99aa229]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:53:49 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[840243fb-0194-4647-9c41-e758b2de167c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d] added
Aug 01 19:53:49 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e255a4ef-b6fd-4d75-96ee-310e1c5eba77]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d1a2ad-e428-45d6-b1b7-a3dd82b403e9]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nAHmLCZD {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nAHmLCZD" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f44ca7b-0631-4c73-b3e8-a3e7d79df3fe]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nAHmLCZD'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3724d305-5e0a-49b9-83b6-cf43c1e3cff4]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c686c039-6bbf-44ff-9813-e8021da7e2d7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:53:49 user nova-compute[72504]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 (non-flash)
Aug 01 19:53:49 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:53:49 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:53:49 user nova-compute[72504]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 (non-flash)
Aug 01 19:53:49 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:53:49 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4474af09-f685-4cc7-a37a-c098d74a3502]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d, portal: 172.16.0.220,3260]
Aug 01 19:53:49 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d, portal: 172.16.0.220,3260] successful.
Aug 01 19:53:49 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9b4037-896d-429b-8e63-76d1aa78a235]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2955e35-500f-41f4-8152-b12c44f6e6b7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:53:49 user nova-compute[72504]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 (non-flash)
Aug 01 19:53:49 user nova-compute[72504]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)
Aug 01 19:53:49 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:53:49 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:53:49 user nova-compute[72504]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 (non-flash)
Aug 01 19:53:49 user nova-compute[72504]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)
Aug 01 19:53:49 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:53:49 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.028s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cacd90-18bd-4dcc-8eda-15a9ef3e1938]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:53:49 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAHmLCZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:53:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:50 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:53:50 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23637646439626230', 'path': '/dev/sdd'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:53:50 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637646439626230', 'path': '/dev/sdd'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:53:50 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:49:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1940907332',display_name='tempest-ServerActionsTestOtherB-server-1940907332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1940907332',id=3,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzhjBwv/fwyuXjW1x6h8vd/kIx1PP+lp3UGnSLHNEmFgbtKuVpQ2lyUbVPsnNcWUwbyAFXlofeww/O420ZBkncMBF2kewUMxpZllUL90MSl7NE91UoBCSbwKPcmnMcunA==',key_name='tempest-keypair-1272671103',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:49:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b6958054d48748c68942fb4d36d5ca8b',ramdisk_id='',reservation_id='r-uhmjifqg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1731713993',owner_user_name='tempest-ServerActionsTestOtherB-1731713993-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:53:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98fd620d741b433ba699e5bbbc5ae1c0',uuid=5193c770-80ca-44c3-9950-cb25c65e94e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-542724405-network", "vif_mac": "fa:16:3e:46:8a:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:53:50 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Converting VIF {"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-542724405-network", "vif_mac": "fa:16:3e:46:8a:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:53:50 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:8a:a8,bridge_name='br-int',has_traffic_filtering=True,id=8f1cca03-e1f6-44db-b8d3-d7a305fc1461,network=Network(a1278c28-de03-4929-8689-60655553da2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cca03-e1') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:53:50 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:53:50 user nova-compute[72504]:   <uuid>5193c770-80ca-44c3-9950-cb25c65e94e8</uuid>
Aug 01 19:53:50 user nova-compute[72504]:   <name>instance-00000003</name>
Aug 01 19:53:50 user nova-compute[72504]:   <memory>2097152</memory>
Aug 01 19:53:50 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:53:50 user nova-compute[72504]:   <metadata>
Aug 01 19:53:50 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:53:50 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:53:50 user nova-compute[72504]:       <nova:name>tempest-ServerActionsTestOtherB-server-1940907332</nova:name>
Aug 01 19:53:50 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:53:49</nova:creationTime>
Aug 01 19:53:50 user nova-compute[72504]:       <nova:flavor name="m1.small">
Aug 01 19:53:50 user nova-compute[72504]:         <nova:memory>2048</nova:memory>
Aug 01 19:53:50 user nova-compute[72504]:         <nova:disk>20</nova:disk>
Aug 01 19:53:50 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:53:50 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:53:50 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:53:50 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:53:50 user nova-compute[72504]:       <nova:owner>
Aug 01 19:53:50 user nova-compute[72504]:         <nova:user uuid="98fd620d741b433ba699e5bbbc5ae1c0">tempest-ServerActionsTestOtherB-1731713993-project-member</nova:user>
Aug 01 19:53:50 user nova-compute[72504]:         <nova:project uuid="b6958054d48748c68942fb4d36d5ca8b">tempest-ServerActionsTestOtherB-1731713993</nova:project>
Aug 01 19:53:50 user nova-compute[72504]:       </nova:owner>
Aug 01 19:53:50 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:53:50 user nova-compute[72504]:       <nova:ports>
Aug 01 19:53:50 user nova-compute[72504]:         <nova:port uuid="8f1cca03-e1f6-44db-b8d3-d7a305fc1461">
Aug 01 19:53:50 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 19:53:50 user nova-compute[72504]:         </nova:port>
Aug 01 19:53:50 user nova-compute[72504]:       </nova:ports>
Aug 01 19:53:50 user nova-compute[72504]:     </nova:instance>
Aug 01 19:53:50 user nova-compute[72504]:   </metadata>
Aug 01 19:53:50 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:53:50 user nova-compute[72504]:     <system>
Aug 01 19:53:50 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:53:50 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:53:50 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:53:50 user nova-compute[72504]:       <entry name="serial">5193c770-80ca-44c3-9950-cb25c65e94e8</entry>
Aug 01 19:53:50 user nova-compute[72504]:       <entry name="uuid">5193c770-80ca-44c3-9950-cb25c65e94e8</entry>
Aug 01 19:53:50 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:53:50 user nova-compute[72504]:     </system>
Aug 01 19:53:50 user nova-compute[72504]:   </sysinfo>
Aug 01 19:53:50 user nova-compute[72504]:   <os>
Aug 01 19:53:50 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:53:50 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:53:50 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:53:50 user nova-compute[72504]:   </os>
Aug 01 19:53:50 user nova-compute[72504]:   <features>
Aug 01 19:53:50 user nova-compute[72504]:     <acpi/>
Aug 01 19:53:50 user nova-compute[72504]:     <apic/>
Aug 01 19:53:50 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:53:50 user nova-compute[72504]:   </features>
Aug 01 19:53:50 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:53:50 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:53:50 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:53:50 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:53:50 user nova-compute[72504]:   </clock>
Aug 01 19:53:50 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:53:50 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:53:50 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:53:50 user nova-compute[72504]:   </cpu>
Aug 01 19:53:50 user nova-compute[72504]:   <devices>
Aug 01 19:53:50 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:53:50 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:53:50 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk"/>
Aug 01 19:53:50 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:53:50 user nova-compute[72504]:     </disk>
Aug 01 19:53:50 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 19:53:50 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:53:50 user nova-compute[72504]:       <source dev="/dev/sdd"/>
Aug 01 19:53:50 user nova-compute[72504]:       <target dev="vdb" bus="virtio"/>
Aug 01 19:53:50 user nova-compute[72504]:       <serial>fd436d31-78dd-4044-b044-840d1853718d</serial>
Aug 01 19:53:50 user nova-compute[72504]:     </disk>
Aug 01 19:53:50 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:53:50 user nova-compute[72504]:       <mac address="fa:16:3e:46:8a:a8"/>
Aug 01 19:53:50 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:53:50 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:53:50 user nova-compute[72504]:       <target dev="tap8f1cca03-e1"/>
Aug 01 19:53:50 user nova-compute[72504]:     </interface>
Aug 01 19:53:50 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:53:50 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/console.log" append="off"/>
Aug 01 19:53:50 user nova-compute[72504]:     </serial>
Aug 01 19:53:50 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:53:50 user nova-compute[72504]:     <video>
Aug 01 19:53:50 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:53:50 user nova-compute[72504]:     </video>
Aug 01 19:53:50 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:53:50 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:53:50 user nova-compute[72504]:     </rng>
Aug 01 19:53:50 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:53:50 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:53:50 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:53:50 user nova-compute[72504]:     </memballoon>
Aug 01 19:53:50 user nova-compute[72504]:   </devices>
Aug 01 19:53:50 user nova-compute[72504]: </domain>
Aug 01 19:53:50 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:53:50 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:49:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1940907332',display_name='tempest-ServerActionsTestOtherB-server-1940907332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1940907332',id=3,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzhjBwv/fwyuXjW1x6h8vd/kIx1PP+lp3UGnSLHNEmFgbtKuVpQ2lyUbVPsnNcWUwbyAFXlofeww/O420ZBkncMBF2kewUMxpZllUL90MSl7NE91UoBCSbwKPcmnMcunA==',key_name='tempest-keypair-1272671103',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:49:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b6958054d48748c68942fb4d36d5ca8b',ramdisk_id='',reservation_id='r-uhmjifqg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1731713993',owner_user_name='tempest-ServerActionsTestOtherB-1731713993-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:53:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98fd620d741b433ba699e5bbbc5ae1c0',uuid=5193c770-80ca-44c3-9950-cb25c65e94e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-542724405-network", "vif_mac": "fa:16:3e:46:8a:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:53:50 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Converting VIF {"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-542724405-network", "vif_mac": "fa:16:3e:46:8a:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:53:50 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:8a:a8,bridge_name='br-int',has_traffic_filtering=True,id=8f1cca03-e1f6-44db-b8d3-d7a305fc1461,network=Network(a1278c28-de03-4929-8689-60655553da2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cca03-e1') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:53:50 user nova-compute[72504]: DEBUG os_vif [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:8a:a8,bridge_name='br-int',has_traffic_filtering=True,id=8f1cca03-e1f6-44db-b8d3-d7a305fc1461,network=Network(a1278c28-de03-4929-8689-60655553da2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cca03-e1') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:53:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:53:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:53:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f1cca03-e1, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:53:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8f1cca03-e1, col_values=(('external_ids', {'iface-id': '8f1cca03-e1f6-44db-b8d3-d7a305fc1461', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:8a:a8', 'vm-uuid': '5193c770-80ca-44c3-9950-cb25c65e94e8'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:53:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:53:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:50 user nova-compute[72504]: INFO os_vif [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:8a:a8,bridge_name='br-int',has_traffic_filtering=True,id=8f1cca03-e1f6-44db-b8d3-d7a305fc1461,network=Network(a1278c28-de03-4929-8689-60655553da2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cca03-e1')
Aug 01 19:53:50 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:53:50 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:53:50 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] No VIF found with MAC fa:16:3e:46:8a:a8, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:53:50 user nova-compute[72504]: DEBUG nova.compute.manager [req-5ebbafec-6c75-4cd5-bdd7-09e74893fd15 req-6c092996-af09-45b8-9766-452af6f7502e service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-deleted-4a5b6139-7885-46c7-9210-676227003327 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:50 user nova-compute[72504]: INFO nova.compute.manager [req-5ebbafec-6c75-4cd5-bdd7-09e74893fd15 req-6c092996-af09-45b8-9766-452af6f7502e service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Neutron deleted interface 4a5b6139-7885-46c7-9210-676227003327; detaching it from the instance and deleting it from the info cache
Aug 01 19:53:50 user nova-compute[72504]: DEBUG nova.network.neutron [req-5ebbafec-6c75-4cd5-bdd7-09e74893fd15 req-6c092996-af09-45b8-9766-452af6f7502e service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Updating instance_info_cache with network_info: [{"id": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "address": "fa:16:3e:c2:7b:99", "network": {"id": "9ccd7c4b-5d10-4ec8-9f00-f4b269b82d04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1560588778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1898db0f-13", "ovs_interfaceid": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "address": "fa:16:3e:71:06:4f", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d17a5cc-0f", "ovs_interfaceid": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "address": "fa:16:3e:52:80:5a", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769dacee-eb", "ovs_interfaceid": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4fc53eb7-bc35-49cd-af26-52ec96aa2008", "address": "fa:16:3e:ee:80:d5", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc53eb7-bc", "ovs_interfaceid": "4fc53eb7-bc35-49cd-af26-52ec96aa2008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "address": "fa:16:3e:2a:6f:04", "network": {"id": "749ff417-d2f9-4311-b2f7-bbdf0cfd37a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-178411316", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd0b585f-55", "ovs_interfaceid": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:53:51 user nova-compute[72504]: DEBUG nova.compute.manager [req-5ebbafec-6c75-4cd5-bdd7-09e74893fd15 req-6c092996-af09-45b8-9766-452af6f7502e service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Detach interface failed, port_id=4a5b6139-7885-46c7-9210-676227003327, reason: Instance 85816260-b37b-4b9e-9b52-f823120645aa could not be found. {{(pid=72504) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 19:53:51 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:51 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:51 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:51 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:51 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:52 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919632.9164586, 76aa3861-0ca1-4e7f-9a15-9219037bc1ee => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:53:52 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] VM Resumed (Lifecycle Event)
Aug 01 19:53:52 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:53:52 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:53:52 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:53:52 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Instance spawned successfully.
Aug 01 19:53:52 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:53:53 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:53:53 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919632.918403, 76aa3861-0ca1-4e7f-9a15-9219037bc1ee => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:53:53 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] VM Started (Lifecycle Event)
Aug 01 19:53:53 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:53:53 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:53:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:53 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:53:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:53 user nova-compute[72504]: DEBUG nova.compute.manager [req-b7ef17dc-1184-4bec-bc41-49c8fab83e4d req-85185078-af8c-4e49-8ab7-88072b0d95bc service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-deleted-4fc53eb7-bc35-49cd-af26-52ec96aa2008 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:53 user nova-compute[72504]: INFO nova.compute.manager [req-b7ef17dc-1184-4bec-bc41-49c8fab83e4d req-85185078-af8c-4e49-8ab7-88072b0d95bc service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Neutron deleted interface 4fc53eb7-bc35-49cd-af26-52ec96aa2008; detaching it from the instance and deleting it from the info cache
Aug 01 19:53:53 user nova-compute[72504]: DEBUG nova.network.neutron [req-b7ef17dc-1184-4bec-bc41-49c8fab83e4d req-85185078-af8c-4e49-8ab7-88072b0d95bc service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Updating instance_info_cache with network_info: [{"id": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "address": "fa:16:3e:c2:7b:99", "network": {"id": "9ccd7c4b-5d10-4ec8-9f00-f4b269b82d04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1560588778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1898db0f-13", "ovs_interfaceid": "1898db0f-13d0-443c-a15f-bcb85039ecdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "address": "fa:16:3e:71:06:4f", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d17a5cc-0f", "ovs_interfaceid": "4d17a5cc-0fda-4d09-9121-baab1fed85e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "address": "fa:16:3e:52:80:5a", "network": {"id": "c2d0d0c4-7a0b-4ea5-8fe6-39f88dfebcf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-416468068", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769dacee-eb", "ovs_interfaceid": "769dacee-ebe9-47f8-994f-1d59b15e2a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "address": "fa:16:3e:2a:6f:04", "network": {"id": "749ff417-d2f9-4311-b2f7-bbdf0cfd37a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-178411316", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87a15b5dc83241d9a0bfd3df652e08a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd0b585f-55", "ovs_interfaceid": "fd0b585f-558c-44a1-a5a3-24f825aa19e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:53:53 user nova-compute[72504]: DEBUG nova.compute.manager [req-b7ef17dc-1184-4bec-bc41-49c8fab83e4d req-85185078-af8c-4e49-8ab7-88072b0d95bc service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Detach interface failed, port_id=4fc53eb7-bc35-49cd-af26-52ec96aa2008, reason: Instance 85816260-b37b-4b9e-9b52-f823120645aa could not be found. {{(pid=72504) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 19:53:53 user nova-compute[72504]: DEBUG nova.compute.manager [req-b7ef17dc-1184-4bec-bc41-49c8fab83e4d req-85185078-af8c-4e49-8ab7-88072b0d95bc service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Received event network-vif-plugged-2edbeaad-cd66-4a79-9fae-544f2a33e922 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b7ef17dc-1184-4bec-bc41-49c8fab83e4d req-85185078-af8c-4e49-8ab7-88072b0d95bc service nova] Acquiring lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b7ef17dc-1184-4bec-bc41-49c8fab83e4d req-85185078-af8c-4e49-8ab7-88072b0d95bc service nova] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b7ef17dc-1184-4bec-bc41-49c8fab83e4d req-85185078-af8c-4e49-8ab7-88072b0d95bc service nova] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:53 user nova-compute[72504]: DEBUG nova.compute.manager [req-b7ef17dc-1184-4bec-bc41-49c8fab83e4d req-85185078-af8c-4e49-8ab7-88072b0d95bc service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] No waiting events found dispatching network-vif-plugged-2edbeaad-cd66-4a79-9fae-544f2a33e922 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:53 user nova-compute[72504]: WARNING nova.compute.manager [req-b7ef17dc-1184-4bec-bc41-49c8fab83e4d req-85185078-af8c-4e49-8ab7-88072b0d95bc service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Received unexpected event network-vif-plugged-2edbeaad-cd66-4a79-9fae-544f2a33e922 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 19:53:53 user nova-compute[72504]: DEBUG nova.compute.manager [req-b7ef17dc-1184-4bec-bc41-49c8fab83e4d req-85185078-af8c-4e49-8ab7-88072b0d95bc service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Received event network-vif-plugged-2edbeaad-cd66-4a79-9fae-544f2a33e922 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b7ef17dc-1184-4bec-bc41-49c8fab83e4d req-85185078-af8c-4e49-8ab7-88072b0d95bc service nova] Acquiring lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b7ef17dc-1184-4bec-bc41-49c8fab83e4d req-85185078-af8c-4e49-8ab7-88072b0d95bc service nova] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b7ef17dc-1184-4bec-bc41-49c8fab83e4d req-85185078-af8c-4e49-8ab7-88072b0d95bc service nova] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:53 user nova-compute[72504]: DEBUG nova.compute.manager [req-b7ef17dc-1184-4bec-bc41-49c8fab83e4d req-85185078-af8c-4e49-8ab7-88072b0d95bc service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] No waiting events found dispatching network-vif-plugged-2edbeaad-cd66-4a79-9fae-544f2a33e922 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:53 user nova-compute[72504]: WARNING nova.compute.manager [req-b7ef17dc-1184-4bec-bc41-49c8fab83e4d req-85185078-af8c-4e49-8ab7-88072b0d95bc service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Received unexpected event network-vif-plugged-2edbeaad-cd66-4a79-9fae-544f2a33e922 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 19:53:53 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:53:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d90159b-5d74-440f-b904-184410811563 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 30.270s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:53 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:53:53 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Took 9.67 seconds to deallocate network for instance.
Aug 01 19:53:54 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919634.8701427, 5193c770-80ca-44c3-9950-cb25c65e94e8 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:53:54 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] VM Resumed (Lifecycle Event)
Aug 01 19:53:54 user nova-compute[72504]: DEBUG nova.compute.manager [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:53:54 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Instance running successfully.
Aug 01 19:53:54 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Failed to set time: agent not configured {{(pid=72504) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 01 19:53:54 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9ac6be48-a0a9-462b-857c-49030a48f368 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] finish_migration finished successfully. {{(pid=72504) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 01 19:53:54 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:53:54 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:53:54 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 19:53:54 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919634.8741326, 5193c770-80ca-44c3-9950-cb25c65e94e8 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:53:54 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] VM Started (Lifecycle Event)
Aug 01 19:53:54 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:53:54 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:53:55 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 19:53:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-891e383f-e592-4e62-ae97-2da9590a7e30 req-6d15c054-9ecd-4fed-acc3-c1c9064ce596 service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Received event network-vif-plugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-891e383f-e592-4e62-ae97-2da9590a7e30 req-6d15c054-9ecd-4fed-acc3-c1c9064ce596 service nova] Acquiring lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-891e383f-e592-4e62-ae97-2da9590a7e30 req-6d15c054-9ecd-4fed-acc3-c1c9064ce596 service nova] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-891e383f-e592-4e62-ae97-2da9590a7e30 req-6d15c054-9ecd-4fed-acc3-c1c9064ce596 service nova] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-891e383f-e592-4e62-ae97-2da9590a7e30 req-6d15c054-9ecd-4fed-acc3-c1c9064ce596 service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] No waiting events found dispatching network-vif-plugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:55 user nova-compute[72504]: WARNING nova.compute.manager [req-891e383f-e592-4e62-ae97-2da9590a7e30 req-6d15c054-9ecd-4fed-acc3-c1c9064ce596 service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Received unexpected event network-vif-plugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 for instance with vm_state resized and task_state None.
Aug 01 19:53:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-891e383f-e592-4e62-ae97-2da9590a7e30 req-6d15c054-9ecd-4fed-acc3-c1c9064ce596 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-deleted-1898db0f-13d0-443c-a15f-bcb85039ecdd {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-891e383f-e592-4e62-ae97-2da9590a7e30 req-6d15c054-9ecd-4fed-acc3-c1c9064ce596 service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Received event network-vif-plugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-891e383f-e592-4e62-ae97-2da9590a7e30 req-6d15c054-9ecd-4fed-acc3-c1c9064ce596 service nova] Acquiring lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-891e383f-e592-4e62-ae97-2da9590a7e30 req-6d15c054-9ecd-4fed-acc3-c1c9064ce596 service nova] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-891e383f-e592-4e62-ae97-2da9590a7e30 req-6d15c054-9ecd-4fed-acc3-c1c9064ce596 service nova] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-891e383f-e592-4e62-ae97-2da9590a7e30 req-6d15c054-9ecd-4fed-acc3-c1c9064ce596 service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] No waiting events found dispatching network-vif-plugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:53:55 user nova-compute[72504]: WARNING nova.compute.manager [req-891e383f-e592-4e62-ae97-2da9590a7e30 req-6d15c054-9ecd-4fed-acc3-c1c9064ce596 service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Received unexpected event network-vif-plugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 for instance with vm_state resized and task_state None.
Aug 01 19:53:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-891e383f-e592-4e62-ae97-2da9590a7e30 req-6d15c054-9ecd-4fed-acc3-c1c9064ce596 service nova] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Received event network-vif-deleted-fd0b585f-558c-44a1-a5a3-24f825aa19e0 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:53:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:56 user nova-compute[72504]: INFO nova.compute.manager [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Took 2.70 seconds to detach 3 volumes for instance.
Aug 01 19:53:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:53:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:53:56 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690919621.3380134, 85816260-b37b-4b9e-9b52-f823120645aa => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:53:56 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] VM Stopped (Lifecycle Event)
Aug 01 19:53:56 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3c69ceb7-1900-4c7c-9370-6287fc444bd2 None None] [instance: 85816260-b37b-4b9e-9b52-f823120645aa] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:53:57 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:53:57 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:53:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.578s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:57 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Deleted allocations for instance 85816260-b37b-4b9e-9b52-f823120645aa
Aug 01 19:53:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:53:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8d47ee8e-c300-4baa-8695-ea05d5baf492 tempest-TaggedBootDevicesTest_v242-1825089340 tempest-TaggedBootDevicesTest_v242-1825089340-project-member] Lock "85816260-b37b-4b9e-9b52-f823120645aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 18.637s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:53:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:00 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690919625.6201956, 840f652e-bd31-4cb0-bd52-2873a641d876 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:54:00 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] VM Stopped (Lifecycle Event)
Aug 01 19:54:00 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e70bab82-96e0-49d3-b87a-897729fb9929 None None] [instance: 840f652e-bd31-4cb0-bd52-2873a641d876] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:54:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Acquiring lock "cb230370-0feb-46b5-8837-35fea366b34f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:54:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lock "cb230370-0feb-46b5-8837-35fea366b34f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:54:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 19:54:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:54:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:54:03 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:54:03 user nova-compute[72504]: INFO nova.compute.claims [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Claim successful on node user
Aug 01 19:54:03 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:54:03 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:54:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:54:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 19:54:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 19:54:03 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 19:54:03 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 19:54:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 19:54:04 user nova-compute[72504]: DEBUG nova.policy [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7336874664f446a3ae318c21643a7925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa32d6ef3fa4cf3b5d229f868e34045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 19:54:04 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 19:54:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:54:04 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Creating image(s)
Aug 01 19:54:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb230370-0feb-46b5-8837-35fea366b34f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:54:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lock "/opt/stack/data/nova/instances/cb230370-0feb-46b5-8837-35fea366b34f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:54:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lock "/opt/stack/data/nova/instances/cb230370-0feb-46b5-8837-35fea366b34f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:54:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.178s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:54:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:54:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/cb230370-0feb-46b5-8837-35fea366b34f/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/cb230370-0feb-46b5-8837-35fea366b34f/disk 1073741824" returned: 0 in 0.058s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:54:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.157s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:04 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb230370-0feb-46b5-8837-35fea366b34f/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 19:54:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb230370-0feb-46b5-8837-35fea366b34f/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:04 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Successfully created port: e342b987-cf5d-4e32-ba7c-d18fa3519229 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:54:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb230370-0feb-46b5-8837-35fea366b34f/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:04 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Cannot resize image /opt/stack/data/nova/instances/cb230370-0feb-46b5-8837-35fea366b34f/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 19:54:04 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lazy-loading 'migration_context' on Instance uuid cb230370-0feb-46b5-8837-35fea366b34f {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:54:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 19:54:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Ensure instance console log exists: /opt/stack/data/nova/instances/cb230370-0feb-46b5-8837-35fea366b34f/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:54:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:54:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:54:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:54:05 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Successfully updated port: e342b987-cf5d-4e32-ba7c-d18fa3519229 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:54:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Acquiring lock "refresh_cache-cb230370-0feb-46b5-8837-35fea366b34f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:54:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Acquired lock "refresh_cache-cb230370-0feb-46b5-8837-35fea366b34f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:54:05 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:54:05 user nova-compute[72504]: DEBUG nova.compute.manager [req-5ca2f261-096c-4a81-92a8-01d5322430a7 req-31905649-3d3c-4f9c-8b38-e58989c74b2b service nova] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Received event network-changed-e342b987-cf5d-4e32-ba7c-d18fa3519229 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:54:05 user nova-compute[72504]: DEBUG nova.compute.manager [req-5ca2f261-096c-4a81-92a8-01d5322430a7 req-31905649-3d3c-4f9c-8b38-e58989c74b2b service nova] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Refreshing instance network info cache due to event network-changed-e342b987-cf5d-4e32-ba7c-d18fa3519229. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:54:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5ca2f261-096c-4a81-92a8-01d5322430a7 req-31905649-3d3c-4f9c-8b38-e58989c74b2b service nova] Acquiring lock "refresh_cache-cb230370-0feb-46b5-8837-35fea366b34f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:54:05 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:54:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:05 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Updating instance_info_cache with network_info: [{"id": "e342b987-cf5d-4e32-ba7c-d18fa3519229", "address": "fa:16:3e:ba:56:6f", "network": {"id": "63ff1aab-acfc-4e7b-aee4-4bcd09b47a06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1427520461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aa32d6ef3fa4cf3b5d229f868e34045", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape342b987-cf", "ovs_interfaceid": "e342b987-cf5d-4e32-ba7c-d18fa3519229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Releasing lock "refresh_cache-cb230370-0feb-46b5-8837-35fea366b34f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Instance network_info: |[{"id": "e342b987-cf5d-4e32-ba7c-d18fa3519229", "address": "fa:16:3e:ba:56:6f", "network": {"id": "63ff1aab-acfc-4e7b-aee4-4bcd09b47a06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1427520461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aa32d6ef3fa4cf3b5d229f868e34045", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape342b987-cf", "ovs_interfaceid": "e342b987-cf5d-4e32-ba7c-d18fa3519229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5ca2f261-096c-4a81-92a8-01d5322430a7 req-31905649-3d3c-4f9c-8b38-e58989c74b2b service nova] Acquired lock "refresh_cache-cb230370-0feb-46b5-8837-35fea366b34f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.network.neutron [req-5ca2f261-096c-4a81-92a8-01d5322430a7 req-31905649-3d3c-4f9c-8b38-e58989c74b2b service nova] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Refreshing network info cache for port e342b987-cf5d-4e32-ba7c-d18fa3519229 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Start _get_guest_xml network_info=[{"id": "e342b987-cf5d-4e32-ba7c-d18fa3519229", "address": "fa:16:3e:ba:56:6f", "network": {"id": "63ff1aab-acfc-4e7b-aee4-4bcd09b47a06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1427520461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aa32d6ef3fa4cf3b5d229f868e34045", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape342b987-cf", "ovs_interfaceid": "e342b987-cf5d-4e32-ba7c-d18fa3519229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:54:06 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:54:06 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:54:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2056322209',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2056322209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2056322',id=16,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRIyW2FBXcvI67fmCRGig/d6LUthuWq1woC8+/Eir391DE5iEKV5UloI9MtOykxG+Ke7U5bxnTaEWJf5t7OkGCpEgoPZzx07e412yl8eyklOrsWf+W54ZftTSPXV+4r8g==',key_name='tempest-keypair-1800767565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aa32d6ef3fa4cf3b5d229f868e34045',ramdisk_id='',reservation_id='r-noa5n77e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-337134775',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:54:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7336874664f446a3ae318c21643a7925',uuid=cb230370-0feb-46b5-8837-35fea366b34f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e342b987-cf5d-4e32-ba7c-d18fa3519229", "address": "fa:16:3e:ba:56:6f", "network": {"id": "63ff1aab-acfc-4e7b-aee4-4bcd09b47a06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1427520461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aa32d6ef3fa4cf3b5d229f868e34045", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape342b987-cf", "ovs_interfaceid": "e342b987-cf5d-4e32-ba7c-d18fa3519229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Converting VIF {"id": "e342b987-cf5d-4e32-ba7c-d18fa3519229", "address": "fa:16:3e:ba:56:6f", "network": {"id": "63ff1aab-acfc-4e7b-aee4-4bcd09b47a06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1427520461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aa32d6ef3fa4cf3b5d229f868e34045", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape342b987-cf", "ovs_interfaceid": "e342b987-cf5d-4e32-ba7c-d18fa3519229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:56:6f,bridge_name='br-int',has_traffic_filtering=True,id=e342b987-cf5d-4e32-ba7c-d18fa3519229,network=Network(63ff1aab-acfc-4e7b-aee4-4bcd09b47a06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape342b987-cf') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lazy-loading 'pci_devices' on Instance uuid cb230370-0feb-46b5-8837-35fea366b34f {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:54:06 user nova-compute[72504]:   <uuid>cb230370-0feb-46b5-8837-35fea366b34f</uuid>
Aug 01 19:54:06 user nova-compute[72504]:   <name>instance-00000010</name>
Aug 01 19:54:06 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:54:06 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:54:06 user nova-compute[72504]:   <metadata>
Aug 01 19:54:06 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:54:06 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:54:06 user nova-compute[72504]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-2056322209</nova:name>
Aug 01 19:54:06 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:54:06</nova:creationTime>
Aug 01 19:54:06 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:54:06 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:54:06 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:54:06 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:54:06 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:54:06 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:54:06 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:54:06 user nova-compute[72504]:       <nova:owner>
Aug 01 19:54:06 user nova-compute[72504]:         <nova:user uuid="7336874664f446a3ae318c21643a7925">tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member</nova:user>
Aug 01 19:54:06 user nova-compute[72504]:         <nova:project uuid="2aa32d6ef3fa4cf3b5d229f868e34045">tempest-TestServerVolumeAttachScenarioOldVersion-337134775</nova:project>
Aug 01 19:54:06 user nova-compute[72504]:       </nova:owner>
Aug 01 19:54:06 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:54:06 user nova-compute[72504]:       <nova:ports>
Aug 01 19:54:06 user nova-compute[72504]:         <nova:port uuid="e342b987-cf5d-4e32-ba7c-d18fa3519229">
Aug 01 19:54:06 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 19:54:06 user nova-compute[72504]:         </nova:port>
Aug 01 19:54:06 user nova-compute[72504]:       </nova:ports>
Aug 01 19:54:06 user nova-compute[72504]:     </nova:instance>
Aug 01 19:54:06 user nova-compute[72504]:   </metadata>
Aug 01 19:54:06 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:54:06 user nova-compute[72504]:     <system>
Aug 01 19:54:06 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:54:06 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:54:06 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:54:06 user nova-compute[72504]:       <entry name="serial">cb230370-0feb-46b5-8837-35fea366b34f</entry>
Aug 01 19:54:06 user nova-compute[72504]:       <entry name="uuid">cb230370-0feb-46b5-8837-35fea366b34f</entry>
Aug 01 19:54:06 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:54:06 user nova-compute[72504]:     </system>
Aug 01 19:54:06 user nova-compute[72504]:   </sysinfo>
Aug 01 19:54:06 user nova-compute[72504]:   <os>
Aug 01 19:54:06 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:54:06 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:54:06 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:54:06 user nova-compute[72504]:   </os>
Aug 01 19:54:06 user nova-compute[72504]:   <features>
Aug 01 19:54:06 user nova-compute[72504]:     <acpi/>
Aug 01 19:54:06 user nova-compute[72504]:     <apic/>
Aug 01 19:54:06 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:54:06 user nova-compute[72504]:   </features>
Aug 01 19:54:06 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:54:06 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:54:06 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:54:06 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:54:06 user nova-compute[72504]:   </clock>
Aug 01 19:54:06 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:54:06 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:54:06 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:54:06 user nova-compute[72504]:   </cpu>
Aug 01 19:54:06 user nova-compute[72504]:   <devices>
Aug 01 19:54:06 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:54:06 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:54:06 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/cb230370-0feb-46b5-8837-35fea366b34f/disk"/>
Aug 01 19:54:06 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:54:06 user nova-compute[72504]:     </disk>
Aug 01 19:54:06 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:54:06 user nova-compute[72504]:       <mac address="fa:16:3e:ba:56:6f"/>
Aug 01 19:54:06 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:54:06 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:54:06 user nova-compute[72504]:       <target dev="tape342b987-cf"/>
Aug 01 19:54:06 user nova-compute[72504]:     </interface>
Aug 01 19:54:06 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:54:06 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/cb230370-0feb-46b5-8837-35fea366b34f/console.log" append="off"/>
Aug 01 19:54:06 user nova-compute[72504]:     </serial>
Aug 01 19:54:06 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:54:06 user nova-compute[72504]:     <video>
Aug 01 19:54:06 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:54:06 user nova-compute[72504]:     </video>
Aug 01 19:54:06 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:54:06 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:54:06 user nova-compute[72504]:     </rng>
Aug 01 19:54:06 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:54:06 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:54:06 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:54:06 user nova-compute[72504]:     </memballoon>
Aug 01 19:54:06 user nova-compute[72504]:   </devices>
Aug 01 19:54:06 user nova-compute[72504]: </domain>
Aug 01 19:54:06 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:54:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2056322209',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2056322209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2056322',id=16,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRIyW2FBXcvI67fmCRGig/d6LUthuWq1woC8+/Eir391DE5iEKV5UloI9MtOykxG+Ke7U5bxnTaEWJf5t7OkGCpEgoPZzx07e412yl8eyklOrsWf+W54ZftTSPXV+4r8g==',key_name='tempest-keypair-1800767565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2aa32d6ef3fa4cf3b5d229f868e34045',ramdisk_id='',reservation_id='r-noa5n77e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-337134775',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:54:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7336874664f446a3ae318c21643a7925',uuid=cb230370-0feb-46b5-8837-35fea366b34f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e342b987-cf5d-4e32-ba7c-d18fa3519229", "address": "fa:16:3e:ba:56:6f", "network": {"id": "63ff1aab-acfc-4e7b-aee4-4bcd09b47a06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1427520461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aa32d6ef3fa4cf3b5d229f868e34045", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape342b987-cf", "ovs_interfaceid": "e342b987-cf5d-4e32-ba7c-d18fa3519229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Converting VIF {"id": "e342b987-cf5d-4e32-ba7c-d18fa3519229", "address": "fa:16:3e:ba:56:6f", "network": {"id": "63ff1aab-acfc-4e7b-aee4-4bcd09b47a06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1427520461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aa32d6ef3fa4cf3b5d229f868e34045", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape342b987-cf", "ovs_interfaceid": "e342b987-cf5d-4e32-ba7c-d18fa3519229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:56:6f,bridge_name='br-int',has_traffic_filtering=True,id=e342b987-cf5d-4e32-ba7c-d18fa3519229,network=Network(63ff1aab-acfc-4e7b-aee4-4bcd09b47a06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape342b987-cf') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG os_vif [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:56:6f,bridge_name='br-int',has_traffic_filtering=True,id=e342b987-cf5d-4e32-ba7c-d18fa3519229,network=Network(63ff1aab-acfc-4e7b-aee4-4bcd09b47a06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape342b987-cf') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape342b987-cf, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape342b987-cf, col_values=(('external_ids', {'iface-id': 'e342b987-cf5d-4e32-ba7c-d18fa3519229', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:56:6f', 'vm-uuid': 'cb230370-0feb-46b5-8837-35fea366b34f'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:06 user nova-compute[72504]: INFO os_vif [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:56:6f,bridge_name='br-int',has_traffic_filtering=True,id=e342b987-cf5d-4e32-ba7c-d18fa3519229,network=Network(63ff1aab-acfc-4e7b-aee4-4bcd09b47a06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape342b987-cf')
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] No VIF found with MAC fa:16:3e:ba:56:6f, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.network.neutron [req-5ca2f261-096c-4a81-92a8-01d5322430a7 req-31905649-3d3c-4f9c-8b38-e58989c74b2b service nova] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Updated VIF entry in instance network info cache for port e342b987-cf5d-4e32-ba7c-d18fa3519229. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG nova.network.neutron [req-5ca2f261-096c-4a81-92a8-01d5322430a7 req-31905649-3d3c-4f9c-8b38-e58989c74b2b service nova] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Updating instance_info_cache with network_info: [{"id": "e342b987-cf5d-4e32-ba7c-d18fa3519229", "address": "fa:16:3e:ba:56:6f", "network": {"id": "63ff1aab-acfc-4e7b-aee4-4bcd09b47a06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1427520461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aa32d6ef3fa4cf3b5d229f868e34045", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape342b987-cf", "ovs_interfaceid": "e342b987-cf5d-4e32-ba7c-d18fa3519229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:54:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5ca2f261-096c-4a81-92a8-01d5322430a7 req-31905649-3d3c-4f9c-8b38-e58989c74b2b service nova] Releasing lock "refresh_cache-cb230370-0feb-46b5-8837-35fea366b34f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:54:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:07 user nova-compute[72504]: DEBUG nova.compute.manager [req-90566101-58f3-4967-85ec-e0ea3e974d45 req-dc77c9b6-08c3-483c-9686-591d207beb49 service nova] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Received event network-vif-plugged-e342b987-cf5d-4e32-ba7c-d18fa3519229 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:54:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-90566101-58f3-4967-85ec-e0ea3e974d45 req-dc77c9b6-08c3-483c-9686-591d207beb49 service nova] Acquiring lock "cb230370-0feb-46b5-8837-35fea366b34f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:54:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-90566101-58f3-4967-85ec-e0ea3e974d45 req-dc77c9b6-08c3-483c-9686-591d207beb49 service nova] Lock "cb230370-0feb-46b5-8837-35fea366b34f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:54:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-90566101-58f3-4967-85ec-e0ea3e974d45 req-dc77c9b6-08c3-483c-9686-591d207beb49 service nova] Lock "cb230370-0feb-46b5-8837-35fea366b34f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:54:07 user nova-compute[72504]: DEBUG nova.compute.manager [req-90566101-58f3-4967-85ec-e0ea3e974d45 req-dc77c9b6-08c3-483c-9686-591d207beb49 service nova] [instance: cb230370-0feb-46b5-8837-35fea366b34f] No waiting events found dispatching network-vif-plugged-e342b987-cf5d-4e32-ba7c-d18fa3519229 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:54:07 user nova-compute[72504]: WARNING nova.compute.manager [req-90566101-58f3-4967-85ec-e0ea3e974d45 req-dc77c9b6-08c3-483c-9686-591d207beb49 service nova] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Received unexpected event network-vif-plugged-e342b987-cf5d-4e32-ba7c-d18fa3519229 for instance with vm_state building and task_state spawning.
Aug 01 19:54:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:09 user nova-compute[72504]: DEBUG nova.compute.manager [req-5e72bef3-3da7-46d2-b381-d0eb3da0cd12 req-2c7e6ff0-0a9f-4606-9586-21cd9fbe74f8 service nova] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Received event network-vif-plugged-e342b987-cf5d-4e32-ba7c-d18fa3519229 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:54:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5e72bef3-3da7-46d2-b381-d0eb3da0cd12 req-2c7e6ff0-0a9f-4606-9586-21cd9fbe74f8 service nova] Acquiring lock "cb230370-0feb-46b5-8837-35fea366b34f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:54:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5e72bef3-3da7-46d2-b381-d0eb3da0cd12 req-2c7e6ff0-0a9f-4606-9586-21cd9fbe74f8 service nova] Lock "cb230370-0feb-46b5-8837-35fea366b34f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:54:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5e72bef3-3da7-46d2-b381-d0eb3da0cd12 req-2c7e6ff0-0a9f-4606-9586-21cd9fbe74f8 service nova] Lock "cb230370-0feb-46b5-8837-35fea366b34f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:54:09 user nova-compute[72504]: DEBUG nova.compute.manager [req-5e72bef3-3da7-46d2-b381-d0eb3da0cd12 req-2c7e6ff0-0a9f-4606-9586-21cd9fbe74f8 service nova] [instance: cb230370-0feb-46b5-8837-35fea366b34f] No waiting events found dispatching network-vif-plugged-e342b987-cf5d-4e32-ba7c-d18fa3519229 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:54:09 user nova-compute[72504]: WARNING nova.compute.manager [req-5e72bef3-3da7-46d2-b381-d0eb3da0cd12 req-2c7e6ff0-0a9f-4606-9586-21cd9fbe74f8 service nova] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Received unexpected event network-vif-plugged-e342b987-cf5d-4e32-ba7c-d18fa3519229 for instance with vm_state building and task_state spawning.
Aug 01 19:54:10 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919650.1320112, cb230370-0feb-46b5-8837-35fea366b34f => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:54:10 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: cb230370-0feb-46b5-8837-35fea366b34f] VM Resumed (Lifecycle Event)
Aug 01 19:54:10 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:54:10 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:54:10 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Instance spawned successfully.
Aug 01 19:54:10 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 19:54:10 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:54:10 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:54:10 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:54:10 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:54:10 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:54:10 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:54:10 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:54:10 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:54:10 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: cb230370-0feb-46b5-8837-35fea366b34f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:54:10 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919650.1351225, cb230370-0feb-46b5-8837-35fea366b34f => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:54:10 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: cb230370-0feb-46b5-8837-35fea366b34f] VM Started (Lifecycle Event)
Aug 01 19:54:10 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:54:10 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:54:10 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: cb230370-0feb-46b5-8837-35fea366b34f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:54:10 user nova-compute[72504]: INFO nova.compute.manager [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Took 6.41 seconds to spawn the instance on the hypervisor.
Aug 01 19:54:10 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:54:10 user nova-compute[72504]: INFO nova.compute.manager [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Took 7.29 seconds to build instance.
Aug 01 19:54:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e6f60e97-2087-4168-a214-0c338c59bf2e tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lock "cb230370-0feb-46b5-8837-35fea366b34f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.398s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:54:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:11 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:54:11 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:54:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:12 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:54:14 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:54:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:54:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:54:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:54:14 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:54:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb230370-0feb-46b5-8837-35fea366b34f/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb230370-0feb-46b5-8837-35fea366b34f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb230370-0feb-46b5-8837-35fea366b34f/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb230370-0feb-46b5-8837-35fea366b34f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6496ff-6f53-4617-9f99-e932d7267fda/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6496ff-6f53-4617-9f99-e932d7267fda/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6496ff-6f53-4617-9f99-e932d7267fda/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6496ff-6f53-4617-9f99-e932d7267fda/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:54:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:54:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:54:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:54:18 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:54:18 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:54:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=7456MB free_disk=25.432579040527344GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:54:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:54:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:54:18 user nova-compute[72504]: INFO nova.compute.manager [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Rescuing
Aug 01 19:54:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "refresh_cache-7391a8ce-7ce5-47ec-97f6-6159645688ea" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:54:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquired lock "refresh_cache-7391a8ce-7ce5-47ec-97f6-6159645688ea" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:54:18 user nova-compute[72504]: DEBUG nova.network.neutron [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:54:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Applying migration context for instance 5193c770-80ca-44c3-9950-cb25c65e94e8 as it has an incoming, in-progress migration 4901761c-b8c7-43c6-ae23-07943cf903e4. Migration status is finished {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 19:54:18 user nova-compute[72504]: INFO nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Updating resource usage from migration 4901761c-b8c7-43c6-ae23-07943cf903e4
Aug 01 19:54:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:54:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1de87977-532f-45f7-856b-84df41b2a567 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:54:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance c9fd391d-51c0-4ef9-86cc-5ce2c76c177a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:54:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 7391a8ce-7ce5-47ec-97f6-6159645688ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:54:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance ab6496ff-6f53-4617-9f99-e932d7267fda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:54:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:54:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 128c2981-363c-4ae9-b46d-15b5e5d9cac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:54:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 76aa3861-0ca1-4e7f-9a15-9219037bc1ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:54:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Migration 4901761c-b8c7-43c6-ae23-07943cf903e4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 19:54:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 5193c770-80ca-44c3-9950-cb25c65e94e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:54:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance cb230370-0feb-46b5-8837-35fea366b34f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:54:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:54:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:54:19 user nova-compute[72504]: DEBUG nova.network.neutron [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Updating instance_info_cache with network_info: [{"id": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "address": "fa:16:3e:08:82:e6", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd06cd7-81", "ovs_interfaceid": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:54:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Releasing lock "refresh_cache-7391a8ce-7ce5-47ec-97f6-6159645688ea" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:54:19 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:54:19 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:54:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:54:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.614s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:54:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:19 user nova-compute[72504]: DEBUG nova.compute.manager [req-c7d4a6cc-3160-4e95-ab68-12f2f053dd25 req-b01b1e70-e96e-483e-8169-7d03ae763e7a service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Received event network-vif-unplugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:54:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c7d4a6cc-3160-4e95-ab68-12f2f053dd25 req-b01b1e70-e96e-483e-8169-7d03ae763e7a service nova] Acquiring lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:54:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c7d4a6cc-3160-4e95-ab68-12f2f053dd25 req-b01b1e70-e96e-483e-8169-7d03ae763e7a service nova] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:54:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c7d4a6cc-3160-4e95-ab68-12f2f053dd25 req-b01b1e70-e96e-483e-8169-7d03ae763e7a service nova] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:54:19 user nova-compute[72504]: DEBUG nova.compute.manager [req-c7d4a6cc-3160-4e95-ab68-12f2f053dd25 req-b01b1e70-e96e-483e-8169-7d03ae763e7a service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] No waiting events found dispatching network-vif-unplugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:54:19 user nova-compute[72504]: WARNING nova.compute.manager [req-c7d4a6cc-3160-4e95-ab68-12f2f053dd25 req-b01b1e70-e96e-483e-8169-7d03ae763e7a service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Received unexpected event network-vif-unplugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 for instance with vm_state active and task_state rescuing.
Aug 01 19:54:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:20 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Instance destroyed successfully.
Aug 01 19:54:20 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Attempting a stable device rescue
Aug 01 19:54:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72504) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 19:54:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Instance directory exists: not creating {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 19:54:20 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Creating image(s)
Aug 01 19:54:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "/opt/stack/data/nova/instances/7391a8ce-7ce5-47ec-97f6-6159645688ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:54:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "/opt/stack/data/nova/instances/7391a8ce-7ce5-47ec-97f6-6159645688ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:54:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "/opt/stack/data/nova/instances/7391a8ce-7ce5-47ec-97f6-6159645688ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:54:20 user nova-compute[72504]: DEBUG nova.objects.instance [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7391a8ce-7ce5-47ec-97f6-6159645688ea {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:54:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "074eae364ff5c4c70ec3be4140b38e8248990d4e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:54:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "074eae364ff5c4c70ec3be4140b38e8248990d4e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:54:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/074eae364ff5c4c70ec3be4140b38e8248990d4e.part --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:21 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:54:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:21 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:54:21 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:54:21 user nova-compute[72504]: DEBUG nova.compute.manager [req-92ccb6fa-faa2-4adf-b83d-441d26226bf5 req-0d4d3aed-4f4b-447c-ac69-59394f92e2ba service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Received event network-vif-plugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:54:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-92ccb6fa-faa2-4adf-b83d-441d26226bf5 req-0d4d3aed-4f4b-447c-ac69-59394f92e2ba service nova] Acquiring lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:54:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-92ccb6fa-faa2-4adf-b83d-441d26226bf5 req-0d4d3aed-4f4b-447c-ac69-59394f92e2ba service nova] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:54:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-92ccb6fa-faa2-4adf-b83d-441d26226bf5 req-0d4d3aed-4f4b-447c-ac69-59394f92e2ba service nova] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:54:21 user nova-compute[72504]: DEBUG nova.compute.manager [req-92ccb6fa-faa2-4adf-b83d-441d26226bf5 req-0d4d3aed-4f4b-447c-ac69-59394f92e2ba service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] No waiting events found dispatching network-vif-plugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:54:21 user nova-compute[72504]: WARNING nova.compute.manager [req-92ccb6fa-faa2-4adf-b83d-441d26226bf5 req-0d4d3aed-4f4b-447c-ac69-59394f92e2ba service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Received unexpected event network-vif-plugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 for instance with vm_state active and task_state rescuing.
Aug 01 19:54:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/074eae364ff5c4c70ec3be4140b38e8248990d4e.part --force-share --output=json" returned: 0 in 0.194s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:21 user nova-compute[72504]: DEBUG nova.virt.images [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] c44c22a7-9852-4a65-b0ca-fe012bf7b08a was qcow2, converting to raw {{(pid=72504) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 19:54:21 user nova-compute[72504]: DEBUG nova.privsep.utils [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72504) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 19:54:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/074eae364ff5c4c70ec3be4140b38e8248990d4e.part /opt/stack/data/nova/instances/_base/074eae364ff5c4c70ec3be4140b38e8248990d4e.converted {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:54:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:54:21 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Acquiring lock "d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG nova.compute.manager [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Updating instance_info_cache with network_info: [{"id": "381103b0-a255-4d2a-b20e-8dc4b15028e9", "address": "fa:16:3e:45:86:19", "network": {"id": "b2c62156-50c6-4f54-b857-961843d14579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-554746486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd6112c6db747f297455ca969783d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381103b0-a2", "ovs_interfaceid": "381103b0-a255-4d2a-b20e-8dc4b15028e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/074eae364ff5c4c70ec3be4140b38e8248990d4e.part /opt/stack/data/nova/instances/_base/074eae364ff5c4c70ec3be4140b38e8248990d4e.converted" returned: 0 in 0.711s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/074eae364ff5c4c70ec3be4140b38e8248990d4e.converted --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:54:22 user nova-compute[72504]: INFO nova.compute.claims [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Claim successful on node user
Aug 01 19:54:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/074eae364ff5c4c70ec3be4140b38e8248990d4e.converted --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "074eae364ff5c4c70ec3be4140b38e8248990d4e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.469s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "074eae364ff5c4c70ec3be4140b38e8248990d4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "074eae364ff5c4c70ec3be4140b38e8248990d4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/074eae364ff5c4c70ec3be4140b38e8248990d4e --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/074eae364ff5c4c70ec3be4140b38e8248990d4e --force-share --output=json" returned: 0 in 0.130s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/074eae364ff5c4c70ec3be4140b38e8248990d4e,backing_fmt=raw /opt/stack/data/nova/instances/7391a8ce-7ce5-47ec-97f6-6159645688ea/disk.rescue {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/074eae364ff5c4c70ec3be4140b38e8248990d4e,backing_fmt=raw /opt/stack/data/nova/instances/7391a8ce-7ce5-47ec-97f6-6159645688ea/disk.rescue" returned: 0 in 0.051s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "074eae364ff5c4c70ec3be4140b38e8248990d4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG nova.objects.instance [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lazy-loading 'migration_context' on Instance uuid 7391a8ce-7ce5-47ec-97f6-6159645688ea {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Start _get_guest_xml network_info=[{"id": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "address": "fa:16:3e:08:82:e6", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "vif_mac": "fa:16:3e:08:82:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd06cd7-81", "ovs_interfaceid": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c44c22a7-9852-4a65-b0ca-fe012bf7b08a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcdXAqpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '7391a8ce-7ce5-47ec-97f6-6159645688ea', 'attached_at': '', 'detached_at': '', 'volume_id': '6a4682cd-8a63-4b10-9857-1ea601c38ba9', 'serial': '6a4682cd-8a63-4b10-9857-1ea601c38ba9'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': '2ceec72f-cb71-4c09-a6ce-c4b18ff336dd', 'volume_type': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG nova.objects.instance [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lazy-loading 'resources' on Instance uuid 7391a8ce-7ce5-47ec-97f6-6159645688ea {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG nova.objects.instance [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lazy-loading 'numa_topology' on Instance uuid 7391a8ce-7ce5-47ec-97f6-6159645688ea {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:54:22 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:54:22 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:54:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG nova.objects.instance [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7391a8ce-7ce5-47ec-97f6-6159645688ea {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcdXAqpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:54:22 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:54:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:54:22 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:54:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:54:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:54:22 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:54:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260" returned: 0 in 0.101s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d607b3de-5f3d-4637-92c3-7260b95d008e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = LcdXAqpw\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 01 19:54:23 user nova-compute[72504]: node.name = iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9
Aug 01 19:54:23 user nova-compute[72504]: node.tpgt = -1
Aug 01 19:54:23 user nova-compute[72504]: node.startup = automatic
Aug 01 19:54:23 user nova-compute[72504]: node.leading_login = No
Aug 01 19:54:23 user nova-compute[72504]: iface.iscsi_ifacename = default
Aug 01 19:54:23 user nova-compute[72504]: iface.net_ifacename = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.ipaddress = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.prefix_len = 0
Aug 01 19:54:23 user nova-compute[72504]: iface.hwaddress = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.transport_name = tcp
Aug 01 19:54:23 user nova-compute[72504]: iface.initiatorname = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.state = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.vlan_id = 0
Aug 01 19:54:23 user nova-compute[72504]: iface.vlan_priority = 0
Aug 01 19:54:23 user nova-compute[72504]: iface.vlan_state = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.iface_num = 0
Aug 01 19:54:23 user nova-compute[72504]: iface.mtu = 0
Aug 01 19:54:23 user nova-compute[72504]: iface.port = 0
Aug 01 19:54:23 user nova-compute[72504]: iface.bootproto = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.subnet_mask = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.gateway = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.dhcp_alt_client_id_state = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.dhcp_alt_client_id = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.dhcp_dns = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.dhcp_learn_iqn = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.dhcp_req_vendor_id_state = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.dhcp_vendor_id_state = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.dhcp_vendor_id = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.dhcp_slp_da = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.fragmentation = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.gratuitous_arp = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.incoming_forwarding = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.tos_state = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.tos = 0
Aug 01 19:54:23 user nova-compute[72504]: iface.ttl = 0
Aug 01 19:54:23 user nova-compute[72504]: iface.delayed_ack = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.tcp_nagle = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.tcp_wsf_state = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.tcp_wsf = 0
Aug 01 19:54:23 user nova-compute[72504]: iface.tcp_timer_scale = 0
Aug 01 19:54:23 user nova-compute[72504]: iface.tcp_timestamp = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.redirect = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.def_task_mgmt_timeout = 0
Aug 01 19:54:23 user nova-compute[72504]: iface.header_digest = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.data_digest = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.immediate_data = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.initial_r2t = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.data_seq_inorder = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.data_pdu_inorder = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.erl = 0
Aug 01 19:54:23 user nova-compute[72504]: iface.max_receive_data_len = 0
Aug 01 19:54:23 user nova-compute[72504]: iface.first_burst_len = 0
Aug 01 19:54:23 user nova-compute[72504]: iface.max_outstanding_r2t = 0
Aug 01 19:54:23 user nova-compute[72504]: iface.max_burst_len = 0
Aug 01 19:54:23 user nova-compute[72504]: iface.chap_auth = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.bidi_chap = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.strict_login_compliance = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.discovery_auth = <empty>
Aug 01 19:54:23 user nova-compute[72504]: iface.discovery_logout = <empty>
Aug 01 19:54:23 user nova-compute[72504]: node.discovery_address = <empty>
Aug 01 19:54:23 user nova-compute[72504]: node.discovery_port = 0
Aug 01 19:54:23 user nova-compute[72504]: node.discovery_type = static
Aug 01 19:54:23 user nova-compute[72504]: node.session.initial_cmdsn = 0
Aug 01 19:54:23 user nova-compute[72504]: node.session.initial_login_retry_max = 8
Aug 01 19:54:23 user nova-compute[72504]: node.session.xmit_thread_priority = -20
Aug 01 19:54:23 user nova-compute[72504]: node.session.cmds_max = 128
Aug 01 19:54:23 user nova-compute[72504]: node.session.queue_depth = 32
Aug 01 19:54:23 user nova-compute[72504]: node.session.nr_sessions = 1
Aug 01 19:54:23 user nova-compute[72504]: node.session.auth.authmethod = CHAP
Aug 01 19:54:23 user nova-compute[72504]: node.session.auth.username = LcdXAqpw
Aug 01 19:54:23 user nova-compute[72504]: node.session.auth.password = ***
Aug 01 19:54:23 user nova-compute[72504]: node.session.auth.username_in = <empty>
Aug 01 19:54:23 user nova-compute[72504]: node.session.auth.password_in = <empty>
Aug 01 19:54:23 user nova-compute[72504]: node.session.auth.chap_algs = MD5
Aug 01 19:54:23 user nova-compute[72504]: node.session.timeo.replacement_timeout = 120
Aug 01 19:54:23 user nova-compute[72504]: node.session.err_timeo.abort_timeout = 15
Aug 01 19:54:23 user nova-compute[72504]: node.session.err_timeo.lu_reset_timeout = 30
Aug 01 19:54:23 user nova-compute[72504]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 01 19:54:23 user nova-compute[72504]: node.session.err_timeo.host_reset_timeout = 60
Aug 01 19:54:23 user nova-compute[72504]: node.session.iscsi.FastAbort = Yes
Aug 01 19:54:23 user nova-compute[72504]: node.session.iscsi.InitialR2T = No
Aug 01 19:54:23 user nova-compute[72504]: node.session.iscsi.ImmediateData = Yes
Aug 01 19:54:23 user nova-compute[72504]: node.session.iscsi.FirstBurstLength = 262144
Aug 01 19:54:23 user nova-compute[72504]: node.session.iscsi.MaxBurstLength = 16776192
Aug 01 19:54:23 user nova-compute[72504]: node.session.iscsi.DefaultTime2Retain = 0
Aug 01 19:54:23 user nova-compute[72504]: node.session.iscsi.DefaultTime2Wait = 2
Aug 01 19:54:23 user nova-compute[72504]: node.session.iscsi.MaxConnections = 1
Aug 01 19:54:23 user nova-compute[72504]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 01 19:54:23 user nova-compute[72504]: node.session.iscsi.ERL = 0
Aug 01 19:54:23 user nova-compute[72504]: node.session.scan = manual
Aug 01 19:54:23 user nova-compute[72504]: node.session.reopen_max = 0
Aug 01 19:54:23 user nova-compute[72504]: node.conn[0].address = 172.16.0.220
Aug 01 19:54:23 user nova-compute[72504]: node.conn[0].port = 3260
Aug 01 19:54:23 user nova-compute[72504]: node.conn[0].startup = manual
Aug 01 19:54:23 user nova-compute[72504]: node.conn[0].tcp.window_size = 524288
Aug 01 19:54:23 user nova-compute[72504]: node.conn[0].tcp.type_of_service = 0
Aug 01 19:54:23 user nova-compute[72504]: node.conn[0].timeo.logout_timeout = 15
Aug 01 19:54:23 user nova-compute[72504]: node.conn[0].timeo.login_timeout = 15
Aug 01 19:54:23 user nova-compute[72504]: node.conn[0].timeo.auth_timeout = 45
Aug 01 19:54:23 user nova-compute[72504]: node.conn[0].timeo.noop_out_interval = 5
Aug 01 19:54:23 user nova-compute[72504]: node.conn[0].timeo.noop_out_timeout = 5
Aug 01 19:54:23 user nova-compute[72504]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 01 19:54:23 user nova-compute[72504]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 01 19:54:23 user nova-compute[72504]: node.conn[0].iscsi.HeaderDigest = None
Aug 01 19:54:23 user nova-compute[72504]: node.conn[0].iscsi.DataDigest = None
Aug 01 19:54:23 user nova-compute[72504]: node.conn[0].iscsi.IFMarker = No
Aug 01 19:54:23 user nova-compute[72504]: node.conn[0].iscsi.OFMarker = No
Aug 01 19:54:23 user nova-compute[72504]: # END RECORD
Aug 01 19:54:23 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c284bba-dbfc-45aa-aad2-54151052d421]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5592127-b8d6-40d5-b9ce-72097ebfa1af]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LcdXAqpw {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LcdXAqpw" returned: 0 in 0.027s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[449a0f0e-a850-44b0-bc07-ab3ca98566bc]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LcdXAqpw'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.600s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.119s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a61dbfd-af01-424b-bf01-3a2d05b20805]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e411a17-3b80-4680-a139-71c28929a3f8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:54:23 user nova-compute[72504]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 (non-flash)
Aug 01 19:54:23 user nova-compute[72504]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)
Aug 01 19:54:23 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:54:23 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:54:23 user nova-compute[72504]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 (non-flash)
Aug 01 19:54:23 user nova-compute[72504]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)
Aug 01 19:54:23 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:54:23 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] HCTL ('33', '0', '0', 0) found on session 15 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG nova.network.neutron [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 19:54:23 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.050s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba81e73f-93d5-4115-9ef6-26c5c09af8f1]: (4, ('0 0 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Searching for a device in session 15 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcdXAqpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.430s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] <== connect_volume: return (432ms) {'type': 'block', 'scsi_wwn': '26539376333396562', 'path': '/dev/sdb'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539376333396562', 'path': '/dev/sdb'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:52:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1918672849',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1918672849',id=12,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:52:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b82898c99bce4f04afda7e9ff6e4d5db',ramdisk_id='',reservation_id='r-l7bz59oe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-519115368',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:52:50Z,user_data=None,user_id='01263cb2c1874026be1c735abc966b45',uuid=7391a8ce-7ce5-47ec-97f6-6159645688ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "address": "fa:16:3e:08:82:e6", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "vif_mac": "fa:16:3e:08:82:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd06cd7-81", "ovs_interfaceid": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Converting VIF {"id": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "address": "fa:16:3e:08:82:e6", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "vif_mac": "fa:16:3e:08:82:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd06cd7-81", "ovs_interfaceid": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:82:e6,bridge_name='br-int',has_traffic_filtering=True,id=2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bd06cd7-81') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG nova.objects.instance [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lazy-loading 'pci_devices' on Instance uuid 7391a8ce-7ce5-47ec-97f6-6159645688ea {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:54:23 user nova-compute[72504]:   <uuid>7391a8ce-7ce5-47ec-97f6-6159645688ea</uuid>
Aug 01 19:54:23 user nova-compute[72504]:   <name>instance-0000000c</name>
Aug 01 19:54:23 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:54:23 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:54:23 user nova-compute[72504]:   <metadata>
Aug 01 19:54:23 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:54:23 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:54:23 user nova-compute[72504]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1918672849</nova:name>
Aug 01 19:54:23 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:54:22</nova:creationTime>
Aug 01 19:54:23 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:54:23 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:54:23 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:54:23 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:54:23 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:54:23 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:54:23 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:54:23 user nova-compute[72504]:       <nova:owner>
Aug 01 19:54:23 user nova-compute[72504]:         <nova:user uuid="01263cb2c1874026be1c735abc966b45">tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member</nova:user>
Aug 01 19:54:23 user nova-compute[72504]:         <nova:project uuid="b82898c99bce4f04afda7e9ff6e4d5db">tempest-ServerBootFromVolumeStableRescueTest-519115368</nova:project>
Aug 01 19:54:23 user nova-compute[72504]:       </nova:owner>
Aug 01 19:54:23 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:54:23 user nova-compute[72504]:       <nova:ports>
Aug 01 19:54:23 user nova-compute[72504]:         <nova:port uuid="2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66">
Aug 01 19:54:23 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 19:54:23 user nova-compute[72504]:         </nova:port>
Aug 01 19:54:23 user nova-compute[72504]:       </nova:ports>
Aug 01 19:54:23 user nova-compute[72504]:     </nova:instance>
Aug 01 19:54:23 user nova-compute[72504]:   </metadata>
Aug 01 19:54:23 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:54:23 user nova-compute[72504]:     <system>
Aug 01 19:54:23 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:54:23 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:54:23 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:54:23 user nova-compute[72504]:       <entry name="serial">7391a8ce-7ce5-47ec-97f6-6159645688ea</entry>
Aug 01 19:54:23 user nova-compute[72504]:       <entry name="uuid">7391a8ce-7ce5-47ec-97f6-6159645688ea</entry>
Aug 01 19:54:23 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:54:23 user nova-compute[72504]:     </system>
Aug 01 19:54:23 user nova-compute[72504]:   </sysinfo>
Aug 01 19:54:23 user nova-compute[72504]:   <os>
Aug 01 19:54:23 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:54:23 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:54:23 user nova-compute[72504]:   </os>
Aug 01 19:54:23 user nova-compute[72504]:   <features>
Aug 01 19:54:23 user nova-compute[72504]:     <acpi/>
Aug 01 19:54:23 user nova-compute[72504]:     <apic/>
Aug 01 19:54:23 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:54:23 user nova-compute[72504]:   </features>
Aug 01 19:54:23 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:54:23 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:54:23 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:54:23 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:54:23 user nova-compute[72504]:   </clock>
Aug 01 19:54:23 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:54:23 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:54:23 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:54:23 user nova-compute[72504]:   </cpu>
Aug 01 19:54:23 user nova-compute[72504]:   <devices>
Aug 01 19:54:23 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 19:54:23 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:54:23 user nova-compute[72504]:       <source dev="/dev/sdb"/>
Aug 01 19:54:23 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:54:23 user nova-compute[72504]:       <serial>6a4682cd-8a63-4b10-9857-1ea601c38ba9</serial>
Aug 01 19:54:23 user nova-compute[72504]:     </disk>
Aug 01 19:54:23 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:54:23 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:54:23 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/7391a8ce-7ce5-47ec-97f6-6159645688ea/disk.rescue"/>
Aug 01 19:54:23 user nova-compute[72504]:       <target dev="vdb" bus="virtio"/>
Aug 01 19:54:23 user nova-compute[72504]:       <boot order="1"/>
Aug 01 19:54:23 user nova-compute[72504]:     </disk>
Aug 01 19:54:23 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:54:23 user nova-compute[72504]:       <mac address="fa:16:3e:08:82:e6"/>
Aug 01 19:54:23 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:54:23 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:54:23 user nova-compute[72504]:       <target dev="tap2bd06cd7-81"/>
Aug 01 19:54:23 user nova-compute[72504]:     </interface>
Aug 01 19:54:23 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:54:23 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/7391a8ce-7ce5-47ec-97f6-6159645688ea/console.log" append="off"/>
Aug 01 19:54:23 user nova-compute[72504]:     </serial>
Aug 01 19:54:23 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:54:23 user nova-compute[72504]:     <video>
Aug 01 19:54:23 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:54:23 user nova-compute[72504]:     </video>
Aug 01 19:54:23 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:54:23 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:54:23 user nova-compute[72504]:     </rng>
Aug 01 19:54:23 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:54:23 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:54:23 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:54:23 user nova-compute[72504]:     </memballoon>
Aug 01 19:54:23 user nova-compute[72504]:   </devices>
Aug 01 19:54:23 user nova-compute[72504]: </domain>
Aug 01 19:54:23 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG nova.policy [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '97ef13eef2a345909187312f5a62e0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540d878e5ea4bfda3d342e5a78035f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 19:54:23 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Instance destroyed successfully.
Aug 01 19:54:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] No VIF found with MAC fa:16:3e:08:82:e6, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:54:23 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Creating image(s)
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Acquiring lock "/opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "/opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "/opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.153s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk 1073741824" returned: 0 in 0.057s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:54:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.141s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:24 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 19:54:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:24 user nova-compute[72504]: DEBUG nova.network.neutron [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Successfully created port: 1ae5b451-36d3-474b-b576-26b42d8dbb6d {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:54:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:24 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Cannot resize image /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 19:54:24 user nova-compute[72504]: DEBUG nova.objects.instance [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lazy-loading 'migration_context' on Instance uuid d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:54:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 19:54:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Ensure instance console log exists: /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:54:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:54:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:54:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:54:24 user nova-compute[72504]: DEBUG nova.network.neutron [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Successfully updated port: 1ae5b451-36d3-474b-b576-26b42d8dbb6d {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:54:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Acquiring lock "refresh_cache-d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:54:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Acquired lock "refresh_cache-d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:54:24 user nova-compute[72504]: DEBUG nova.network.neutron [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:54:24 user nova-compute[72504]: DEBUG nova.compute.manager [req-4d66d47b-3fd1-4459-a2f8-5355ac1e2067 req-819a7472-5e5b-45e9-9ac4-999f9a8fa241 service nova] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Received event network-changed-1ae5b451-36d3-474b-b576-26b42d8dbb6d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:54:24 user nova-compute[72504]: DEBUG nova.compute.manager [req-4d66d47b-3fd1-4459-a2f8-5355ac1e2067 req-819a7472-5e5b-45e9-9ac4-999f9a8fa241 service nova] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Refreshing instance network info cache due to event network-changed-1ae5b451-36d3-474b-b576-26b42d8dbb6d. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:54:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4d66d47b-3fd1-4459-a2f8-5355ac1e2067 req-819a7472-5e5b-45e9-9ac4-999f9a8fa241 service nova] Acquiring lock "refresh_cache-d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:54:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:24 user nova-compute[72504]: DEBUG nova.network.neutron [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:54:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:25 user nova-compute[72504]: DEBUG nova.network.neutron [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Updating instance_info_cache with network_info: [{"id": "1ae5b451-36d3-474b-b576-26b42d8dbb6d", "address": "fa:16:3e:9d:e3:8f", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae5b451-36", "ovs_interfaceid": "1ae5b451-36d3-474b-b576-26b42d8dbb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:54:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Releasing lock "refresh_cache-d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:54:25 user nova-compute[72504]: DEBUG nova.compute.manager [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Instance network_info: |[{"id": "1ae5b451-36d3-474b-b576-26b42d8dbb6d", "address": "fa:16:3e:9d:e3:8f", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae5b451-36", "ovs_interfaceid": "1ae5b451-36d3-474b-b576-26b42d8dbb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 19:54:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4d66d47b-3fd1-4459-a2f8-5355ac1e2067 req-819a7472-5e5b-45e9-9ac4-999f9a8fa241 service nova] Acquired lock "refresh_cache-d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:54:25 user nova-compute[72504]: DEBUG nova.network.neutron [req-4d66d47b-3fd1-4459-a2f8-5355ac1e2067 req-819a7472-5e5b-45e9-9ac4-999f9a8fa241 service nova] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Refreshing network info cache for port 1ae5b451-36d3-474b-b576-26b42d8dbb6d {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:54:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Start _get_guest_xml network_info=[{"id": "1ae5b451-36d3-474b-b576-26b42d8dbb6d", "address": "fa:16:3e:9d:e3:8f", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae5b451-36", "ovs_interfaceid": "1ae5b451-36d3-474b-b576-26b42d8dbb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:54:25 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:54:25 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:54:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:54:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:54:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:54:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:54:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:54:25 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:54:25 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:54:25 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:54:25 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:54:25 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:54:25 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:54:25 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:54:25 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:54:25 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:54:25 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:54:25 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:54:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:54:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-368818763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-368818763',id=17,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQCD+zOzDrd1/CCpM6oSIMgSHsBflnqyFlcd8fKpthsdAbVFpTofSu3G34nwV4VW+3QK6NYd0lmqH2X7kyYik3VPR8N9fNexhWmS0Q3ij+8T7bAbFUZwST+7wOwH0oY7g==',key_name='tempest-keypair-1838146836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9540d878e5ea4bfda3d342e5a78035f5',ramdisk_id='',reservation_id='r-599zglgv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-2015428092',owner_user_name='tempest-ServerActionsV293TestJSON-2015428092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:54:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97ef13eef2a345909187312f5a62e0f6',uuid=d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ae5b451-36d3-474b-b576-26b42d8dbb6d", "address": "fa:16:3e:9d:e3:8f", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae5b451-36", "ovs_interfaceid": "1ae5b451-36d3-474b-b576-26b42d8dbb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:54:26 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Converting VIF {"id": "1ae5b451-36d3-474b-b576-26b42d8dbb6d", "address": "fa:16:3e:9d:e3:8f", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae5b451-36", "ovs_interfaceid": "1ae5b451-36d3-474b-b576-26b42d8dbb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:54:26 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:e3:8f,bridge_name='br-int',has_traffic_filtering=True,id=1ae5b451-36d3-474b-b576-26b42d8dbb6d,network=Network(d4da5ad8-9045-4076-9f31-ea9faaf8e6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ae5b451-36') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:54:26 user nova-compute[72504]: DEBUG nova.objects.instance [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lazy-loading 'pci_devices' on Instance uuid d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:54:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:54:26 user nova-compute[72504]:   <uuid>d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd</uuid>
Aug 01 19:54:26 user nova-compute[72504]:   <name>instance-00000011</name>
Aug 01 19:54:26 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:54:26 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:54:26 user nova-compute[72504]:   <metadata>
Aug 01 19:54:26 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:54:26 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:54:26 user nova-compute[72504]:       <nova:name>tempest-ServerActionsV293TestJSON-server-368818763</nova:name>
Aug 01 19:54:26 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:54:25</nova:creationTime>
Aug 01 19:54:26 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:54:26 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:54:26 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:54:26 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:54:26 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:54:26 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:54:26 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:54:26 user nova-compute[72504]:       <nova:owner>
Aug 01 19:54:26 user nova-compute[72504]:         <nova:user uuid="97ef13eef2a345909187312f5a62e0f6">tempest-ServerActionsV293TestJSON-2015428092-project-member</nova:user>
Aug 01 19:54:26 user nova-compute[72504]:         <nova:project uuid="9540d878e5ea4bfda3d342e5a78035f5">tempest-ServerActionsV293TestJSON-2015428092</nova:project>
Aug 01 19:54:26 user nova-compute[72504]:       </nova:owner>
Aug 01 19:54:26 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:54:26 user nova-compute[72504]:       <nova:ports>
Aug 01 19:54:26 user nova-compute[72504]:         <nova:port uuid="1ae5b451-36d3-474b-b576-26b42d8dbb6d">
Aug 01 19:54:26 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 19:54:26 user nova-compute[72504]:         </nova:port>
Aug 01 19:54:26 user nova-compute[72504]:       </nova:ports>
Aug 01 19:54:26 user nova-compute[72504]:     </nova:instance>
Aug 01 19:54:26 user nova-compute[72504]:   </metadata>
Aug 01 19:54:26 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:54:26 user nova-compute[72504]:     <system>
Aug 01 19:54:26 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:54:26 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:54:26 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:54:26 user nova-compute[72504]:       <entry name="serial">d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd</entry>
Aug 01 19:54:26 user nova-compute[72504]:       <entry name="uuid">d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd</entry>
Aug 01 19:54:26 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:54:26 user nova-compute[72504]:     </system>
Aug 01 19:54:26 user nova-compute[72504]:   </sysinfo>
Aug 01 19:54:26 user nova-compute[72504]:   <os>
Aug 01 19:54:26 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:54:26 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:54:26 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:54:26 user nova-compute[72504]:   </os>
Aug 01 19:54:26 user nova-compute[72504]:   <features>
Aug 01 19:54:26 user nova-compute[72504]:     <acpi/>
Aug 01 19:54:26 user nova-compute[72504]:     <apic/>
Aug 01 19:54:26 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:54:26 user nova-compute[72504]:   </features>
Aug 01 19:54:26 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:54:26 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:54:26 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:54:26 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:54:26 user nova-compute[72504]:   </clock>
Aug 01 19:54:26 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:54:26 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:54:26 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:54:26 user nova-compute[72504]:   </cpu>
Aug 01 19:54:26 user nova-compute[72504]:   <devices>
Aug 01 19:54:26 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:54:26 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:54:26 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk"/>
Aug 01 19:54:26 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:54:26 user nova-compute[72504]:     </disk>
Aug 01 19:54:26 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:54:26 user nova-compute[72504]:       <mac address="fa:16:3e:9d:e3:8f"/>
Aug 01 19:54:26 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:54:26 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:54:26 user nova-compute[72504]:       <target dev="tap1ae5b451-36"/>
Aug 01 19:54:26 user nova-compute[72504]:     </interface>
Aug 01 19:54:26 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:54:26 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/console.log" append="off"/>
Aug 01 19:54:26 user nova-compute[72504]:     </serial>
Aug 01 19:54:26 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:54:26 user nova-compute[72504]:     <video>
Aug 01 19:54:26 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:54:26 user nova-compute[72504]:     </video>
Aug 01 19:54:26 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:54:26 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:54:26 user nova-compute[72504]:     </rng>
Aug 01 19:54:26 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:54:26 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:54:26 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:54:26 user nova-compute[72504]:     </memballoon>
Aug 01 19:54:26 user nova-compute[72504]:   </devices>
Aug 01 19:54:26 user nova-compute[72504]: </domain>
Aug 01 19:54:26 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:54:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:54:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-368818763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-368818763',id=17,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQCD+zOzDrd1/CCpM6oSIMgSHsBflnqyFlcd8fKpthsdAbVFpTofSu3G34nwV4VW+3QK6NYd0lmqH2X7kyYik3VPR8N9fNexhWmS0Q3ij+8T7bAbFUZwST+7wOwH0oY7g==',key_name='tempest-keypair-1838146836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9540d878e5ea4bfda3d342e5a78035f5',ramdisk_id='',reservation_id='r-599zglgv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-2015428092',owner_user_name='tempest-ServerActionsV293TestJSON-2015428092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:54:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97ef13eef2a345909187312f5a62e0f6',uuid=d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ae5b451-36d3-474b-b576-26b42d8dbb6d", "address": "fa:16:3e:9d:e3:8f", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae5b451-36", "ovs_interfaceid": "1ae5b451-36d3-474b-b576-26b42d8dbb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:54:26 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Converting VIF {"id": "1ae5b451-36d3-474b-b576-26b42d8dbb6d", "address": "fa:16:3e:9d:e3:8f", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae5b451-36", "ovs_interfaceid": "1ae5b451-36d3-474b-b576-26b42d8dbb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:54:26 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:e3:8f,bridge_name='br-int',has_traffic_filtering=True,id=1ae5b451-36d3-474b-b576-26b42d8dbb6d,network=Network(d4da5ad8-9045-4076-9f31-ea9faaf8e6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ae5b451-36') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:54:26 user nova-compute[72504]: DEBUG os_vif [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:e3:8f,bridge_name='br-int',has_traffic_filtering=True,id=1ae5b451-36d3-474b-b576-26b42d8dbb6d,network=Network(d4da5ad8-9045-4076-9f31-ea9faaf8e6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ae5b451-36') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:54:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:54:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:54:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ae5b451-36, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:54:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ae5b451-36, col_values=(('external_ids', {'iface-id': '1ae5b451-36d3-474b-b576-26b42d8dbb6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:e3:8f', 'vm-uuid': 'd11f4be8-6b26-43b6-9a49-02f6f9dc6bcd'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:54:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:54:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:26 user nova-compute[72504]: INFO os_vif [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:e3:8f,bridge_name='br-int',has_traffic_filtering=True,id=1ae5b451-36d3-474b-b576-26b42d8dbb6d,network=Network(d4da5ad8-9045-4076-9f31-ea9faaf8e6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ae5b451-36')
Aug 01 19:54:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:54:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] No VIF found with MAC fa:16:3e:9d:e3:8f, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:54:26 user nova-compute[72504]: DEBUG nova.network.neutron [req-4d66d47b-3fd1-4459-a2f8-5355ac1e2067 req-819a7472-5e5b-45e9-9ac4-999f9a8fa241 service nova] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Updated VIF entry in instance network info cache for port 1ae5b451-36d3-474b-b576-26b42d8dbb6d. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:54:26 user nova-compute[72504]: DEBUG nova.network.neutron [req-4d66d47b-3fd1-4459-a2f8-5355ac1e2067 req-819a7472-5e5b-45e9-9ac4-999f9a8fa241 service nova] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Updating instance_info_cache with network_info: [{"id": "1ae5b451-36d3-474b-b576-26b42d8dbb6d", "address": "fa:16:3e:9d:e3:8f", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae5b451-36", "ovs_interfaceid": "1ae5b451-36d3-474b-b576-26b42d8dbb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:54:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4d66d47b-3fd1-4459-a2f8-5355ac1e2067 req-819a7472-5e5b-45e9-9ac4-999f9a8fa241 service nova] Releasing lock "refresh_cache-d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:54:27 user nova-compute[72504]: DEBUG nova.compute.manager [req-b80a82be-c25a-4406-bca6-7096bf01f612 req-24259f56-4590-4fd2-82fa-7d1e336fbf07 service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Received event network-vif-plugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:54:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b80a82be-c25a-4406-bca6-7096bf01f612 req-24259f56-4590-4fd2-82fa-7d1e336fbf07 service nova] Acquiring lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:54:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b80a82be-c25a-4406-bca6-7096bf01f612 req-24259f56-4590-4fd2-82fa-7d1e336fbf07 service nova] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:54:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b80a82be-c25a-4406-bca6-7096bf01f612 req-24259f56-4590-4fd2-82fa-7d1e336fbf07 service nova] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:54:27 user nova-compute[72504]: DEBUG nova.compute.manager [req-b80a82be-c25a-4406-bca6-7096bf01f612 req-24259f56-4590-4fd2-82fa-7d1e336fbf07 service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] No waiting events found dispatching network-vif-plugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:54:27 user nova-compute[72504]: WARNING nova.compute.manager [req-b80a82be-c25a-4406-bca6-7096bf01f612 req-24259f56-4590-4fd2-82fa-7d1e336fbf07 service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Received unexpected event network-vif-plugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 for instance with vm_state active and task_state rescuing.
Aug 01 19:54:27 user nova-compute[72504]: DEBUG nova.compute.manager [req-b80a82be-c25a-4406-bca6-7096bf01f612 req-24259f56-4590-4fd2-82fa-7d1e336fbf07 service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Received event network-vif-plugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:54:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b80a82be-c25a-4406-bca6-7096bf01f612 req-24259f56-4590-4fd2-82fa-7d1e336fbf07 service nova] Acquiring lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:54:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b80a82be-c25a-4406-bca6-7096bf01f612 req-24259f56-4590-4fd2-82fa-7d1e336fbf07 service nova] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:54:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b80a82be-c25a-4406-bca6-7096bf01f612 req-24259f56-4590-4fd2-82fa-7d1e336fbf07 service nova] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:54:27 user nova-compute[72504]: DEBUG nova.compute.manager [req-b80a82be-c25a-4406-bca6-7096bf01f612 req-24259f56-4590-4fd2-82fa-7d1e336fbf07 service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] No waiting events found dispatching network-vif-plugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:54:27 user nova-compute[72504]: WARNING nova.compute.manager [req-b80a82be-c25a-4406-bca6-7096bf01f612 req-24259f56-4590-4fd2-82fa-7d1e336fbf07 service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Received unexpected event network-vif-plugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 for instance with vm_state active and task_state rescuing.
Aug 01 19:54:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Removed pending event for 7391a8ce-7ce5-47ec-97f6-6159645688ea due to event {{(pid=72504) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 19:54:27 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919667.8230617, 7391a8ce-7ce5-47ec-97f6-6159645688ea => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:54:27 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] VM Resumed (Lifecycle Event)
Aug 01 19:54:27 user nova-compute[72504]: DEBUG nova.compute.manager [None req-053a5f0a-7667-41b0-b543-6e383a584033 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:54:27 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:54:27 user nova-compute[72504]: DEBUG nova.compute.manager [req-4bc9ff86-8a7d-419b-bf0f-a1c29fd0885a req-2b6025f6-555e-48d4-9da7-9060a26d71b3 service nova] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Received event network-vif-plugged-1ae5b451-36d3-474b-b576-26b42d8dbb6d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:54:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4bc9ff86-8a7d-419b-bf0f-a1c29fd0885a req-2b6025f6-555e-48d4-9da7-9060a26d71b3 service nova] Acquiring lock "d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:54:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4bc9ff86-8a7d-419b-bf0f-a1c29fd0885a req-2b6025f6-555e-48d4-9da7-9060a26d71b3 service nova] Lock "d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:54:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4bc9ff86-8a7d-419b-bf0f-a1c29fd0885a req-2b6025f6-555e-48d4-9da7-9060a26d71b3 service nova] Lock "d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:54:27 user nova-compute[72504]: DEBUG nova.compute.manager [req-4bc9ff86-8a7d-419b-bf0f-a1c29fd0885a req-2b6025f6-555e-48d4-9da7-9060a26d71b3 service nova] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] No waiting events found dispatching network-vif-plugged-1ae5b451-36d3-474b-b576-26b42d8dbb6d {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:54:27 user nova-compute[72504]: WARNING nova.compute.manager [req-4bc9ff86-8a7d-419b-bf0f-a1c29fd0885a req-2b6025f6-555e-48d4-9da7-9060a26d71b3 service nova] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Received unexpected event network-vif-plugged-1ae5b451-36d3-474b-b576-26b42d8dbb6d for instance with vm_state building and task_state spawning.
Aug 01 19:54:27 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:54:27 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 19:54:27 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919667.8243184, 7391a8ce-7ce5-47ec-97f6-6159645688ea => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:54:27 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] VM Started (Lifecycle Event)
Aug 01 19:54:28 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:54:28 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:54:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:29 user nova-compute[72504]: DEBUG nova.compute.manager [req-c7715cdc-d375-47b7-9941-b79b86c29b42 req-4b81fe13-f24a-47d1-85ac-3ef453c993d1 service nova] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Received event network-vif-plugged-1ae5b451-36d3-474b-b576-26b42d8dbb6d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:54:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c7715cdc-d375-47b7-9941-b79b86c29b42 req-4b81fe13-f24a-47d1-85ac-3ef453c993d1 service nova] Acquiring lock "d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:54:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c7715cdc-d375-47b7-9941-b79b86c29b42 req-4b81fe13-f24a-47d1-85ac-3ef453c993d1 service nova] Lock "d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:54:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c7715cdc-d375-47b7-9941-b79b86c29b42 req-4b81fe13-f24a-47d1-85ac-3ef453c993d1 service nova] Lock "d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:54:29 user nova-compute[72504]: DEBUG nova.compute.manager [req-c7715cdc-d375-47b7-9941-b79b86c29b42 req-4b81fe13-f24a-47d1-85ac-3ef453c993d1 service nova] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] No waiting events found dispatching network-vif-plugged-1ae5b451-36d3-474b-b576-26b42d8dbb6d {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:54:29 user nova-compute[72504]: WARNING nova.compute.manager [req-c7715cdc-d375-47b7-9941-b79b86c29b42 req-4b81fe13-f24a-47d1-85ac-3ef453c993d1 service nova] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Received unexpected event network-vif-plugged-1ae5b451-36d3-474b-b576-26b42d8dbb6d for instance with vm_state building and task_state spawning.
Aug 01 19:54:30 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919670.2198699, d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:54:30 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] VM Resumed (Lifecycle Event)
Aug 01 19:54:30 user nova-compute[72504]: DEBUG nova.compute.manager [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:54:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:54:30 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Instance spawned successfully.
Aug 01 19:54:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 19:54:30 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:54:30 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:54:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:54:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:54:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:54:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:54:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:54:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:54:30 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:54:30 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919670.2238781, d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:54:30 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] VM Started (Lifecycle Event)
Aug 01 19:54:30 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:54:30 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:54:30 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:54:30 user nova-compute[72504]: INFO nova.compute.manager [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Took 6.84 seconds to spawn the instance on the hypervisor.
Aug 01 19:54:30 user nova-compute[72504]: DEBUG nova.compute.manager [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:54:30 user nova-compute[72504]: INFO nova.compute.manager [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Took 7.92 seconds to build instance.
Aug 01 19:54:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2add3d63-4e26-4059-a505-e76d164c8c1a tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.170s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:54:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "1de87977-532f-45f7-856b-84df41b2a567" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:54:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "1de87977-532f-45f7-856b-84df41b2a567" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:54:36 user nova-compute[72504]: INFO nova.compute.manager [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Detaching volume 7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d
Aug 01 19:54:36 user nova-compute[72504]: INFO nova.virt.block_device [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Attempting to driver detach volume 7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d from mountpoint /dev/vdb
Aug 01 19:54:36 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Attempting to detach device vdb from instance 1de87977-532f-45f7-856b-84df41b2a567 from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 19:54:36 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:54:36 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:54:36 user nova-compute[72504]:   <source dev="/dev/sdh"/>
Aug 01 19:54:36 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:54:36 user nova-compute[72504]:   <serial>7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d</serial>
Aug 01 19:54:36 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 19:54:36 user nova-compute[72504]: </disk>
Aug 01 19:54:36 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:54:36 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Successfully detached device vdb from instance 1de87977-532f-45f7-856b-84df41b2a567 from the persistent domain config.
Aug 01 19:54:36 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1de87977-532f-45f7-856b-84df41b2a567 from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 19:54:36 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:54:36 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:54:36 user nova-compute[72504]:   <source dev="/dev/sdh"/>
Aug 01 19:54:36 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:54:36 user nova-compute[72504]:   <serial>7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d</serial>
Aug 01 19:54:36 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 19:54:36 user nova-compute[72504]: </disk>
Aug 01 19:54:36 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:54:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690919677.092359, 1de87977-532f-45f7-856b-84df41b2a567 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1de87977-532f-45f7-856b-84df41b2a567 {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 19:54:37 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Successfully detached device vdb from instance 1de87977-532f-45f7-856b-84df41b2a567 from the live domain config.
Aug 01 19:54:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNeZfGsc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:54:37 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:54:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b27b976-3d0e-4d19-bf2e-c1e9b6b2bbd3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6b22f7-a2d0-4e82-a30a-cd578d4ee40b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:54:37 user nova-compute[72504]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 (non-flash)
Aug 01 19:54:37 user nova-compute[72504]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)
Aug 01 19:54:37 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:54:37 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:54:37 user nova-compute[72504]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 (non-flash)
Aug 01 19:54:37 user nova-compute[72504]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)
Aug 01 19:54:37 user nova-compute[72504]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d (non-flash)
Aug 01 19:54:37 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff4143792d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d'): ({'sdh'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Removing single pathed devices sdh {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce96308-a019-4a81-a216-828e5cec069d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75fa3c1-68e8-4c2a-a55e-45803111749e]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Flushing IO for device /dev/sdh {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbae417-388d-4bca-9581-d8990226d369]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.083s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6631d7-7e95-43e7-8694-d7077a061a1d]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] SCSI volumes sdh have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.082s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3ea2e1-0476-4a77-87d1-ca6be16a14d8]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2b669e-315d-4a63-8c8a-e0e2f23ad478]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d, portal: 172.16.0.220,3260]
Aug 01 19:54:37 user nova-compute[72504]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d, portal: 172.16.0.220,3260] successful.
Aug 01 19:54:37 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f0ddc68-40fa-43f1-aae6-efcdb4ad3f0d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4be61e-6a06-47de-8bec-378afe7b3663]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.470s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] <== disconnect_volume: return (472ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:54:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:54:38 user nova-compute[72504]: DEBUG nova.objects.instance [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lazy-loading 'flavor' on Instance uuid 1de87977-532f-45f7-856b-84df41b2a567 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:54:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-dbedd7b0-30e5-4bed-b8b6-41b44f7d82f1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "1de87977-532f-45f7-856b-84df41b2a567" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.992s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:54:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:51 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b74e3be4-f7c2-4780-9252-6b67d9b5f9c6 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Acquiring lock "ab6496ff-6f53-4617-9f99-e932d7267fda" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:54:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b74e3be4-f7c2-4780-9252-6b67d9b5f9c6 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "ab6496ff-6f53-4617-9f99-e932d7267fda" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:54:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b74e3be4-f7c2-4780-9252-6b67d9b5f9c6 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Acquiring lock "ab6496ff-6f53-4617-9f99-e932d7267fda-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:54:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b74e3be4-f7c2-4780-9252-6b67d9b5f9c6 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "ab6496ff-6f53-4617-9f99-e932d7267fda-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:54:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b74e3be4-f7c2-4780-9252-6b67d9b5f9c6 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "ab6496ff-6f53-4617-9f99-e932d7267fda-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:54:58 user nova-compute[72504]: INFO nova.compute.manager [None req-b74e3be4-f7c2-4780-9252-6b67d9b5f9c6 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Terminating instance
Aug 01 19:54:58 user nova-compute[72504]: DEBUG nova.compute.manager [None req-b74e3be4-f7c2-4780-9252-6b67d9b5f9c6 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 19:54:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:59 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Instance destroyed successfully.
Aug 01 19:54:59 user nova-compute[72504]: DEBUG nova.objects.instance [None req-b74e3be4-f7c2-4780-9252-6b67d9b5f9c6 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lazy-loading 'resources' on Instance uuid ab6496ff-6f53-4617-9f99-e932d7267fda {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:54:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-b74e3be4-f7c2-4780-9252-6b67d9b5f9c6 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1384458212',display_name='tempest-VolumesAdminNegativeTest-server-1384458212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1384458212',id=13,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:53:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4bd6112c6db747f297455ca969783d11',ramdisk_id='',reservation_id='r-u57087pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1986244634',owner_user_name='tempest-VolumesAdminNegativeTest-1986244634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:53:07Z,user_data=None,user_id='d0602032d5a34a83a13a4888436b689e',uuid=ab6496ff-6f53-4617-9f99-e932d7267fda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "035a0311-c451-45b2-9959-772d998e248d", "address": "fa:16:3e:28:58:89", "network": {"id": "b2c62156-50c6-4f54-b857-961843d14579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-554746486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd6112c6db747f297455ca969783d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035a0311-c4", "ovs_interfaceid": "035a0311-c451-45b2-9959-772d998e248d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:54:59 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-b74e3be4-f7c2-4780-9252-6b67d9b5f9c6 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Converting VIF {"id": "035a0311-c451-45b2-9959-772d998e248d", "address": "fa:16:3e:28:58:89", "network": {"id": "b2c62156-50c6-4f54-b857-961843d14579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-554746486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd6112c6db747f297455ca969783d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035a0311-c4", "ovs_interfaceid": "035a0311-c451-45b2-9959-772d998e248d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:54:59 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-b74e3be4-f7c2-4780-9252-6b67d9b5f9c6 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:58:89,bridge_name='br-int',has_traffic_filtering=True,id=035a0311-c451-45b2-9959-772d998e248d,network=Network(b2c62156-50c6-4f54-b857-961843d14579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035a0311-c4') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:54:59 user nova-compute[72504]: DEBUG os_vif [None req-b74e3be4-f7c2-4780-9252-6b67d9b5f9c6 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:58:89,bridge_name='br-int',has_traffic_filtering=True,id=035a0311-c451-45b2-9959-772d998e248d,network=Network(b2c62156-50c6-4f54-b857-961843d14579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035a0311-c4') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:54:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap035a0311-c4, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:54:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:54:59 user nova-compute[72504]: INFO os_vif [None req-b74e3be4-f7c2-4780-9252-6b67d9b5f9c6 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:58:89,bridge_name='br-int',has_traffic_filtering=True,id=035a0311-c451-45b2-9959-772d998e248d,network=Network(b2c62156-50c6-4f54-b857-961843d14579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035a0311-c4')
Aug 01 19:54:59 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-b74e3be4-f7c2-4780-9252-6b67d9b5f9c6 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Deleting instance files /opt/stack/data/nova/instances/ab6496ff-6f53-4617-9f99-e932d7267fda_del
Aug 01 19:54:59 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-b74e3be4-f7c2-4780-9252-6b67d9b5f9c6 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Deletion of /opt/stack/data/nova/instances/ab6496ff-6f53-4617-9f99-e932d7267fda_del complete
Aug 01 19:54:59 user nova-compute[72504]: DEBUG nova.compute.manager [req-56e829f1-744b-4565-8019-94c1f601bd68 req-3c1b3c84-3cb1-492d-8df4-f61f9bc76afd service nova] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Received event network-vif-unplugged-035a0311-c451-45b2-9959-772d998e248d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:54:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-56e829f1-744b-4565-8019-94c1f601bd68 req-3c1b3c84-3cb1-492d-8df4-f61f9bc76afd service nova] Acquiring lock "ab6496ff-6f53-4617-9f99-e932d7267fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:54:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-56e829f1-744b-4565-8019-94c1f601bd68 req-3c1b3c84-3cb1-492d-8df4-f61f9bc76afd service nova] Lock "ab6496ff-6f53-4617-9f99-e932d7267fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:54:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-56e829f1-744b-4565-8019-94c1f601bd68 req-3c1b3c84-3cb1-492d-8df4-f61f9bc76afd service nova] Lock "ab6496ff-6f53-4617-9f99-e932d7267fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:54:59 user nova-compute[72504]: DEBUG nova.compute.manager [req-56e829f1-744b-4565-8019-94c1f601bd68 req-3c1b3c84-3cb1-492d-8df4-f61f9bc76afd service nova] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] No waiting events found dispatching network-vif-unplugged-035a0311-c451-45b2-9959-772d998e248d {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:54:59 user nova-compute[72504]: DEBUG nova.compute.manager [req-56e829f1-744b-4565-8019-94c1f601bd68 req-3c1b3c84-3cb1-492d-8df4-f61f9bc76afd service nova] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Received event network-vif-unplugged-035a0311-c451-45b2-9959-772d998e248d for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:54:59 user nova-compute[72504]: INFO nova.compute.manager [None req-b74e3be4-f7c2-4780-9252-6b67d9b5f9c6 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Took 0.76 seconds to destroy the instance on the hypervisor.
Aug 01 19:54:59 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-b74e3be4-f7c2-4780-9252-6b67d9b5f9c6 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 19:54:59 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 19:54:59 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 19:54:59 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:54:59 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Took 0.54 seconds to deallocate network for instance.
Aug 01 19:54:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b74e3be4-f7c2-4780-9252-6b67d9b5f9c6 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:54:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b74e3be4-f7c2-4780-9252-6b67d9b5f9c6 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:00 user nova-compute[72504]: DEBUG nova.compute.manager [req-f0b4ea70-d17d-4ca0-aa9a-9b0778335936 req-8a5828dc-791e-4cd9-8728-360e25cbaf02 service nova] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Received event network-vif-deleted-035a0311-c451-45b2-9959-772d998e248d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:55:00 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-b74e3be4-f7c2-4780-9252-6b67d9b5f9c6 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:55:00 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-b74e3be4-f7c2-4780-9252-6b67d9b5f9c6 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:55:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b74e3be4-f7c2-4780-9252-6b67d9b5f9c6 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:00 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-b74e3be4-f7c2-4780-9252-6b67d9b5f9c6 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Deleted allocations for instance ab6496ff-6f53-4617-9f99-e932d7267fda
Aug 01 19:55:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b74e3be4-f7c2-4780-9252-6b67d9b5f9c6 tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "ab6496ff-6f53-4617-9f99-e932d7267fda" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.904s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:01 user nova-compute[72504]: DEBUG nova.compute.manager [req-0b062e9a-b080-4e37-b868-ac8ad45a3635 req-d341c520-34cb-44b4-b803-027d8ed6fe34 service nova] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Received event network-vif-plugged-035a0311-c451-45b2-9959-772d998e248d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:55:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0b062e9a-b080-4e37-b868-ac8ad45a3635 req-d341c520-34cb-44b4-b803-027d8ed6fe34 service nova] Acquiring lock "ab6496ff-6f53-4617-9f99-e932d7267fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0b062e9a-b080-4e37-b868-ac8ad45a3635 req-d341c520-34cb-44b4-b803-027d8ed6fe34 service nova] Lock "ab6496ff-6f53-4617-9f99-e932d7267fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0b062e9a-b080-4e37-b868-ac8ad45a3635 req-d341c520-34cb-44b4-b803-027d8ed6fe34 service nova] Lock "ab6496ff-6f53-4617-9f99-e932d7267fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:01 user nova-compute[72504]: DEBUG nova.compute.manager [req-0b062e9a-b080-4e37-b868-ac8ad45a3635 req-d341c520-34cb-44b4-b803-027d8ed6fe34 service nova] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] No waiting events found dispatching network-vif-plugged-035a0311-c451-45b2-9959-772d998e248d {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:55:01 user nova-compute[72504]: WARNING nova.compute.manager [req-0b062e9a-b080-4e37-b868-ac8ad45a3635 req-d341c520-34cb-44b4-b803-027d8ed6fe34 service nova] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Received unexpected event network-vif-plugged-035a0311-c451-45b2-9959-772d998e248d for instance with vm_state deleted and task_state None.
Aug 01 19:55:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "88f95d20-e391-4100-93b2-da29bfcf9704" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "88f95d20-e391-4100-93b2-da29bfcf9704" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:09 user nova-compute[72504]: DEBUG nova.compute.manager [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 19:55:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:09 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:55:09 user nova-compute[72504]: INFO nova.compute.claims [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Claim successful on node user
Aug 01 19:55:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:09 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:55:09 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:55:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:09 user nova-compute[72504]: DEBUG nova.compute.manager [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 19:55:09 user nova-compute[72504]: DEBUG nova.compute.manager [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 19:55:09 user nova-compute[72504]: DEBUG nova.network.neutron [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 19:55:09 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 19:55:09 user nova-compute[72504]: DEBUG nova.compute.manager [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 19:55:09 user nova-compute[72504]: DEBUG nova.policy [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd76765d1d24342f99ce0d65f416d382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816239d15d3341cdaa785fc36c8e7cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 19:55:09 user nova-compute[72504]: DEBUG nova.compute.manager [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 19:55:09 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:55:09 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Creating image(s)
Aug 01 19:55:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "/opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "/opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "/opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:09 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:09 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:55:09 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Cleaning up deleted instances {{(pid=72504) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 19:55:09 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] There are 0 instances to clean {{(pid=72504) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 19:55:09 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.138s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:09 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.144s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk 1073741824" returned: 0 in 0.052s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.134s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:10 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Checking if we can resize image /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 19:55:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:10 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Cannot resize image /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 19:55:10 user nova-compute[72504]: DEBUG nova.objects.instance [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lazy-loading 'migration_context' on Instance uuid 88f95d20-e391-4100-93b2-da29bfcf9704 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:55:10 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 19:55:10 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Ensure instance console log exists: /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:55:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:10 user nova-compute[72504]: DEBUG nova.network.neutron [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Successfully created port: 3a4ace30-3ca6-4cc9-8125-599cc4097662 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:55:11 user nova-compute[72504]: INFO nova.compute.manager [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Rescuing
Aug 01 19:55:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "refresh_cache-128c2981-363c-4ae9-b46d-15b5e5d9cac6" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:55:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquired lock "refresh_cache-128c2981-363c-4ae9-b46d-15b5e5d9cac6" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:55:11 user nova-compute[72504]: DEBUG nova.network.neutron [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:55:11 user nova-compute[72504]: DEBUG nova.network.neutron [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Successfully updated port: 3a4ace30-3ca6-4cc9-8125-599cc4097662 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:55:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "refresh_cache-88f95d20-e391-4100-93b2-da29bfcf9704" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:55:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquired lock "refresh_cache-88f95d20-e391-4100-93b2-da29bfcf9704" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:55:11 user nova-compute[72504]: DEBUG nova.network.neutron [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:55:11 user nova-compute[72504]: DEBUG nova.compute.manager [req-f5b99fe7-9189-4422-973f-99708fcf8a95 req-0cc1cc42-932a-4d53-95a9-80a9ff9fa171 service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Received event network-changed-3a4ace30-3ca6-4cc9-8125-599cc4097662 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:55:11 user nova-compute[72504]: DEBUG nova.compute.manager [req-f5b99fe7-9189-4422-973f-99708fcf8a95 req-0cc1cc42-932a-4d53-95a9-80a9ff9fa171 service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Refreshing instance network info cache due to event network-changed-3a4ace30-3ca6-4cc9-8125-599cc4097662. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:55:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f5b99fe7-9189-4422-973f-99708fcf8a95 req-0cc1cc42-932a-4d53-95a9-80a9ff9fa171 service nova] Acquiring lock "refresh_cache-88f95d20-e391-4100-93b2-da29bfcf9704" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:55:11 user nova-compute[72504]: DEBUG nova.network.neutron [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.network.neutron [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Updating instance_info_cache with network_info: [{"id": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "address": "fa:16:3e:c3:aa:1c", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a4ace30-3c", "ovs_interfaceid": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Releasing lock "refresh_cache-88f95d20-e391-4100-93b2-da29bfcf9704" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.compute.manager [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Instance network_info: |[{"id": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "address": "fa:16:3e:c3:aa:1c", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a4ace30-3c", "ovs_interfaceid": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f5b99fe7-9189-4422-973f-99708fcf8a95 req-0cc1cc42-932a-4d53-95a9-80a9ff9fa171 service nova] Acquired lock "refresh_cache-88f95d20-e391-4100-93b2-da29bfcf9704" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.network.neutron [req-f5b99fe7-9189-4422-973f-99708fcf8a95 req-0cc1cc42-932a-4d53-95a9-80a9ff9fa171 service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Refreshing network info cache for port 3a4ace30-3ca6-4cc9-8125-599cc4097662 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Start _get_guest_xml network_info=[{"id": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "address": "fa:16:3e:c3:aa:1c", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a4ace30-3c", "ovs_interfaceid": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:55:12 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:55:12 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1800688900',display_name='tempest-ServerActionsTestOtherA-server-1800688900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1800688900',id=18,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLbPu5MF6DPaLmysryryb5dEvmDVe/ZpzyX1JNIgtOIXBuGnF7k0B3yFjfDeyUfOXvFKWH1T1tnnmguBKUJb6gDrcdFY/x4LtLMGVeolXUhKxLNh5O13uubFnujvAs7Sg==',key_name='tempest-keypair-2041585985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='816239d15d3341cdaa785fc36c8e7cdb',ramdisk_id='',reservation_id='r-5qhy089r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1009670506',owner_user_name='tempest-ServerActionsTestOtherA-1009670506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:55:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d76765d1d24342f99ce0d65f416d382b',uuid=88f95d20-e391-4100-93b2-da29bfcf9704,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "address": "fa:16:3e:c3:aa:1c", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a4ace30-3c", "ovs_interfaceid": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Converting VIF {"id": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "address": "fa:16:3e:c3:aa:1c", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a4ace30-3c", "ovs_interfaceid": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:aa:1c,bridge_name='br-int',has_traffic_filtering=True,id=3a4ace30-3ca6-4cc9-8125-599cc4097662,network=Network(92749f96-d369-4df5-85ce-252c277e7ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a4ace30-3c') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.objects.instance [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lazy-loading 'pci_devices' on Instance uuid 88f95d20-e391-4100-93b2-da29bfcf9704 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:55:12 user nova-compute[72504]:   <uuid>88f95d20-e391-4100-93b2-da29bfcf9704</uuid>
Aug 01 19:55:12 user nova-compute[72504]:   <name>instance-00000012</name>
Aug 01 19:55:12 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:55:12 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:55:12 user nova-compute[72504]:   <metadata>
Aug 01 19:55:12 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:55:12 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:55:12 user nova-compute[72504]:       <nova:name>tempest-ServerActionsTestOtherA-server-1800688900</nova:name>
Aug 01 19:55:12 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:55:12</nova:creationTime>
Aug 01 19:55:12 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:55:12 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:55:12 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:55:12 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:55:12 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:55:12 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:55:12 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:55:12 user nova-compute[72504]:       <nova:owner>
Aug 01 19:55:12 user nova-compute[72504]:         <nova:user uuid="d76765d1d24342f99ce0d65f416d382b">tempest-ServerActionsTestOtherA-1009670506-project-member</nova:user>
Aug 01 19:55:12 user nova-compute[72504]:         <nova:project uuid="816239d15d3341cdaa785fc36c8e7cdb">tempest-ServerActionsTestOtherA-1009670506</nova:project>
Aug 01 19:55:12 user nova-compute[72504]:       </nova:owner>
Aug 01 19:55:12 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:55:12 user nova-compute[72504]:       <nova:ports>
Aug 01 19:55:12 user nova-compute[72504]:         <nova:port uuid="3a4ace30-3ca6-4cc9-8125-599cc4097662">
Aug 01 19:55:12 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 19:55:12 user nova-compute[72504]:         </nova:port>
Aug 01 19:55:12 user nova-compute[72504]:       </nova:ports>
Aug 01 19:55:12 user nova-compute[72504]:     </nova:instance>
Aug 01 19:55:12 user nova-compute[72504]:   </metadata>
Aug 01 19:55:12 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:55:12 user nova-compute[72504]:     <system>
Aug 01 19:55:12 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:55:12 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:55:12 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:55:12 user nova-compute[72504]:       <entry name="serial">88f95d20-e391-4100-93b2-da29bfcf9704</entry>
Aug 01 19:55:12 user nova-compute[72504]:       <entry name="uuid">88f95d20-e391-4100-93b2-da29bfcf9704</entry>
Aug 01 19:55:12 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:55:12 user nova-compute[72504]:     </system>
Aug 01 19:55:12 user nova-compute[72504]:   </sysinfo>
Aug 01 19:55:12 user nova-compute[72504]:   <os>
Aug 01 19:55:12 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:55:12 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:55:12 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:55:12 user nova-compute[72504]:   </os>
Aug 01 19:55:12 user nova-compute[72504]:   <features>
Aug 01 19:55:12 user nova-compute[72504]:     <acpi/>
Aug 01 19:55:12 user nova-compute[72504]:     <apic/>
Aug 01 19:55:12 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:55:12 user nova-compute[72504]:   </features>
Aug 01 19:55:12 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:55:12 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:55:12 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:55:12 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:55:12 user nova-compute[72504]:   </clock>
Aug 01 19:55:12 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:55:12 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:55:12 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:55:12 user nova-compute[72504]:   </cpu>
Aug 01 19:55:12 user nova-compute[72504]:   <devices>
Aug 01 19:55:12 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:55:12 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:55:12 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk"/>
Aug 01 19:55:12 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:55:12 user nova-compute[72504]:     </disk>
Aug 01 19:55:12 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:55:12 user nova-compute[72504]:       <mac address="fa:16:3e:c3:aa:1c"/>
Aug 01 19:55:12 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:55:12 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:55:12 user nova-compute[72504]:       <target dev="tap3a4ace30-3c"/>
Aug 01 19:55:12 user nova-compute[72504]:     </interface>
Aug 01 19:55:12 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:55:12 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/console.log" append="off"/>
Aug 01 19:55:12 user nova-compute[72504]:     </serial>
Aug 01 19:55:12 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:55:12 user nova-compute[72504]:     <video>
Aug 01 19:55:12 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:55:12 user nova-compute[72504]:     </video>
Aug 01 19:55:12 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:55:12 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:55:12 user nova-compute[72504]:     </rng>
Aug 01 19:55:12 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:55:12 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:55:12 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:55:12 user nova-compute[72504]:     </memballoon>
Aug 01 19:55:12 user nova-compute[72504]:   </devices>
Aug 01 19:55:12 user nova-compute[72504]: </domain>
Aug 01 19:55:12 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1800688900',display_name='tempest-ServerActionsTestOtherA-server-1800688900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1800688900',id=18,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLbPu5MF6DPaLmysryryb5dEvmDVe/ZpzyX1JNIgtOIXBuGnF7k0B3yFjfDeyUfOXvFKWH1T1tnnmguBKUJb6gDrcdFY/x4LtLMGVeolXUhKxLNh5O13uubFnujvAs7Sg==',key_name='tempest-keypair-2041585985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='816239d15d3341cdaa785fc36c8e7cdb',ramdisk_id='',reservation_id='r-5qhy089r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1009670506',owner_user_name='tempest-ServerActionsTestOtherA-1009670506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:55:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d76765d1d24342f99ce0d65f416d382b',uuid=88f95d20-e391-4100-93b2-da29bfcf9704,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "address": "fa:16:3e:c3:aa:1c", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a4ace30-3c", "ovs_interfaceid": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Converting VIF {"id": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "address": "fa:16:3e:c3:aa:1c", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a4ace30-3c", "ovs_interfaceid": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:aa:1c,bridge_name='br-int',has_traffic_filtering=True,id=3a4ace30-3ca6-4cc9-8125-599cc4097662,network=Network(92749f96-d369-4df5-85ce-252c277e7ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a4ace30-3c') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG os_vif [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:aa:1c,bridge_name='br-int',has_traffic_filtering=True,id=3a4ace30-3ca6-4cc9-8125-599cc4097662,network=Network(92749f96-d369-4df5-85ce-252c277e7ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a4ace30-3c') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.network.neutron [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Updating instance_info_cache with network_info: [{"id": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "address": "fa:16:3e:c0:3a:dc", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88a4a208-71", "ovs_interfaceid": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a4ace30-3c, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a4ace30-3c, col_values=(('external_ids', {'iface-id': '3a4ace30-3ca6-4cc9-8125-599cc4097662', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:aa:1c', 'vm-uuid': '88f95d20-e391-4100-93b2-da29bfcf9704'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Releasing lock "refresh_cache-128c2981-363c-4ae9-b46d-15b5e5d9cac6" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:12 user nova-compute[72504]: INFO os_vif [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:aa:1c,bridge_name='br-int',has_traffic_filtering=True,id=3a4ace30-3ca6-4cc9-8125-599cc4097662,network=Network(92749f96-d369-4df5-85ce-252c277e7ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a4ace30-3c')
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] No VIF found with MAC fa:16:3e:c3:aa:1c, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.network.neutron [req-f5b99fe7-9189-4422-973f-99708fcf8a95 req-0cc1cc42-932a-4d53-95a9-80a9ff9fa171 service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Updated VIF entry in instance network info cache for port 3a4ace30-3ca6-4cc9-8125-599cc4097662. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.network.neutron [req-f5b99fe7-9189-4422-973f-99708fcf8a95 req-0cc1cc42-932a-4d53-95a9-80a9ff9fa171 service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Updating instance_info_cache with network_info: [{"id": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "address": "fa:16:3e:c3:aa:1c", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a4ace30-3c", "ovs_interfaceid": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f5b99fe7-9189-4422-973f-99708fcf8a95 req-0cc1cc42-932a-4d53-95a9-80a9ff9fa171 service nova] Releasing lock "refresh_cache-88f95d20-e391-4100-93b2-da29bfcf9704" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.compute.manager [req-d5695f5f-8225-4a9b-b9cc-cac20795084f req-d4e11a24-8d33-4003-a539-12c5ae4de4c9 service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Received event network-vif-unplugged-88a4a208-7192-4e81-b9b2-1e07e7e307d1 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d5695f5f-8225-4a9b-b9cc-cac20795084f req-d4e11a24-8d33-4003-a539-12c5ae4de4c9 service nova] Acquiring lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d5695f5f-8225-4a9b-b9cc-cac20795084f req-d4e11a24-8d33-4003-a539-12c5ae4de4c9 service nova] Lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d5695f5f-8225-4a9b-b9cc-cac20795084f req-d4e11a24-8d33-4003-a539-12c5ae4de4c9 service nova] Lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG nova.compute.manager [req-d5695f5f-8225-4a9b-b9cc-cac20795084f req-d4e11a24-8d33-4003-a539-12c5ae4de4c9 service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] No waiting events found dispatching network-vif-unplugged-88a4a208-7192-4e81-b9b2-1e07e7e307d1 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:55:12 user nova-compute[72504]: WARNING nova.compute.manager [req-d5695f5f-8225-4a9b-b9cc-cac20795084f req-d4e11a24-8d33-4003-a539-12c5ae4de4c9 service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Received unexpected event network-vif-unplugged-88a4a208-7192-4e81-b9b2-1e07e7e307d1 for instance with vm_state active and task_state rescuing.
Aug 01 19:55:12 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:13 user nova-compute[72504]: INFO nova.compute.manager [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Detaching volume 0d7d6bd1-a0f4-42f6-9e43-b73af451d960
Aug 01 19:55:13 user nova-compute[72504]: INFO nova.virt.block_device [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Attempting to driver detach volume 0d7d6bd1-a0f4-42f6-9e43-b73af451d960 from mountpoint /dev/vdc
Aug 01 19:55:13 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Instance destroyed successfully.
Aug 01 19:55:13 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Attempting rescue
Aug 01 19:55:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72504) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 19:55:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Attempting to detach device vdc from instance 76aa3861-0ca1-4e7f-9a15-9219037bc1ee from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 19:55:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:55:13 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:55:13 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 19:55:13 user nova-compute[72504]:   <target dev="vdc" bus="virtio"/>
Aug 01 19:55:13 user nova-compute[72504]:   <serial>0d7d6bd1-a0f4-42f6-9e43-b73af451d960</serial>
Aug 01 19:55:13 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 19:55:13 user nova-compute[72504]: </disk>
Aug 01 19:55:13 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:55:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Instance directory exists: not creating {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 19:55:13 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Creating image(s)
Aug 01 19:55:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "/opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "/opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "/opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:13 user nova-compute[72504]: DEBUG nova.objects.instance [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'trusted_certs' on Instance uuid 128c2981-363c-4ae9-b46d-15b5e5d9cac6 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:55:13 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Successfully detached device vdc from instance 76aa3861-0ca1-4e7f-9a15-9219037bc1ee from the persistent domain config.
Aug 01 19:55:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 76aa3861-0ca1-4e7f-9a15-9219037bc1ee from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 19:55:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:55:13 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:55:13 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 19:55:13 user nova-compute[72504]:   <target dev="vdc" bus="virtio"/>
Aug 01 19:55:13 user nova-compute[72504]:   <serial>0d7d6bd1-a0f4-42f6-9e43-b73af451d960</serial>
Aug 01 19:55:13 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 19:55:13 user nova-compute[72504]: </disk>
Aug 01 19:55:13 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:55:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:13 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:55:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue" returned: 0 in 0.049s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:13 user nova-compute[72504]: DEBUG nova.objects.instance [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'migration_context' on Instance uuid 128c2981-363c-4ae9-b46d-15b5e5d9cac6 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Start _get_guest_xml network_info=[{"id": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "address": "fa:16:3e:c0:3a:dc", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "vif_mac": "fa:16:3e:c0:3a:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88a4a208-71", "ovs_interfaceid": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.objects.instance [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'resources' on Instance uuid 128c2981-363c-4ae9-b46d-15b5e5d9cac6 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.objects.instance [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'numa_topology' on Instance uuid 128c2981-363c-4ae9-b46d-15b5e5d9cac6 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:55:14 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:55:14 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.objects.instance [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'vcpu_model' on Instance uuid 128c2981-363c-4ae9-b46d-15b5e5d9cac6 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:53:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2007920168',display_name='tempest-ServerRescueNegativeTestJSON-server-2007920168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2007920168',id=15,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:53:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='274aed6773224c4fb534aac970d6bb34',ramdisk_id='',reservation_id='r-dg8uckty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-897201375',owner_user_name='tempest-ServerRescueNegativeTestJSON-897201375-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:53:31Z,user_data=None,user_id='be219e31095441269a1f140a77ad0d57',uuid=128c2981-363c-4ae9-b46d-15b5e5d9cac6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "address": "fa:16:3e:c0:3a:dc", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "vif_mac": "fa:16:3e:c0:3a:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88a4a208-71", "ovs_interfaceid": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Converting VIF {"id": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "address": "fa:16:3e:c0:3a:dc", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "vif_mac": "fa:16:3e:c0:3a:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88a4a208-71", "ovs_interfaceid": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:3a:dc,bridge_name='br-int',has_traffic_filtering=True,id=88a4a208-7192-4e81-b9b2-1e07e7e307d1,network=Network(9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88a4a208-71') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.objects.instance [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'pci_devices' on Instance uuid 128c2981-363c-4ae9-b46d-15b5e5d9cac6 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:55:14 user nova-compute[72504]:   <uuid>128c2981-363c-4ae9-b46d-15b5e5d9cac6</uuid>
Aug 01 19:55:14 user nova-compute[72504]:   <name>instance-0000000f</name>
Aug 01 19:55:14 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:55:14 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:55:14 user nova-compute[72504]:   <metadata>
Aug 01 19:55:14 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:55:14 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:55:14 user nova-compute[72504]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2007920168</nova:name>
Aug 01 19:55:14 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:55:14</nova:creationTime>
Aug 01 19:55:14 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:55:14 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:55:14 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:55:14 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:55:14 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:55:14 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:55:14 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:55:14 user nova-compute[72504]:       <nova:owner>
Aug 01 19:55:14 user nova-compute[72504]:         <nova:user uuid="be219e31095441269a1f140a77ad0d57">tempest-ServerRescueNegativeTestJSON-897201375-project-member</nova:user>
Aug 01 19:55:14 user nova-compute[72504]:         <nova:project uuid="274aed6773224c4fb534aac970d6bb34">tempest-ServerRescueNegativeTestJSON-897201375</nova:project>
Aug 01 19:55:14 user nova-compute[72504]:       </nova:owner>
Aug 01 19:55:14 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:55:14 user nova-compute[72504]:       <nova:ports>
Aug 01 19:55:14 user nova-compute[72504]:         <nova:port uuid="88a4a208-7192-4e81-b9b2-1e07e7e307d1">
Aug 01 19:55:14 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 19:55:14 user nova-compute[72504]:         </nova:port>
Aug 01 19:55:14 user nova-compute[72504]:       </nova:ports>
Aug 01 19:55:14 user nova-compute[72504]:     </nova:instance>
Aug 01 19:55:14 user nova-compute[72504]:   </metadata>
Aug 01 19:55:14 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:55:14 user nova-compute[72504]:     <system>
Aug 01 19:55:14 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:55:14 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:55:14 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:55:14 user nova-compute[72504]:       <entry name="serial">128c2981-363c-4ae9-b46d-15b5e5d9cac6</entry>
Aug 01 19:55:14 user nova-compute[72504]:       <entry name="uuid">128c2981-363c-4ae9-b46d-15b5e5d9cac6</entry>
Aug 01 19:55:14 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:55:14 user nova-compute[72504]:     </system>
Aug 01 19:55:14 user nova-compute[72504]:   </sysinfo>
Aug 01 19:55:14 user nova-compute[72504]:   <os>
Aug 01 19:55:14 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:55:14 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:55:14 user nova-compute[72504]:   </os>
Aug 01 19:55:14 user nova-compute[72504]:   <features>
Aug 01 19:55:14 user nova-compute[72504]:     <acpi/>
Aug 01 19:55:14 user nova-compute[72504]:     <apic/>
Aug 01 19:55:14 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:55:14 user nova-compute[72504]:   </features>
Aug 01 19:55:14 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:55:14 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:55:14 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:55:14 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:55:14 user nova-compute[72504]:   </clock>
Aug 01 19:55:14 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:55:14 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:55:14 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:55:14 user nova-compute[72504]:   </cpu>
Aug 01 19:55:14 user nova-compute[72504]:   <devices>
Aug 01 19:55:14 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:55:14 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:55:14 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue"/>
Aug 01 19:55:14 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:55:14 user nova-compute[72504]:     </disk>
Aug 01 19:55:14 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:55:14 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:55:14 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk"/>
Aug 01 19:55:14 user nova-compute[72504]:       <target dev="vdb" bus="virtio"/>
Aug 01 19:55:14 user nova-compute[72504]:     </disk>
Aug 01 19:55:14 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:55:14 user nova-compute[72504]:       <mac address="fa:16:3e:c0:3a:dc"/>
Aug 01 19:55:14 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:55:14 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:55:14 user nova-compute[72504]:       <target dev="tap88a4a208-71"/>
Aug 01 19:55:14 user nova-compute[72504]:     </interface>
Aug 01 19:55:14 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:55:14 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/console.log" append="off"/>
Aug 01 19:55:14 user nova-compute[72504]:     </serial>
Aug 01 19:55:14 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:55:14 user nova-compute[72504]:     <video>
Aug 01 19:55:14 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:55:14 user nova-compute[72504]:     </video>
Aug 01 19:55:14 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:55:14 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:55:14 user nova-compute[72504]:     </rng>
Aug 01 19:55:14 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:55:14 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:55:14 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:55:14 user nova-compute[72504]:     </memballoon>
Aug 01 19:55:14 user nova-compute[72504]:   </devices>
Aug 01 19:55:14 user nova-compute[72504]: </domain>
Aug 01 19:55:14 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:55:14 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Instance destroyed successfully.
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690919699.2398431, ab6496ff-6f53-4617-9f99-e932d7267fda => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:55:14 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] VM Stopped (Lifecycle Event)
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] No VIF found with MAC fa:16:3e:c0:3a:dc, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.compute.manager [None req-027240ac-776c-4323-ab0f-917e665a00b3 None None] [instance: ab6496ff-6f53-4617-9f99-e932d7267fda] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.compute.manager [req-8ecc0371-1aed-4555-9b5e-eb064369dcd4 req-911aec5e-ad17-406e-a54b-ae98f6d3492d service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Received event network-vif-plugged-3a4ace30-3ca6-4cc9-8125-599cc4097662 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-8ecc0371-1aed-4555-9b5e-eb064369dcd4 req-911aec5e-ad17-406e-a54b-ae98f6d3492d service nova] Acquiring lock "88f95d20-e391-4100-93b2-da29bfcf9704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-8ecc0371-1aed-4555-9b5e-eb064369dcd4 req-911aec5e-ad17-406e-a54b-ae98f6d3492d service nova] Lock "88f95d20-e391-4100-93b2-da29bfcf9704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-8ecc0371-1aed-4555-9b5e-eb064369dcd4 req-911aec5e-ad17-406e-a54b-ae98f6d3492d service nova] Lock "88f95d20-e391-4100-93b2-da29bfcf9704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.compute.manager [req-8ecc0371-1aed-4555-9b5e-eb064369dcd4 req-911aec5e-ad17-406e-a54b-ae98f6d3492d service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] No waiting events found dispatching network-vif-plugged-3a4ace30-3ca6-4cc9-8125-599cc4097662 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:55:14 user nova-compute[72504]: WARNING nova.compute.manager [req-8ecc0371-1aed-4555-9b5e-eb064369dcd4 req-911aec5e-ad17-406e-a54b-ae98f6d3492d service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Received unexpected event network-vif-plugged-3a4ace30-3ca6-4cc9-8125-599cc4097662 for instance with vm_state building and task_state spawning.
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690919714.3690088, 76aa3861-0ca1-4e7f-9a15-9219037bc1ee => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 76aa3861-0ca1-4e7f-9a15-9219037bc1ee {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 19:55:14 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Successfully detached device vdc from instance 76aa3861-0ca1-4e7f-9a15-9219037bc1ee from the live domain config.
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lHRQqzGf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:55:14 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:55:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0dc2ce-ed58-4b83-869b-ef0073988fbb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4720293e-1c7a-4a6e-93d6-ab341e90f35c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:55:14 user nova-compute[72504]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 (non-flash)
Aug 01 19:55:14 user nova-compute[72504]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)
Aug 01 19:55:14 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:55:14 user nova-compute[72504]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 (non-flash)
Aug 01 19:55:14 user nova-compute[72504]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)
Aug 01 19:55:14 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff4141c3370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960'): ({'sdc'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Removing single pathed devices sdc {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41fd33e-9596-4873-8974-dc658e3b763c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[502d1da6-c46d-4a2d-bd93-a73170314748]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Flushing IO for device /dev/sdc {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[84895b42-dd5a-47c4-ac87-d820a9004f21]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7988910-5a24-4660-bb9a-b7e8ad716bd0]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e84438-be32-4428-a657-b00ea0d0de72]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[70237549-52af-4887-83ac-06cb412e8ce3]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960, portal: 172.16.0.220,3260]
Aug 01 19:55:14 user nova-compute[72504]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960, portal: 172.16.0.220,3260] successful.
Aug 01 19:55:14 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d7d6bd1-a0f4-42f6-9e43-b73af451d960 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd08cf7-09cc-40ba-999e-afd490cf5a82]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] <== disconnect_volume: return (333ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.compute.manager [req-686fd68a-e995-4ffc-9ac0-d36bccef58fe req-0b90703b-f66f-4a67-9d72-15bb4544dcd7 service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Received event network-vif-plugged-88a4a208-7192-4e81-b9b2-1e07e7e307d1 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-686fd68a-e995-4ffc-9ac0-d36bccef58fe req-0b90703b-f66f-4a67-9d72-15bb4544dcd7 service nova] Acquiring lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-686fd68a-e995-4ffc-9ac0-d36bccef58fe req-0b90703b-f66f-4a67-9d72-15bb4544dcd7 service nova] Lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-686fd68a-e995-4ffc-9ac0-d36bccef58fe req-0b90703b-f66f-4a67-9d72-15bb4544dcd7 service nova] Lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.compute.manager [req-686fd68a-e995-4ffc-9ac0-d36bccef58fe req-0b90703b-f66f-4a67-9d72-15bb4544dcd7 service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] No waiting events found dispatching network-vif-plugged-88a4a208-7192-4e81-b9b2-1e07e7e307d1 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:55:14 user nova-compute[72504]: WARNING nova.compute.manager [req-686fd68a-e995-4ffc-9ac0-d36bccef58fe req-0b90703b-f66f-4a67-9d72-15bb4544dcd7 service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Received unexpected event network-vif-plugged-88a4a208-7192-4e81-b9b2-1e07e7e307d1 for instance with vm_state active and task_state rescuing.
Aug 01 19:55:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:14 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:55:15 user nova-compute[72504]: DEBUG nova.objects.instance [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lazy-loading 'flavor' on Instance uuid 76aa3861-0ca1-4e7f-9a15-9219037bc1ee {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:55:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-84f565b8-1f13-484c-a3f4-bf1d69516c60 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.894s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:16 user nova-compute[72504]: DEBUG nova.compute.manager [req-6fc86481-6201-4576-be00-3777459ac520 req-395f72d3-f11b-435a-8247-32165dede411 service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Received event network-vif-plugged-3a4ace30-3ca6-4cc9-8125-599cc4097662 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:55:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6fc86481-6201-4576-be00-3777459ac520 req-395f72d3-f11b-435a-8247-32165dede411 service nova] Acquiring lock "88f95d20-e391-4100-93b2-da29bfcf9704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6fc86481-6201-4576-be00-3777459ac520 req-395f72d3-f11b-435a-8247-32165dede411 service nova] Lock "88f95d20-e391-4100-93b2-da29bfcf9704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6fc86481-6201-4576-be00-3777459ac520 req-395f72d3-f11b-435a-8247-32165dede411 service nova] Lock "88f95d20-e391-4100-93b2-da29bfcf9704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:16 user nova-compute[72504]: DEBUG nova.compute.manager [req-6fc86481-6201-4576-be00-3777459ac520 req-395f72d3-f11b-435a-8247-32165dede411 service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] No waiting events found dispatching network-vif-plugged-3a4ace30-3ca6-4cc9-8125-599cc4097662 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:55:16 user nova-compute[72504]: WARNING nova.compute.manager [req-6fc86481-6201-4576-be00-3777459ac520 req-395f72d3-f11b-435a-8247-32165dede411 service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Received unexpected event network-vif-plugged-3a4ace30-3ca6-4cc9-8125-599cc4097662 for instance with vm_state building and task_state spawning.
Aug 01 19:55:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb230370-0feb-46b5-8837-35fea366b34f/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:16 user nova-compute[72504]: DEBUG nova.compute.manager [req-4b7f69a0-54cb-480d-954e-0f8814206db7 req-3976838f-cdf6-4eca-b37c-b5df154cdd4a service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Received event network-vif-plugged-88a4a208-7192-4e81-b9b2-1e07e7e307d1 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:55:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4b7f69a0-54cb-480d-954e-0f8814206db7 req-3976838f-cdf6-4eca-b37c-b5df154cdd4a service nova] Acquiring lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4b7f69a0-54cb-480d-954e-0f8814206db7 req-3976838f-cdf6-4eca-b37c-b5df154cdd4a service nova] Lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4b7f69a0-54cb-480d-954e-0f8814206db7 req-3976838f-cdf6-4eca-b37c-b5df154cdd4a service nova] Lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:16 user nova-compute[72504]: DEBUG nova.compute.manager [req-4b7f69a0-54cb-480d-954e-0f8814206db7 req-3976838f-cdf6-4eca-b37c-b5df154cdd4a service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] No waiting events found dispatching network-vif-plugged-88a4a208-7192-4e81-b9b2-1e07e7e307d1 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:55:16 user nova-compute[72504]: WARNING nova.compute.manager [req-4b7f69a0-54cb-480d-954e-0f8814206db7 req-3976838f-cdf6-4eca-b37c-b5df154cdd4a service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Received unexpected event network-vif-plugged-88a4a208-7192-4e81-b9b2-1e07e7e307d1 for instance with vm_state active and task_state rescuing.
Aug 01 19:55:16 user nova-compute[72504]: DEBUG nova.compute.manager [req-4b7f69a0-54cb-480d-954e-0f8814206db7 req-3976838f-cdf6-4eca-b37c-b5df154cdd4a service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Received event network-vif-plugged-88a4a208-7192-4e81-b9b2-1e07e7e307d1 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:55:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4b7f69a0-54cb-480d-954e-0f8814206db7 req-3976838f-cdf6-4eca-b37c-b5df154cdd4a service nova] Acquiring lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4b7f69a0-54cb-480d-954e-0f8814206db7 req-3976838f-cdf6-4eca-b37c-b5df154cdd4a service nova] Lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4b7f69a0-54cb-480d-954e-0f8814206db7 req-3976838f-cdf6-4eca-b37c-b5df154cdd4a service nova] Lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:16 user nova-compute[72504]: DEBUG nova.compute.manager [req-4b7f69a0-54cb-480d-954e-0f8814206db7 req-3976838f-cdf6-4eca-b37c-b5df154cdd4a service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] No waiting events found dispatching network-vif-plugged-88a4a208-7192-4e81-b9b2-1e07e7e307d1 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:55:16 user nova-compute[72504]: WARNING nova.compute.manager [req-4b7f69a0-54cb-480d-954e-0f8814206db7 req-3976838f-cdf6-4eca-b37c-b5df154cdd4a service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Received unexpected event network-vif-plugged-88a4a208-7192-4e81-b9b2-1e07e7e307d1 for instance with vm_state active and task_state rescuing.
Aug 01 19:55:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb230370-0feb-46b5-8837-35fea366b34f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb230370-0feb-46b5-8837-35fea366b34f/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb230370-0feb-46b5-8837-35fea366b34f/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:17 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919717.8669453, 88f95d20-e391-4100-93b2-da29bfcf9704 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:55:17 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] VM Resumed (Lifecycle Event)
Aug 01 19:55:17 user nova-compute[72504]: DEBUG nova.compute.manager [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:55:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:55:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:17 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:55:17 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Instance spawned successfully.
Aug 01 19:55:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 19:55:17 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:55:17 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:55:17 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919717.880023, 88f95d20-e391-4100-93b2-da29bfcf9704 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:55:17 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] VM Started (Lifecycle Event)
Aug 01 19:55:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:55:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:55:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:55:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:55:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:55:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:55:17 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:55:17 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:55:18 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:55:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:55:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7391a8ce-7ce5-47ec-97f6-6159645688ea/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:18 user nova-compute[72504]: INFO nova.compute.manager [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Took 8.27 seconds to spawn the instance on the hypervisor.
Aug 01 19:55:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:55:18 user nova-compute[72504]: INFO nova.compute.manager [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Took 9.03 seconds to build instance.
Aug 01 19:55:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7391a8ce-7ce5-47ec-97f6-6159645688ea/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7391a8ce-7ce5-47ec-97f6-6159645688ea/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53029629-7421-483f-8c79-c8ce46a2d1aa tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "88f95d20-e391-4100-93b2-da29bfcf9704" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.194s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7391a8ce-7ce5-47ec-97f6-6159645688ea/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Removed pending event for 128c2981-363c-4ae9-b46d-15b5e5d9cac6 due to event {{(pid=72504) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 19:55:18 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919718.3535314, 128c2981-363c-4ae9-b46d-15b5e5d9cac6 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:55:18 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] VM Resumed (Lifecycle Event)
Aug 01 19:55:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-8ff71b5a-c213-4ce3-ae2a-875ee16ad392 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:55:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:55:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:55:18 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 19:55:18 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919718.3554046, 128c2981-363c-4ae9-b46d-15b5e5d9cac6 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:55:18 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] VM Started (Lifecycle Event)
Aug 01 19:55:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:55:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:55:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:55:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:20 user nova-compute[72504]: DEBUG nova.network.neutron [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Port 8f1cca03-e1f6-44db-b8d3-d7a305fc1461 binding to destination host user is already ACTIVE {{(pid=72504) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 01 19:55:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "refresh_cache-5193c770-80ca-44c3-9950-cb25c65e94e8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:55:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquired lock "refresh_cache-5193c770-80ca-44c3-9950-cb25c65e94e8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:55:20 user nova-compute[72504]: DEBUG nova.network.neutron [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:55:21 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:55:21 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:55:21 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=7260MB free_disk=25.29348373413086GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:55:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:21 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Applying migration context for instance 5193c770-80ca-44c3-9950-cb25c65e94e8 as it has an incoming, in-progress migration 4901761c-b8c7-43c6-ae23-07943cf903e4. Migration status is reverting {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 19:55:21 user nova-compute[72504]: INFO nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Updating resource usage from migration 4901761c-b8c7-43c6-ae23-07943cf903e4
Aug 01 19:55:21 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:55:21 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1de87977-532f-45f7-856b-84df41b2a567 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:55:21 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance c9fd391d-51c0-4ef9-86cc-5ce2c76c177a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:55:21 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 7391a8ce-7ce5-47ec-97f6-6159645688ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:55:21 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:55:21 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 128c2981-363c-4ae9-b46d-15b5e5d9cac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:55:21 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 76aa3861-0ca1-4e7f-9a15-9219037bc1ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:55:21 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Migration 4901761c-b8c7-43c6-ae23-07943cf903e4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 19:55:21 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 5193c770-80ca-44c3-9950-cb25c65e94e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:55:21 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance cb230370-0feb-46b5-8837-35fea366b34f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:55:21 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:55:21 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 88f95d20-e391-4100-93b2-da29bfcf9704 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:55:21 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:55:21 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:55:21 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:55:21 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:55:21 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:55:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.635s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:21 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:55:21 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72504) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 19:55:21 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:55:21 user nova-compute[72504]: DEBUG nova.network.neutron [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Updating instance_info_cache with network_info: [{"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:55:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Releasing lock "refresh_cache-5193c770-80ca-44c3-9950-cb25c65e94e8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:55:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Creating tmpfile /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/tmp0jty4ra9 to verify with other compute node that the instance is on the same shared storage. {{(pid=72504) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 01 19:55:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:22 user nova-compute[72504]: DEBUG nova.compute.manager [req-d84d4f2b-6166-4399-85de-c0d8d63a52df req-6f158a38-4c29-4918-b337-5a3a0c83104d service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Received event network-vif-unplugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:55:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d84d4f2b-6166-4399-85de-c0d8d63a52df req-6f158a38-4c29-4918-b337-5a3a0c83104d service nova] Acquiring lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d84d4f2b-6166-4399-85de-c0d8d63a52df req-6f158a38-4c29-4918-b337-5a3a0c83104d service nova] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d84d4f2b-6166-4399-85de-c0d8d63a52df req-6f158a38-4c29-4918-b337-5a3a0c83104d service nova] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:22 user nova-compute[72504]: DEBUG nova.compute.manager [req-d84d4f2b-6166-4399-85de-c0d8d63a52df req-6f158a38-4c29-4918-b337-5a3a0c83104d service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] No waiting events found dispatching network-vif-unplugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:55:22 user nova-compute[72504]: WARNING nova.compute.manager [req-d84d4f2b-6166-4399-85de-c0d8d63a52df req-6f158a38-4c29-4918-b337-5a3a0c83104d service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Received unexpected event network-vif-unplugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 for instance with vm_state resized and task_state resize_reverting.
Aug 01 19:55:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:22 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Instance destroyed successfully.
Aug 01 19:55:22 user nova-compute[72504]: DEBUG nova.objects.instance [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lazy-loading 'resources' on Instance uuid 5193c770-80ca-44c3-9950-cb25c65e94e8 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:55:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:49:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1940907332',display_name='tempest-ServerActionsTestOtherB-server-1940907332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1940907332',id=3,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzhjBwv/fwyuXjW1x6h8vd/kIx1PP+lp3UGnSLHNEmFgbtKuVpQ2lyUbVPsnNcWUwbyAFXlofeww/O420ZBkncMBF2kewUMxpZllUL90MSl7NE91UoBCSbwKPcmnMcunA==',key_name='tempest-keypair-1272671103',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:53:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6958054d48748c68942fb4d36d5ca8b',ramdisk_id='',reservation_id='r-uhmjifqg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1731713993',owner_user_name='tempest-ServerActionsTestOtherB-1731713993-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:53:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98fd620d741b433ba699e5bbbc5ae1c0',uuid=5193c770-80ca-44c3-9950-cb25c65e94e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:55:22 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Converting VIF {"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:55:22 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:8a:a8,bridge_name='br-int',has_traffic_filtering=True,id=8f1cca03-e1f6-44db-b8d3-d7a305fc1461,network=Network(a1278c28-de03-4929-8689-60655553da2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cca03-e1') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:55:22 user nova-compute[72504]: DEBUG os_vif [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:8a:a8,bridge_name='br-int',has_traffic_filtering=True,id=8f1cca03-e1f6-44db-b8d3-d7a305fc1461,network=Network(a1278c28-de03-4929-8689-60655553da2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cca03-e1') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:55:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f1cca03-e1, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:55:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:55:22 user nova-compute[72504]: INFO os_vif [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:8a:a8,bridge_name='br-int',has_traffic_filtering=True,id=8f1cca03-e1f6-44db-b8d3-d7a305fc1461,network=Network(a1278c28-de03-4929-8689-60655553da2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cca03-e1')
Aug 01 19:55:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:55:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAHmLCZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:55:22 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:55:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:55:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:55:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:55:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[420f09cc-0b22-4e36-9e9d-a0c3606936d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[77855654-04a6-415b-8bd6-78271551a4e7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:55:23 user nova-compute[72504]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)
Aug 01 19:55:23 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:55:23 user nova-compute[72504]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)
Aug 01 19:55:23 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff4142fa5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d'): ({'sdd'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Removing single pathed devices sdd {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5313e7-1336-47a5-82f0-8dbf0ef8fdcf]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4baea1a-9eb2-402c-8e1c-f2e79ffc28e1]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Flushing IO for device /dev/sdd {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4d1b9b-4332-4104-b488-0b6992483ecc]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.069s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb435b8-7abf-47e7-855b-e81577ce1cca]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] SCSI volumes sdd have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11e298c-e3f6-45e7-8212-0737c4234a4c]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9faa93ed-b0a6-4430-baac-482253cac820]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d, portal: 172.16.0.220,3260]
Aug 01 19:55:23 user nova-compute[72504]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d, portal: 172.16.0.220,3260] successful.
Aug 01 19:55:23 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9c40d9-79db-4e1e-9497-6f772411566c]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] <== disconnect_volume: return (346ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-39b3076d-ce59-4e7c-976f-9355bf2f6ff4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-39b3076d-ce59-4e7c-976f-9355bf2f6ff4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 19:55:23 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lazy-loading 'info_cache' on Instance uuid 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:55:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:24 user nova-compute[72504]: DEBUG nova.objects.instance [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lazy-loading 'migration_context' on Instance uuid 5193c770-80ca-44c3-9950-cb25c65e94e8 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:55:24 user nova-compute[72504]: DEBUG nova.compute.manager [req-e9a17beb-9dc8-4bcc-8981-3713a0b639a8 req-a1dad96a-dbe2-42a0-9a17-90719a2bdf8b service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Received event network-vif-plugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:55:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e9a17beb-9dc8-4bcc-8981-3713a0b639a8 req-a1dad96a-dbe2-42a0-9a17-90719a2bdf8b service nova] Acquiring lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e9a17beb-9dc8-4bcc-8981-3713a0b639a8 req-a1dad96a-dbe2-42a0-9a17-90719a2bdf8b service nova] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e9a17beb-9dc8-4bcc-8981-3713a0b639a8 req-a1dad96a-dbe2-42a0-9a17-90719a2bdf8b service nova] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:24 user nova-compute[72504]: DEBUG nova.compute.manager [req-e9a17beb-9dc8-4bcc-8981-3713a0b639a8 req-a1dad96a-dbe2-42a0-9a17-90719a2bdf8b service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] No waiting events found dispatching network-vif-plugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:55:24 user nova-compute[72504]: WARNING nova.compute.manager [req-e9a17beb-9dc8-4bcc-8981-3713a0b639a8 req-a1dad96a-dbe2-42a0-9a17-90719a2bdf8b service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Received unexpected event network-vif-plugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 for instance with vm_state resized and task_state resize_reverting.
Aug 01 19:55:24 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Updating instance_info_cache with network_info: [{"id": "a4953c19-ef72-4bbe-b271-40cc5162842d", "address": "fa:16:3e:86:10:53", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4953c19-ef", "ovs_interfaceid": "a4953c19-ef72-4bbe-b271-40cc5162842d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:55:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-39b3076d-ce59-4e7c-976f-9355bf2f6ff4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:55:24 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 19:55:24 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:55:24 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:55:24 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:55:24 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:55:24 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:55:24 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:55:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.466s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:25 user nova-compute[72504]: INFO nova.compute.manager [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Swapping old allocation on dict_keys(['b951a798-e88c-472c-8347-2c5f6a05d47c']) held by migration 4901761c-b8c7-43c6-ae23-07943cf903e4 for instance
Aug 01 19:55:25 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Overwriting current allocation {'allocations': {'b951a798-e88c-472c-8347-2c5f6a05d47c': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 23}}, 'project_id': 'b6958054d48748c68942fb4d36d5ca8b', 'user_id': '98fd620d741b433ba699e5bbbc5ae1c0', 'consumer_generation': 1} on consumer 5193c770-80ca-44c3-9950-cb25c65e94e8 {{(pid=72504) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 01 19:55:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "refresh_cache-5193c770-80ca-44c3-9950-cb25c65e94e8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:55:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquired lock "refresh_cache-5193c770-80ca-44c3-9950-cb25c65e94e8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:55:25 user nova-compute[72504]: DEBUG nova.network.neutron [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:55:25 user nova-compute[72504]: DEBUG nova.network.neutron [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Updating instance_info_cache with network_info: [{"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:55:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Releasing lock "refresh_cache-5193c770-80ca-44c3-9950-cb25c65e94e8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:55:25 user nova-compute[72504]: DEBUG os_brick.utils [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:55:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[27610a84-c1f5-4038-9349-2a7821f4e31e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6658ff-6a3a-43a4-a096-82ea5048221d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a19f53-171d-404e-b3dd-a37d01423063]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae19243-d5e8-4152-880d-5dfb2309ce41]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:55:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:55:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:55:25 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:55:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c44616d-eceb-44a6-80f6-9702819ce95b]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:55:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:55:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:55:25 user nova-compute[72504]: DEBUG os_brick.utils [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:55:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-536a259c-a0c9-4710-ae75-2b1fb96c1d2e tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "1de87977-532f-45f7-856b-84df41b2a567" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-536a259c-a0c9-4710-ae75-2b1fb96c1d2e tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "1de87977-532f-45f7-856b-84df41b2a567" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-536a259c-a0c9-4710-ae75-2b1fb96c1d2e tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "1de87977-532f-45f7-856b-84df41b2a567-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-536a259c-a0c9-4710-ae75-2b1fb96c1d2e tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "1de87977-532f-45f7-856b-84df41b2a567-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-536a259c-a0c9-4710-ae75-2b1fb96c1d2e tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "1de87977-532f-45f7-856b-84df41b2a567-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:26 user nova-compute[72504]: INFO nova.compute.manager [None req-536a259c-a0c9-4710-ae75-2b1fb96c1d2e tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Terminating instance
Aug 01 19:55:26 user nova-compute[72504]: DEBUG nova.compute.manager [None req-536a259c-a0c9-4710-ae75-2b1fb96c1d2e tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 19:55:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:27 user nova-compute[72504]: DEBUG nova.compute.manager [req-1f882c96-9fc6-451c-a999-323bffb8f010 req-b73e5393-2855-40c1-a1b1-80766b6fffa6 service nova] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Received event network-vif-unplugged-5ecd0d2b-2f55-49b1-8858-3ab96e942b4f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:55:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1f882c96-9fc6-451c-a999-323bffb8f010 req-b73e5393-2855-40c1-a1b1-80766b6fffa6 service nova] Acquiring lock "1de87977-532f-45f7-856b-84df41b2a567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1f882c96-9fc6-451c-a999-323bffb8f010 req-b73e5393-2855-40c1-a1b1-80766b6fffa6 service nova] Lock "1de87977-532f-45f7-856b-84df41b2a567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1f882c96-9fc6-451c-a999-323bffb8f010 req-b73e5393-2855-40c1-a1b1-80766b6fffa6 service nova] Lock "1de87977-532f-45f7-856b-84df41b2a567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:27 user nova-compute[72504]: DEBUG nova.compute.manager [req-1f882c96-9fc6-451c-a999-323bffb8f010 req-b73e5393-2855-40c1-a1b1-80766b6fffa6 service nova] [instance: 1de87977-532f-45f7-856b-84df41b2a567] No waiting events found dispatching network-vif-unplugged-5ecd0d2b-2f55-49b1-8858-3ab96e942b4f {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:55:27 user nova-compute[72504]: DEBUG nova.compute.manager [req-1f882c96-9fc6-451c-a999-323bffb8f010 req-b73e5393-2855-40c1-a1b1-80766b6fffa6 service nova] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Received event network-vif-unplugged-5ecd0d2b-2f55-49b1-8858-3ab96e942b4f for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:55:27 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Instance destroyed successfully.
Aug 01 19:55:27 user nova-compute[72504]: DEBUG nova.objects.instance [None req-536a259c-a0c9-4710-ae75-2b1fb96c1d2e tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lazy-loading 'resources' on Instance uuid 1de87977-532f-45f7-856b-84df41b2a567 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:55:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-536a259c-a0c9-4710-ae75-2b1fb96c1d2e tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:49:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-690282244',display_name='tempest-AttachVolumeNegativeTest-server-690282244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-690282244',id=5,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2gTw4nMcUFERkQeyvYHB/zROHS1gTh0rWtAAjIWTyZ98gQMEl9oC8xtKGmod4S57s4UuOmOGNs0bNy2FnwATXTxSjg3XUIWFm7EOBRqyeGI+iTq7xJOAPcSfqO+Qysnw==',key_name='tempest-keypair-1947884909',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:49:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15cc01820f324654b0959d5fb2adefc3',ramdisk_id='',reservation_id='r-4h1i4rx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2109955223',owner_user_name='tempest-AttachVolumeNegativeTest-2109955223-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:49:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='451baacc96384f35bd8bbb87626ac52d',uuid=1de87977-532f-45f7-856b-84df41b2a567,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ecd0d2b-2f55-49b1-8858-3ab96e942b4f", "address": "fa:16:3e:45:cb:79", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ecd0d2b-2f", "ovs_interfaceid": "5ecd0d2b-2f55-49b1-8858-3ab96e942b4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:55:27 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-536a259c-a0c9-4710-ae75-2b1fb96c1d2e tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Converting VIF {"id": "5ecd0d2b-2f55-49b1-8858-3ab96e942b4f", "address": "fa:16:3e:45:cb:79", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ecd0d2b-2f", "ovs_interfaceid": "5ecd0d2b-2f55-49b1-8858-3ab96e942b4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:55:27 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-536a259c-a0c9-4710-ae75-2b1fb96c1d2e tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:cb:79,bridge_name='br-int',has_traffic_filtering=True,id=5ecd0d2b-2f55-49b1-8858-3ab96e942b4f,network=Network(67292f1d-2643-4cfa-aaf6-0a698d87bfd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ecd0d2b-2f') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:55:27 user nova-compute[72504]: DEBUG os_vif [None req-536a259c-a0c9-4710-ae75-2b1fb96c1d2e tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:cb:79,bridge_name='br-int',has_traffic_filtering=True,id=5ecd0d2b-2f55-49b1-8858-3ab96e942b4f,network=Network(67292f1d-2643-4cfa-aaf6-0a698d87bfd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ecd0d2b-2f') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:55:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ecd0d2b-2f, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:55:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:55:27 user nova-compute[72504]: INFO os_vif [None req-536a259c-a0c9-4710-ae75-2b1fb96c1d2e tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:cb:79,bridge_name='br-int',has_traffic_filtering=True,id=5ecd0d2b-2f55-49b1-8858-3ab96e942b4f,network=Network(67292f1d-2643-4cfa-aaf6-0a698d87bfd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ecd0d2b-2f')
Aug 01 19:55:27 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-536a259c-a0c9-4710-ae75-2b1fb96c1d2e tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Deleting instance files /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567_del
Aug 01 19:55:27 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-536a259c-a0c9-4710-ae75-2b1fb96c1d2e tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Deletion of /opt/stack/data/nova/instances/1de87977-532f-45f7-856b-84df41b2a567_del complete
Aug 01 19:55:27 user nova-compute[72504]: INFO nova.compute.manager [None req-536a259c-a0c9-4710-ae75-2b1fb96c1d2e tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 01 19:55:27 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-536a259c-a0c9-4710-ae75-2b1fb96c1d2e tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 19:55:27 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 19:55:27 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 1de87977-532f-45f7-856b-84df41b2a567] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 19:55:29 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:55:29 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Took 1.31 seconds to deallocate network for instance.
Aug 01 19:55:29 user nova-compute[72504]: DEBUG nova.compute.manager [req-b4c51882-a2fb-4506-9825-84b3b6b8f66c req-0e868263-7a15-4548-80f3-7aa3bd00d625 service nova] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Received event network-vif-deleted-5ecd0d2b-2f55-49b1-8858-3ab96e942b4f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:55:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-536a259c-a0c9-4710-ae75-2b1fb96c1d2e tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-536a259c-a0c9-4710-ae75-2b1fb96c1d2e tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:29 user nova-compute[72504]: DEBUG nova.compute.manager [req-29865209-87d0-473b-9457-c2c935500474 req-203f8f75-ee2a-49b4-b16b-d0b96df7c309 service nova] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Received event network-vif-plugged-5ecd0d2b-2f55-49b1-8858-3ab96e942b4f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:55:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-29865209-87d0-473b-9457-c2c935500474 req-203f8f75-ee2a-49b4-b16b-d0b96df7c309 service nova] Acquiring lock "1de87977-532f-45f7-856b-84df41b2a567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-29865209-87d0-473b-9457-c2c935500474 req-203f8f75-ee2a-49b4-b16b-d0b96df7c309 service nova] Lock "1de87977-532f-45f7-856b-84df41b2a567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-29865209-87d0-473b-9457-c2c935500474 req-203f8f75-ee2a-49b4-b16b-d0b96df7c309 service nova] Lock "1de87977-532f-45f7-856b-84df41b2a567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:29 user nova-compute[72504]: DEBUG nova.compute.manager [req-29865209-87d0-473b-9457-c2c935500474 req-203f8f75-ee2a-49b4-b16b-d0b96df7c309 service nova] [instance: 1de87977-532f-45f7-856b-84df41b2a567] No waiting events found dispatching network-vif-plugged-5ecd0d2b-2f55-49b1-8858-3ab96e942b4f {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:55:29 user nova-compute[72504]: WARNING nova.compute.manager [req-29865209-87d0-473b-9457-c2c935500474 req-203f8f75-ee2a-49b4-b16b-d0b96df7c309 service nova] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Received unexpected event network-vif-plugged-5ecd0d2b-2f55-49b1-8858-3ab96e942b4f for instance with vm_state deleted and task_state None.
Aug 01 19:55:29 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-536a259c-a0c9-4710-ae75-2b1fb96c1d2e tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:55:29 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-536a259c-a0c9-4710-ae75-2b1fb96c1d2e tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:55:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-536a259c-a0c9-4710-ae75-2b1fb96c1d2e tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:29 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-536a259c-a0c9-4710-ae75-2b1fb96c1d2e tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Deleted allocations for instance 1de87977-532f-45f7-856b-84df41b2a567
Aug 01 19:55:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-536a259c-a0c9-4710-ae75-2b1fb96c1d2e tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "1de87977-532f-45f7-856b-84df41b2a567" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.935s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Starting finish_revert_migration {{(pid=72504) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Start _get_guest_xml network_info=[{"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAHmLCZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '5193c770-80ca-44c3-9950-cb25c65e94e8', 'attached_at': '2023-08-01T19:55:34.000000', 'detached_at': '', 'volume_id': 'fd436d31-78dd-4044-b044-840d1853718d', 'serial': 'fd436d31-78dd-4044-b044-840d1853718d'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': '0f739b2a-2b21-4e0d-aed9-80ce4b71e60d', 'volume_type': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:55:34 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:55:34 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:55:34 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG nova.objects.instance [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5193c770-80ca-44c3-9950-cb25c65e94e8 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAHmLCZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:55:34 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:55:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:55:34 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:55:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:55:34 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e10bed6-6c17-4cc4-8b10-794226102036]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:55:34 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8c1b5e-65d4-4542-a896-80f50d179cf2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d] added
Aug 01 19:55:34 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cf6e19-041c-4d12-a767-9ff0f526575a]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cfc87a-01c8-425f-a775-53ad28b4aa51]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nAHmLCZD {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nAHmLCZD" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff0154b-6dfa-4c3c-9773-e59aa673142a]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nAHmLCZD'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[72087ba2-4041-47ca-83d9-dc9bef046a2f]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd82fa3f-794b-4196-bbec-a86e48cd65e0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:55:34 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:55:34 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[50baf6ec-e682-4770-a026-f2febce4a53b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d, portal: 172.16.0.220,3260]
Aug 01 19:55:34 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d, portal: 172.16.0.220,3260] successful.
Aug 01 19:55:34 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2846db4-e070-42d6-bdf4-3e725356abce]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[54413f73-29f1-4aa3-a6dc-bf3dab296d56]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:55:34 user nova-compute[72504]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)
Aug 01 19:55:34 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:55:34 user nova-compute[72504]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)
Aug 01 19:55:34 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca523068-796e-438e-89e6-94818b1666a8]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:55:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAHmLCZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:55:35 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:55:35 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23637646439626230', 'path': '/dev/sdc'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:55:35 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637646439626230', 'path': '/dev/sdc'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:55:35 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:49:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1940907332',display_name='tempest-ServerActionsTestOtherB-server-1940907332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1940907332',id=3,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzhjBwv/fwyuXjW1x6h8vd/kIx1PP+lp3UGnSLHNEmFgbtKuVpQ2lyUbVPsnNcWUwbyAFXlofeww/O420ZBkncMBF2kewUMxpZllUL90MSl7NE91UoBCSbwKPcmnMcunA==',key_name='tempest-keypair-1272671103',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:53:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b6958054d48748c68942fb4d36d5ca8b',ramdisk_id='',reservation_id='r-uhmjifqg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1731713993',owner_user_name='tempest-ServerActionsTestOtherB-1731713993-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:55:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98fd620d741b433ba699e5bbbc5ae1c0',uuid=5193c770-80ca-44c3-9950-cb25c65e94e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:55:35 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Converting VIF {"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:55:35 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:8a:a8,bridge_name='br-int',has_traffic_filtering=True,id=8f1cca03-e1f6-44db-b8d3-d7a305fc1461,network=Network(a1278c28-de03-4929-8689-60655553da2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cca03-e1') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:55:35 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:55:35 user nova-compute[72504]:   <uuid>5193c770-80ca-44c3-9950-cb25c65e94e8</uuid>
Aug 01 19:55:35 user nova-compute[72504]:   <name>instance-00000003</name>
Aug 01 19:55:35 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:55:35 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:55:35 user nova-compute[72504]:   <metadata>
Aug 01 19:55:35 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:55:35 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:55:35 user nova-compute[72504]:       <nova:name>tempest-ServerActionsTestOtherB-server-1940907332</nova:name>
Aug 01 19:55:35 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:55:34</nova:creationTime>
Aug 01 19:55:35 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:55:35 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:55:35 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:55:35 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:55:35 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:55:35 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:55:35 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:55:35 user nova-compute[72504]:       <nova:owner>
Aug 01 19:55:35 user nova-compute[72504]:         <nova:user uuid="98fd620d741b433ba699e5bbbc5ae1c0">tempest-ServerActionsTestOtherB-1731713993-project-member</nova:user>
Aug 01 19:55:35 user nova-compute[72504]:         <nova:project uuid="b6958054d48748c68942fb4d36d5ca8b">tempest-ServerActionsTestOtherB-1731713993</nova:project>
Aug 01 19:55:35 user nova-compute[72504]:       </nova:owner>
Aug 01 19:55:35 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:55:35 user nova-compute[72504]:       <nova:ports>
Aug 01 19:55:35 user nova-compute[72504]:         <nova:port uuid="8f1cca03-e1f6-44db-b8d3-d7a305fc1461">
Aug 01 19:55:35 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 19:55:35 user nova-compute[72504]:         </nova:port>
Aug 01 19:55:35 user nova-compute[72504]:       </nova:ports>
Aug 01 19:55:35 user nova-compute[72504]:     </nova:instance>
Aug 01 19:55:35 user nova-compute[72504]:   </metadata>
Aug 01 19:55:35 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:55:35 user nova-compute[72504]:     <system>
Aug 01 19:55:35 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:55:35 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:55:35 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:55:35 user nova-compute[72504]:       <entry name="serial">5193c770-80ca-44c3-9950-cb25c65e94e8</entry>
Aug 01 19:55:35 user nova-compute[72504]:       <entry name="uuid">5193c770-80ca-44c3-9950-cb25c65e94e8</entry>
Aug 01 19:55:35 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:55:35 user nova-compute[72504]:     </system>
Aug 01 19:55:35 user nova-compute[72504]:   </sysinfo>
Aug 01 19:55:35 user nova-compute[72504]:   <os>
Aug 01 19:55:35 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:55:35 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:55:35 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:55:35 user nova-compute[72504]:   </os>
Aug 01 19:55:35 user nova-compute[72504]:   <features>
Aug 01 19:55:35 user nova-compute[72504]:     <acpi/>
Aug 01 19:55:35 user nova-compute[72504]:     <apic/>
Aug 01 19:55:35 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:55:35 user nova-compute[72504]:   </features>
Aug 01 19:55:35 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:55:35 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:55:35 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:55:35 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:55:35 user nova-compute[72504]:   </clock>
Aug 01 19:55:35 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:55:35 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:55:35 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:55:35 user nova-compute[72504]:   </cpu>
Aug 01 19:55:35 user nova-compute[72504]:   <devices>
Aug 01 19:55:35 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:55:35 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:55:35 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk"/>
Aug 01 19:55:35 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:55:35 user nova-compute[72504]:     </disk>
Aug 01 19:55:35 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 19:55:35 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:55:35 user nova-compute[72504]:       <source dev="/dev/sdc"/>
Aug 01 19:55:35 user nova-compute[72504]:       <target dev="vdb" bus="virtio"/>
Aug 01 19:55:35 user nova-compute[72504]:       <serial>fd436d31-78dd-4044-b044-840d1853718d</serial>
Aug 01 19:55:35 user nova-compute[72504]:     </disk>
Aug 01 19:55:35 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:55:35 user nova-compute[72504]:       <mac address="fa:16:3e:46:8a:a8"/>
Aug 01 19:55:35 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:55:35 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:55:35 user nova-compute[72504]:       <target dev="tap8f1cca03-e1"/>
Aug 01 19:55:35 user nova-compute[72504]:     </interface>
Aug 01 19:55:35 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:55:35 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/console.log" append="off"/>
Aug 01 19:55:35 user nova-compute[72504]:     </serial>
Aug 01 19:55:35 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:55:35 user nova-compute[72504]:     <video>
Aug 01 19:55:35 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:55:35 user nova-compute[72504]:     </video>
Aug 01 19:55:35 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:55:35 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:55:35 user nova-compute[72504]:     </rng>
Aug 01 19:55:35 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:55:35 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:55:35 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:55:35 user nova-compute[72504]:     </memballoon>
Aug 01 19:55:35 user nova-compute[72504]:   </devices>
Aug 01 19:55:35 user nova-compute[72504]: </domain>
Aug 01 19:55:35 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:55:35 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:49:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1940907332',display_name='tempest-ServerActionsTestOtherB-server-1940907332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1940907332',id=3,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzhjBwv/fwyuXjW1x6h8vd/kIx1PP+lp3UGnSLHNEmFgbtKuVpQ2lyUbVPsnNcWUwbyAFXlofeww/O420ZBkncMBF2kewUMxpZllUL90MSl7NE91UoBCSbwKPcmnMcunA==',key_name='tempest-keypair-1272671103',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:53:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b6958054d48748c68942fb4d36d5ca8b',ramdisk_id='',reservation_id='r-uhmjifqg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1731713993',owner_user_name='tempest-ServerActionsTestOtherB-1731713993-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:55:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98fd620d741b433ba699e5bbbc5ae1c0',uuid=5193c770-80ca-44c3-9950-cb25c65e94e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:55:35 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Converting VIF {"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:55:35 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:8a:a8,bridge_name='br-int',has_traffic_filtering=True,id=8f1cca03-e1f6-44db-b8d3-d7a305fc1461,network=Network(a1278c28-de03-4929-8689-60655553da2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cca03-e1') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:55:35 user nova-compute[72504]: DEBUG os_vif [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:8a:a8,bridge_name='br-int',has_traffic_filtering=True,id=8f1cca03-e1f6-44db-b8d3-d7a305fc1461,network=Network(a1278c28-de03-4929-8689-60655553da2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cca03-e1') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:55:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:55:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:55:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f1cca03-e1, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:55:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8f1cca03-e1, col_values=(('external_ids', {'iface-id': '8f1cca03-e1f6-44db-b8d3-d7a305fc1461', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:8a:a8', 'vm-uuid': '5193c770-80ca-44c3-9950-cb25c65e94e8'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:55:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:55:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:35 user nova-compute[72504]: INFO os_vif [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:8a:a8,bridge_name='br-int',has_traffic_filtering=True,id=8f1cca03-e1f6-44db-b8d3-d7a305fc1461,network=Network(a1278c28-de03-4929-8689-60655553da2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cca03-e1')
Aug 01 19:55:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:37 user nova-compute[72504]: DEBUG nova.compute.manager [req-2f03f436-ec1c-441c-9aa8-8fba499d1f7f req-dc61d033-a962-4306-b450-4a7322ec81b0 service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Received event network-vif-plugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:55:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2f03f436-ec1c-441c-9aa8-8fba499d1f7f req-dc61d033-a962-4306-b450-4a7322ec81b0 service nova] Acquiring lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2f03f436-ec1c-441c-9aa8-8fba499d1f7f req-dc61d033-a962-4306-b450-4a7322ec81b0 service nova] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2f03f436-ec1c-441c-9aa8-8fba499d1f7f req-dc61d033-a962-4306-b450-4a7322ec81b0 service nova] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:37 user nova-compute[72504]: DEBUG nova.compute.manager [req-2f03f436-ec1c-441c-9aa8-8fba499d1f7f req-dc61d033-a962-4306-b450-4a7322ec81b0 service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] No waiting events found dispatching network-vif-plugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:55:37 user nova-compute[72504]: WARNING nova.compute.manager [req-2f03f436-ec1c-441c-9aa8-8fba499d1f7f req-dc61d033-a962-4306-b450-4a7322ec81b0 service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Received unexpected event network-vif-plugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 for instance with vm_state resized and task_state resize_reverting.
Aug 01 19:55:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:37 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690919722.9079664, 5193c770-80ca-44c3-9950-cb25c65e94e8 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:55:37 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] VM Stopped (Lifecycle Event)
Aug 01 19:55:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:37 user nova-compute[72504]: DEBUG nova.compute.manager [None req-4bba9302-ecb4-468e-93eb-99dcfbd298a6 None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:55:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-bda6120a-df23-4124-8bd9-1f79229cc1b7 req-d5127f59-8445-4f3e-8f0c-459d5114823d service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Received event network-vif-plugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:55:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-bda6120a-df23-4124-8bd9-1f79229cc1b7 req-d5127f59-8445-4f3e-8f0c-459d5114823d service nova] Acquiring lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-bda6120a-df23-4124-8bd9-1f79229cc1b7 req-d5127f59-8445-4f3e-8f0c-459d5114823d service nova] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-bda6120a-df23-4124-8bd9-1f79229cc1b7 req-d5127f59-8445-4f3e-8f0c-459d5114823d service nova] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-bda6120a-df23-4124-8bd9-1f79229cc1b7 req-d5127f59-8445-4f3e-8f0c-459d5114823d service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] No waiting events found dispatching network-vif-plugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:55:40 user nova-compute[72504]: WARNING nova.compute.manager [req-bda6120a-df23-4124-8bd9-1f79229cc1b7 req-d5127f59-8445-4f3e-8f0c-459d5114823d service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Received unexpected event network-vif-plugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 for instance with vm_state resized and task_state resize_reverting.
Aug 01 19:55:40 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919739.6585405, 5193c770-80ca-44c3-9950-cb25c65e94e8 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:55:40 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] VM Resumed (Lifecycle Event)
Aug 01 19:55:40 user nova-compute[72504]: DEBUG nova.compute.manager [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:55:40 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Instance running successfully.
Aug 01 19:55:40 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] finish_revert_migration finished successfully. {{(pid=72504) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 01 19:55:40 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:55:40 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:55:40 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 01 19:55:40 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919739.6616526, 5193c770-80ca-44c3-9950-cb25c65e94e8 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:55:40 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] VM Started (Lifecycle Event)
Aug 01 19:55:40 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:55:40 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:55:40 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 01 19:55:40 user nova-compute[72504]: INFO nova.compute.manager [None req-335200dc-4610-497f-abf1-7a08b3a5ffae tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Updating instance to original state: 'active'
Aug 01 19:55:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:42 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690919727.604834, 1de87977-532f-45f7-856b-84df41b2a567 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:55:42 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 1de87977-532f-45f7-856b-84df41b2a567] VM Stopped (Lifecycle Event)
Aug 01 19:55:42 user nova-compute[72504]: DEBUG nova.compute.manager [None req-023e5ae3-a088-4e9e-a4f1-6f2033e91b8f None None] [instance: 1de87977-532f-45f7-856b-84df41b2a567] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:55:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Acquiring lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Acquiring lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:54 user nova-compute[72504]: INFO nova.compute.manager [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Terminating instance
Aug 01 19:55:54 user nova-compute[72504]: DEBUG nova.compute.manager [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 19:55:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:54 user nova-compute[72504]: DEBUG nova.compute.manager [req-a090f361-3351-4201-9dea-f391120ef772 req-575c98c0-ae32-4ffb-ae89-31122512bdba service nova] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Received event network-vif-unplugged-381103b0-a255-4d2a-b20e-8dc4b15028e9 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:55:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a090f361-3351-4201-9dea-f391120ef772 req-575c98c0-ae32-4ffb-ae89-31122512bdba service nova] Acquiring lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a090f361-3351-4201-9dea-f391120ef772 req-575c98c0-ae32-4ffb-ae89-31122512bdba service nova] Lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a090f361-3351-4201-9dea-f391120ef772 req-575c98c0-ae32-4ffb-ae89-31122512bdba service nova] Lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:54 user nova-compute[72504]: DEBUG nova.compute.manager [req-a090f361-3351-4201-9dea-f391120ef772 req-575c98c0-ae32-4ffb-ae89-31122512bdba service nova] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] No waiting events found dispatching network-vif-unplugged-381103b0-a255-4d2a-b20e-8dc4b15028e9 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:55:54 user nova-compute[72504]: DEBUG nova.compute.manager [req-a090f361-3351-4201-9dea-f391120ef772 req-575c98c0-ae32-4ffb-ae89-31122512bdba service nova] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Received event network-vif-unplugged-381103b0-a255-4d2a-b20e-8dc4b15028e9 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:55:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-848d48f5-f27b-4c54-81aa-de3c95879642 req-360cff01-1a9e-4561-9d08-81b91502d2a8 service nova] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Received event network-changed-e342b987-cf5d-4e32-ba7c-d18fa3519229 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:55:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-848d48f5-f27b-4c54-81aa-de3c95879642 req-360cff01-1a9e-4561-9d08-81b91502d2a8 service nova] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Refreshing instance network info cache due to event network-changed-e342b987-cf5d-4e32-ba7c-d18fa3519229. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:55:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-848d48f5-f27b-4c54-81aa-de3c95879642 req-360cff01-1a9e-4561-9d08-81b91502d2a8 service nova] Acquiring lock "refresh_cache-cb230370-0feb-46b5-8837-35fea366b34f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:55:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-848d48f5-f27b-4c54-81aa-de3c95879642 req-360cff01-1a9e-4561-9d08-81b91502d2a8 service nova] Acquired lock "refresh_cache-cb230370-0feb-46b5-8837-35fea366b34f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:55:55 user nova-compute[72504]: DEBUG nova.network.neutron [req-848d48f5-f27b-4c54-81aa-de3c95879642 req-360cff01-1a9e-4561-9d08-81b91502d2a8 service nova] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Refreshing network info cache for port e342b987-cf5d-4e32-ba7c-d18fa3519229 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:55:55 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Instance destroyed successfully.
Aug 01 19:55:55 user nova-compute[72504]: DEBUG nova.objects.instance [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lazy-loading 'resources' on Instance uuid c9fd391d-51c0-4ef9-86cc-5ce2c76c177a {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:55:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:49:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-908512508',display_name='tempest-VolumesAdminNegativeTest-server-908512508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-908512508',id=8,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCk7TpUmVRM2lmn7tJzfWortxYyXW44Sed676LjnmBKUTRKstRWrja7p5I0Sk7y9Or/uFmAWV2bnbIpB1eJU/jykNbsJYeBm1icL5nD9s57fLURgdyJbTctrx8tqdDBR0A==',key_name='tempest-keypair-674067401',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:50:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4bd6112c6db747f297455ca969783d11',ramdisk_id='',reservation_id='r-bvj0pk1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1986244634',owner_user_name='tempest-VolumesAdminNegativeTest-1986244634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0602032d5a34a83a13a4888436b689e',uuid=c9fd391d-51c0-4ef9-86cc-5ce2c76c177a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "381103b0-a255-4d2a-b20e-8dc4b15028e9", "address": "fa:16:3e:45:86:19", "network": {"id": "b2c62156-50c6-4f54-b857-961843d14579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-554746486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd6112c6db747f297455ca969783d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381103b0-a2", "ovs_interfaceid": "381103b0-a255-4d2a-b20e-8dc4b15028e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:55:55 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Converting VIF {"id": "381103b0-a255-4d2a-b20e-8dc4b15028e9", "address": "fa:16:3e:45:86:19", "network": {"id": "b2c62156-50c6-4f54-b857-961843d14579", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-554746486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bd6112c6db747f297455ca969783d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap381103b0-a2", "ovs_interfaceid": "381103b0-a255-4d2a-b20e-8dc4b15028e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:55:55 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:86:19,bridge_name='br-int',has_traffic_filtering=True,id=381103b0-a255-4d2a-b20e-8dc4b15028e9,network=Network(b2c62156-50c6-4f54-b857-961843d14579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap381103b0-a2') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:55:55 user nova-compute[72504]: DEBUG os_vif [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:86:19,bridge_name='br-int',has_traffic_filtering=True,id=381103b0-a255-4d2a-b20e-8dc4b15028e9,network=Network(b2c62156-50c6-4f54-b857-961843d14579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap381103b0-a2') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:55:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap381103b0-a2, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:55:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:55:55 user nova-compute[72504]: INFO os_vif [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:86:19,bridge_name='br-int',has_traffic_filtering=True,id=381103b0-a255-4d2a-b20e-8dc4b15028e9,network=Network(b2c62156-50c6-4f54-b857-961843d14579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap381103b0-a2')
Aug 01 19:55:55 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Deleting instance files /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a_del
Aug 01 19:55:55 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Deletion of /opt/stack/data/nova/instances/c9fd391d-51c0-4ef9-86cc-5ce2c76c177a_del complete
Aug 01 19:55:55 user nova-compute[72504]: INFO nova.compute.manager [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 01 19:55:55 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 19:55:55 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 19:55:55 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 19:55:56 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:55:56 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Took 1.00 seconds to deallocate network for instance.
Aug 01 19:55:56 user nova-compute[72504]: DEBUG nova.compute.manager [req-9431f3bd-5d21-48f7-875f-aabd3586a7d2 req-98748cb9-4ffa-4ebc-980a-caf6906ebd4c service nova] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Received event network-vif-deleted-381103b0-a255-4d2a-b20e-8dc4b15028e9 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:55:56 user nova-compute[72504]: INFO nova.compute.manager [req-9431f3bd-5d21-48f7-875f-aabd3586a7d2 req-98748cb9-4ffa-4ebc-980a-caf6906ebd4c service nova] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Neutron deleted interface 381103b0-a255-4d2a-b20e-8dc4b15028e9; detaching it from the instance and deleting it from the info cache
Aug 01 19:55:56 user nova-compute[72504]: DEBUG nova.network.neutron [req-9431f3bd-5d21-48f7-875f-aabd3586a7d2 req-98748cb9-4ffa-4ebc-980a-caf6906ebd4c service nova] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:55:56 user nova-compute[72504]: DEBUG nova.network.neutron [req-848d48f5-f27b-4c54-81aa-de3c95879642 req-360cff01-1a9e-4561-9d08-81b91502d2a8 service nova] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Updated VIF entry in instance network info cache for port e342b987-cf5d-4e32-ba7c-d18fa3519229. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:55:56 user nova-compute[72504]: DEBUG nova.network.neutron [req-848d48f5-f27b-4c54-81aa-de3c95879642 req-360cff01-1a9e-4561-9d08-81b91502d2a8 service nova] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Updating instance_info_cache with network_info: [{"id": "e342b987-cf5d-4e32-ba7c-d18fa3519229", "address": "fa:16:3e:ba:56:6f", "network": {"id": "63ff1aab-acfc-4e7b-aee4-4bcd09b47a06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1427520461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aa32d6ef3fa4cf3b5d229f868e34045", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape342b987-cf", "ovs_interfaceid": "e342b987-cf5d-4e32-ba7c-d18fa3519229", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:55:56 user nova-compute[72504]: DEBUG nova.compute.manager [req-9431f3bd-5d21-48f7-875f-aabd3586a7d2 req-98748cb9-4ffa-4ebc-980a-caf6906ebd4c service nova] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Detach interface failed, port_id=381103b0-a255-4d2a-b20e-8dc4b15028e9, reason: Instance c9fd391d-51c0-4ef9-86cc-5ce2c76c177a could not be found. {{(pid=72504) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 19:55:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-848d48f5-f27b-4c54-81aa-de3c95879642 req-360cff01-1a9e-4561-9d08-81b91502d2a8 service nova] Releasing lock "refresh_cache-cb230370-0feb-46b5-8837-35fea366b34f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:55:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:56 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Refreshing inventories for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 19:55:56 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Updating ProviderTree inventory for provider b951a798-e88c-472c-8347-2c5f6a05d47c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 19:55:56 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Updating inventory in ProviderTree for provider b951a798-e88c-472c-8347-2c5f6a05d47c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 19:55:56 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Refreshing aggregate associations for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c, aggregates: None {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 19:55:56 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Refreshing trait associations for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c, traits: HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 19:55:56 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:55:57 user nova-compute[72504]: WARNING nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Aug 01 19:55:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid 5193c770-80ca-44c3-9950-cb25c65e94e8 {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid 76aa3861-0ca1-4e7f-9a15-9219037bc1ee {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid c9fd391d-51c0-4ef9-86cc-5ce2c76c177a {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid 7391a8ce-7ce5-47ec-97f6-6159645688ea {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid 128c2981-363c-4ae9-b46d-15b5e5d9cac6 {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid cb230370-0feb-46b5-8837-35fea366b34f {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid 88f95d20-e391-4100-93b2-da29bfcf9704 {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "39b3076d-ce59-4e7c-976f-9355bf2f6ff4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "39b3076d-ce59-4e7c-976f-9355bf2f6ff4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "5193c770-80ca-44c3-9950-cb25c65e94e8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "7391a8ce-7ce5-47ec-97f6-6159645688ea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "cb230370-0feb-46b5-8837-35fea366b34f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "cb230370-0feb-46b5-8837-35fea366b34f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "88f95d20-e391-4100-93b2-da29bfcf9704" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "88f95d20-e391-4100-93b2-da29bfcf9704" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-88f6d229-9e83-4e4c-aac1-e615d92e7418 req-8c7b6f83-e1eb-43a6-b71b-89f143f05723 service nova] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Received event network-vif-plugged-381103b0-a255-4d2a-b20e-8dc4b15028e9 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-88f6d229-9e83-4e4c-aac1-e615d92e7418 req-8c7b6f83-e1eb-43a6-b71b-89f143f05723 service nova] Acquiring lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-88f6d229-9e83-4e4c-aac1-e615d92e7418 req-8c7b6f83-e1eb-43a6-b71b-89f143f05723 service nova] Lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-88f6d229-9e83-4e4c-aac1-e615d92e7418 req-8c7b6f83-e1eb-43a6-b71b-89f143f05723 service nova] Lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-88f6d229-9e83-4e4c-aac1-e615d92e7418 req-8c7b6f83-e1eb-43a6-b71b-89f143f05723 service nova] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] No waiting events found dispatching network-vif-plugged-381103b0-a255-4d2a-b20e-8dc4b15028e9 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:55:57 user nova-compute[72504]: WARNING nova.compute.manager [req-88f6d229-9e83-4e4c-aac1-e615d92e7418 req-8c7b6f83-e1eb-43a6-b71b-89f143f05723 service nova] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Received unexpected event network-vif-plugged-381103b0-a255-4d2a-b20e-8dc4b15028e9 for instance with vm_state deleted and task_state None.
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "39b3076d-ce59-4e7c-976f-9355bf2f6ff4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.193s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.189s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.192s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.194s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.190s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.191s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.216s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "cb230370-0feb-46b5-8837-35fea366b34f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.219s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "88f95d20-e391-4100-93b2-da29bfcf9704" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.232s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.745s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:57 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Deleted allocations for instance c9fd391d-51c0-4ef9-86cc-5ce2c76c177a
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-94c8fa85-89c3-430e-b3d1-49b0687855fd tempest-VolumesAdminNegativeTest-1986244634 tempest-VolumesAdminNegativeTest-1986244634-project-member] Lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.856s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.442s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "c9fd391d-51c0-4ef9-86cc-5ce2c76c177a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.021s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:55:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Acquiring lock "cb230370-0feb-46b5-8837-35fea366b34f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lock "cb230370-0feb-46b5-8837-35fea366b34f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:59 user nova-compute[72504]: DEBUG nova.objects.instance [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lazy-loading 'flavor' on Instance uuid cb230370-0feb-46b5-8837-35fea366b34f {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:55:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lock "cb230370-0feb-46b5-8837-35fea366b34f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:55:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Acquiring lock "cb230370-0feb-46b5-8837-35fea366b34f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:55:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lock "cb230370-0feb-46b5-8837-35fea366b34f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:55:59 user nova-compute[72504]: INFO nova.compute.manager [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Attaching volume bfb99db4-25ed-4fe0-8ca9-a262ba99b889 to /dev/vdb
Aug 01 19:55:59 user nova-compute[72504]: DEBUG os_brick.utils [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:55:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:59 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87fb862-141c-4173-aa22-54000f7aad35]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:59 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[32367f56-285f-4f0e-a60d-70d2f4f026a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:55:59 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe0d2bf-fbaf-420c-b089-c47e44e19dd7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:59 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[98dbc466-053e-4291-b616-42e16664af09]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:55:59 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:55:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:55:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:55:59 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:55:59 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[db407e13-83ad-4346-86ea-3715f33c1ba0]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:55:59 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:55:59 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:55:59 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:55:59 user nova-compute[72504]: DEBUG os_brick.utils [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:55:59 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Updating existing volume attachment record: 5e5e4089-3fe6-45d8-8b8e-b34a1193438a {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:56:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-eb12e04b-3cd9-461f-aa6b-4946e072845a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-eb12e04b-3cd9-461f-aa6b-4946e072845a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-eb12e04b-3cd9-461f-aa6b-4946e072845a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-eb12e04b-3cd9-461f-aa6b-4946e072845a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-eb12e04b-3cd9-461f-aa6b-4946e072845a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:04 user nova-compute[72504]: INFO nova.compute.manager [None req-eb12e04b-3cd9-461f-aa6b-4946e072845a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Terminating instance
Aug 01 19:56:04 user nova-compute[72504]: DEBUG nova.compute.manager [None req-eb12e04b-3cd9-461f-aa6b-4946e072845a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 19:56:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-85aeb797-b0a7-45fc-a3d9-9ee3405254a9 req-995012c4-caf2-44b1-ae3d-15bc042d5768 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Received event network-vif-unplugged-2edbeaad-cd66-4a79-9fae-544f2a33e922 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:56:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-85aeb797-b0a7-45fc-a3d9-9ee3405254a9 req-995012c4-caf2-44b1-ae3d-15bc042d5768 service nova] Acquiring lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-85aeb797-b0a7-45fc-a3d9-9ee3405254a9 req-995012c4-caf2-44b1-ae3d-15bc042d5768 service nova] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-85aeb797-b0a7-45fc-a3d9-9ee3405254a9 req-995012c4-caf2-44b1-ae3d-15bc042d5768 service nova] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-85aeb797-b0a7-45fc-a3d9-9ee3405254a9 req-995012c4-caf2-44b1-ae3d-15bc042d5768 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] No waiting events found dispatching network-vif-unplugged-2edbeaad-cd66-4a79-9fae-544f2a33e922 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:56:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-85aeb797-b0a7-45fc-a3d9-9ee3405254a9 req-995012c4-caf2-44b1-ae3d-15bc042d5768 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Received event network-vif-unplugged-2edbeaad-cd66-4a79-9fae-544f2a33e922 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:56:04 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Instance destroyed successfully.
Aug 01 19:56:04 user nova-compute[72504]: DEBUG nova.objects.instance [None req-eb12e04b-3cd9-461f-aa6b-4946e072845a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lazy-loading 'resources' on Instance uuid 76aa3861-0ca1-4e7f-9a15-9219037bc1ee {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:56:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-eb12e04b-3cd9-461f-aa6b-4946e072845a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T19:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1959455272',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1959455272',id=4,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsHS4HasDUoe/iSAkXERl/kuVlkQf10MtX0I95kJDd3Cs0+i0zXsqFDo40azmo6oaI1FB+bIS0tTfcjcH/OnHpg7QjuwLDWmbTaGvKjolNfCML3G3Z8TuOgsM21xi2xRg==',key_name='tempest-keypair-1467874797',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:53:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da04aaa8143b44d5aa21f59a89cd57ee',ramdisk_id='',reservation_id='r-5nw6f64r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-836718209',owner_user_name='tempest-AttachVolumeShelveTestJSON-836718209-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:53:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6260679430fa4828b07bc890c62878c3',uuid=76aa3861-0ca1-4e7f-9a15-9219037bc1ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "address": "fa:16:3e:a8:fa:27", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2edbeaad-cd", "ovs_interfaceid": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:56:04 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-eb12e04b-3cd9-461f-aa6b-4946e072845a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Converting VIF {"id": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "address": "fa:16:3e:a8:fa:27", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2edbeaad-cd", "ovs_interfaceid": "2edbeaad-cd66-4a79-9fae-544f2a33e922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:56:04 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-eb12e04b-3cd9-461f-aa6b-4946e072845a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fa:27,bridge_name='br-int',has_traffic_filtering=True,id=2edbeaad-cd66-4a79-9fae-544f2a33e922,network=Network(40b3d49e-3592-411a-93d6-5a44019ef136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2edbeaad-cd') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:56:04 user nova-compute[72504]: DEBUG os_vif [None req-eb12e04b-3cd9-461f-aa6b-4946e072845a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fa:27,bridge_name='br-int',has_traffic_filtering=True,id=2edbeaad-cd66-4a79-9fae-544f2a33e922,network=Network(40b3d49e-3592-411a-93d6-5a44019ef136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2edbeaad-cd') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:56:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2edbeaad-cd, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:56:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:56:04 user nova-compute[72504]: INFO os_vif [None req-eb12e04b-3cd9-461f-aa6b-4946e072845a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fa:27,bridge_name='br-int',has_traffic_filtering=True,id=2edbeaad-cd66-4a79-9fae-544f2a33e922,network=Network(40b3d49e-3592-411a-93d6-5a44019ef136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2edbeaad-cd')
Aug 01 19:56:04 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-eb12e04b-3cd9-461f-aa6b-4946e072845a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Deleting instance files /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee_del
Aug 01 19:56:04 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-eb12e04b-3cd9-461f-aa6b-4946e072845a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Deletion of /opt/stack/data/nova/instances/76aa3861-0ca1-4e7f-9a15-9219037bc1ee_del complete
Aug 01 19:56:04 user nova-compute[72504]: INFO nova.compute.manager [None req-eb12e04b-3cd9-461f-aa6b-4946e072845a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 01 19:56:04 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-eb12e04b-3cd9-461f-aa6b-4946e072845a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 19:56:04 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 19:56:04 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 19:56:05 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:56:05 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Took 0.95 seconds to deallocate network for instance.
Aug 01 19:56:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-eb12e04b-3cd9-461f-aa6b-4946e072845a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-eb12e04b-3cd9-461f-aa6b-4946e072845a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:06 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-eb12e04b-3cd9-461f-aa6b-4946e072845a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:56:06 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-eb12e04b-3cd9-461f-aa6b-4946e072845a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:56:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-eb12e04b-3cd9-461f-aa6b-4946e072845a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:06 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-eb12e04b-3cd9-461f-aa6b-4946e072845a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Deleted allocations for instance 76aa3861-0ca1-4e7f-9a15-9219037bc1ee
Aug 01 19:56:06 user nova-compute[72504]: DEBUG nova.compute.manager [req-1033968b-fc73-4924-8c14-efda92d64ea7 req-2afcdff3-7a00-42bd-ad25-824f890f25a0 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Received event network-vif-plugged-2edbeaad-cd66-4a79-9fae-544f2a33e922 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:56:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1033968b-fc73-4924-8c14-efda92d64ea7 req-2afcdff3-7a00-42bd-ad25-824f890f25a0 service nova] Acquiring lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1033968b-fc73-4924-8c14-efda92d64ea7 req-2afcdff3-7a00-42bd-ad25-824f890f25a0 service nova] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1033968b-fc73-4924-8c14-efda92d64ea7 req-2afcdff3-7a00-42bd-ad25-824f890f25a0 service nova] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:06 user nova-compute[72504]: DEBUG nova.compute.manager [req-1033968b-fc73-4924-8c14-efda92d64ea7 req-2afcdff3-7a00-42bd-ad25-824f890f25a0 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] No waiting events found dispatching network-vif-plugged-2edbeaad-cd66-4a79-9fae-544f2a33e922 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:56:06 user nova-compute[72504]: WARNING nova.compute.manager [req-1033968b-fc73-4924-8c14-efda92d64ea7 req-2afcdff3-7a00-42bd-ad25-824f890f25a0 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Received unexpected event network-vif-plugged-2edbeaad-cd66-4a79-9fae-544f2a33e922 for instance with vm_state deleted and task_state None.
Aug 01 19:56:06 user nova-compute[72504]: DEBUG nova.compute.manager [req-1033968b-fc73-4924-8c14-efda92d64ea7 req-2afcdff3-7a00-42bd-ad25-824f890f25a0 service nova] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Received event network-vif-deleted-2edbeaad-cd66-4a79-9fae-544f2a33e922 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:56:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-eb12e04b-3cd9-461f-aa6b-4946e072845a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "76aa3861-0ca1-4e7f-9a15-9219037bc1ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.439s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yvAKXgFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:56:07 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:56:07 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:56:07 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:56:07 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:56:07 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ebe4da-18f0-4e9c-b972-27d61cc01e1b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:56:07 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d4a7fd-7557-491a-945a-222edab26a9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889] added
Aug 01 19:56:07 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b690a9df-9988-4544-85b2-ac7da49d99fb]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e58e49-e75f-4945-809f-fb90297591cc]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yvAKXgFo {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yvAKXgFo" returned: 0 in 0.027s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c9005d-f189-4f32-b3bf-1766bf900701]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yvAKXgFo'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61cf2e7-35fd-48e0-a2a7-e794feaab948]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a13bec-d295-4bbf-b755-37ff64768237]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:56:07 user nova-compute[72504]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)
Aug 01 19:56:07 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:56:07 user nova-compute[72504]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)
Aug 01 19:56:07 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9739bc-bc7f-489b-863f-fc7fef9bca8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889, portal: 172.16.0.220,3260]
Aug 01 19:56:07 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889, portal: 172.16.0.220,3260] successful.
Aug 01 19:56:07 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[380869cf-4706-432a-b45a-ea2e88e2982b]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bec4c4-23b3-437e-8b75-27b3a766de07]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:56:07 user nova-compute[72504]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)
Aug 01 19:56:07 user nova-compute[72504]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889 (non-flash)
Aug 01 19:56:07 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:56:07 user nova-compute[72504]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)
Aug 01 19:56:07 user nova-compute[72504]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889 (non-flash)
Aug 01 19:56:07 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d616f6-c019-444f-a0c6-1ac182e93376]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:07 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: None {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:56:08 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:56:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yvAKXgFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:56:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:56:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23035396233666639', 'path': '/dev/sdd'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:56:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035396233666639', 'path': '/dev/sdd'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:56:08 user nova-compute[72504]: DEBUG nova.objects.instance [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lazy-loading 'flavor' on Instance uuid cb230370-0feb-46b5-8837-35fea366b34f {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:56:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 19:56:08 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:56:08 user nova-compute[72504]:   <source dev="/dev/sdd"/>
Aug 01 19:56:08 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:56:08 user nova-compute[72504]:   <serial>bfb99db4-25ed-4fe0-8ca9-a262ba99b889</serial>
Aug 01 19:56:08 user nova-compute[72504]: </disk>
Aug 01 19:56:08 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 19:56:09 user nova-compute[72504]: INFO nova.compute.manager [None req-5e2ad82d-015d-4e23-ba91-f7b990dd58e3 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Unrescuing
Aug 01 19:56:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5e2ad82d-015d-4e23-ba91-f7b990dd58e3 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "refresh_cache-7391a8ce-7ce5-47ec-97f6-6159645688ea" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:56:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5e2ad82d-015d-4e23-ba91-f7b990dd58e3 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquired lock "refresh_cache-7391a8ce-7ce5-47ec-97f6-6159645688ea" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:56:09 user nova-compute[72504]: DEBUG nova.network.neutron [None req-5e2ad82d-015d-4e23-ba91-f7b990dd58e3 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:56:09 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:56:09 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:56:09 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] No VIF found with MAC fa:16:3e:ba:56:6f, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:56:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1485c690-03c6-4119-95e3-dc7b12c36b32 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lock "cb230370-0feb-46b5-8837-35fea366b34f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.067s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:09 user nova-compute[72504]: DEBUG nova.network.neutron [None req-5e2ad82d-015d-4e23-ba91-f7b990dd58e3 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Updating instance_info_cache with network_info: [{"id": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "address": "fa:16:3e:08:82:e6", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd06cd7-81", "ovs_interfaceid": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:56:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5e2ad82d-015d-4e23-ba91-f7b990dd58e3 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Releasing lock "refresh_cache-7391a8ce-7ce5-47ec-97f6-6159645688ea" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:56:09 user nova-compute[72504]: DEBUG nova.objects.instance [None req-5e2ad82d-015d-4e23-ba91-f7b990dd58e3 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lazy-loading 'flavor' on Instance uuid 7391a8ce-7ce5-47ec-97f6-6159645688ea {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:56:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:09 user nova-compute[72504]: DEBUG nova.compute.manager [req-06891c7c-a7e1-4890-b844-0f8cb0e8d310 req-c8068edf-5e82-483b-958f-3ab6d7d72035 service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Received event network-vif-unplugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:56:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-06891c7c-a7e1-4890-b844-0f8cb0e8d310 req-c8068edf-5e82-483b-958f-3ab6d7d72035 service nova] Acquiring lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-06891c7c-a7e1-4890-b844-0f8cb0e8d310 req-c8068edf-5e82-483b-958f-3ab6d7d72035 service nova] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-06891c7c-a7e1-4890-b844-0f8cb0e8d310 req-c8068edf-5e82-483b-958f-3ab6d7d72035 service nova] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:10 user nova-compute[72504]: DEBUG nova.compute.manager [req-06891c7c-a7e1-4890-b844-0f8cb0e8d310 req-c8068edf-5e82-483b-958f-3ab6d7d72035 service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] No waiting events found dispatching network-vif-unplugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:56:10 user nova-compute[72504]: WARNING nova.compute.manager [req-06891c7c-a7e1-4890-b844-0f8cb0e8d310 req-c8068edf-5e82-483b-958f-3ab6d7d72035 service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Received unexpected event network-vif-unplugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 for instance with vm_state rescued and task_state unrescuing.
Aug 01 19:56:10 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:10 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:10 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690919755.4206424, c9fd391d-51c0-4ef9-86cc-5ce2c76c177a => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:56:10 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] VM Stopped (Lifecycle Event)
Aug 01 19:56:10 user nova-compute[72504]: DEBUG nova.compute.manager [None req-b4682b09-69fb-40c6-8740-b5431ed27624 None None] [instance: c9fd391d-51c0-4ef9-86cc-5ce2c76c177a] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:56:10 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:10 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:10 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Instance destroyed successfully.
Aug 01 19:56:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG nova.compute.manager [req-5034b985-f949-4365-b591-f2db48ca4759 req-2250ed0f-af0b-4b3b-9660-eb3ab4a79268 service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Received event network-vif-plugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5034b985-f949-4365-b591-f2db48ca4759 req-2250ed0f-af0b-4b3b-9660-eb3ab4a79268 service nova] Acquiring lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5034b985-f949-4365-b591-f2db48ca4759 req-2250ed0f-af0b-4b3b-9660-eb3ab4a79268 service nova] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5034b985-f949-4365-b591-f2db48ca4759 req-2250ed0f-af0b-4b3b-9660-eb3ab4a79268 service nova] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG nova.compute.manager [req-5034b985-f949-4365-b591-f2db48ca4759 req-2250ed0f-af0b-4b3b-9660-eb3ab4a79268 service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] No waiting events found dispatching network-vif-plugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:56:12 user nova-compute[72504]: WARNING nova.compute.manager [req-5034b985-f949-4365-b591-f2db48ca4759 req-2250ed0f-af0b-4b3b-9660-eb3ab4a79268 service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Received unexpected event network-vif-plugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 for instance with vm_state rescued and task_state unrescuing.
Aug 01 19:56:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Acquiring lock "cb230370-0feb-46b5-8837-35fea366b34f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lock "cb230370-0feb-46b5-8837-35fea366b34f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:12 user nova-compute[72504]: INFO nova.compute.manager [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Detaching volume bfb99db4-25ed-4fe0-8ca9-a262ba99b889
Aug 01 19:56:12 user nova-compute[72504]: INFO nova.virt.block_device [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Attempting to driver detach volume bfb99db4-25ed-4fe0-8ca9-a262ba99b889 from mountpoint /dev/vdb
Aug 01 19:56:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Attempting to detach device vdb from instance cb230370-0feb-46b5-8837-35fea366b34f from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:56:12 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:56:12 user nova-compute[72504]:   <source dev="/dev/sdd"/>
Aug 01 19:56:12 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:56:12 user nova-compute[72504]:   <serial>bfb99db4-25ed-4fe0-8ca9-a262ba99b889</serial>
Aug 01 19:56:12 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 19:56:12 user nova-compute[72504]: </disk>
Aug 01 19:56:12 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:56:12 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Successfully detached device vdb from instance cb230370-0feb-46b5-8837-35fea366b34f from the persistent domain config.
Aug 01 19:56:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cb230370-0feb-46b5-8837-35fea366b34f from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:56:12 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:56:12 user nova-compute[72504]:   <source dev="/dev/sdd"/>
Aug 01 19:56:12 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:56:12 user nova-compute[72504]:   <serial>bfb99db4-25ed-4fe0-8ca9-a262ba99b889</serial>
Aug 01 19:56:12 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 19:56:12 user nova-compute[72504]: </disk>
Aug 01 19:56:12 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690919772.806429, cb230370-0feb-46b5-8837-35fea366b34f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cb230370-0feb-46b5-8837-35fea366b34f {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 19:56:12 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Successfully detached device vdb from instance cb230370-0feb-46b5-8837-35fea366b34f from the live domain config.
Aug 01 19:56:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yvAKXgFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:56:12 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:56:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d63638-5357-4320-90a8-1f5d88888f5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c741bf-6f65-4e1d-a361-506bf264bca0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:56:12 user nova-compute[72504]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)
Aug 01 19:56:12 user nova-compute[72504]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889 (non-flash)
Aug 01 19:56:12 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:56:12 user nova-compute[72504]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)
Aug 01 19:56:12 user nova-compute[72504]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889 (non-flash)
Aug 01 19:56:12 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff41aa2c670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889'): ({'sdd'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Removing single pathed devices sdd {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e408360-11a4-4530-9704-22a41c7cdc33]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c06a7a-4122-4a8f-9f0d-3a05350ded9a]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Flushing IO for device /dev/sdd {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06b7884-6144-4724-b4a7-ee0dd85ef429]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3fd614-b62f-4122-8353-a37e501e19c9]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] SCSI volumes sdd have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c457cc81-a74c-492b-a60d-3b132801f7a1]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc74b35-99bd-4e13-9866-049942e8f2f6]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889, portal: 172.16.0.220,3260]
Aug 01 19:56:13 user nova-compute[72504]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889, portal: 172.16.0.220,3260] successful.
Aug 01 19:56:13 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfb99db4-25ed-4fe0-8ca9-a262ba99b889 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f34a09f-f6fb-4a25-be27-da94d2bcd2bc]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] <== disconnect_volume: return (317ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG nova.compute.manager [req-331013a4-d999-4ea7-b613-d486fecdc99c req-78508efe-be31-4fc6-ab61-f67179efffe5 service nova] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Received event network-changed-1ae5b451-36d3-474b-b576-26b42d8dbb6d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG nova.compute.manager [req-331013a4-d999-4ea7-b613-d486fecdc99c req-78508efe-be31-4fc6-ab61-f67179efffe5 service nova] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Refreshing instance network info cache due to event network-changed-1ae5b451-36d3-474b-b576-26b42d8dbb6d. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-331013a4-d999-4ea7-b613-d486fecdc99c req-78508efe-be31-4fc6-ab61-f67179efffe5 service nova] Acquiring lock "refresh_cache-d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-331013a4-d999-4ea7-b613-d486fecdc99c req-78508efe-be31-4fc6-ab61-f67179efffe5 service nova] Acquired lock "refresh_cache-d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG nova.network.neutron [req-331013a4-d999-4ea7-b613-d486fecdc99c req-78508efe-be31-4fc6-ab61-f67179efffe5 service nova] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Refreshing network info cache for port 1ae5b451-36d3-474b-b576-26b42d8dbb6d {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG nova.network.neutron [req-331013a4-d999-4ea7-b613-d486fecdc99c req-78508efe-be31-4fc6-ab61-f67179efffe5 service nova] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Updated VIF entry in instance network info cache for port 1ae5b451-36d3-474b-b576-26b42d8dbb6d. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG nova.network.neutron [req-331013a4-d999-4ea7-b613-d486fecdc99c req-78508efe-be31-4fc6-ab61-f67179efffe5 service nova] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Updating instance_info_cache with network_info: [{"id": "1ae5b451-36d3-474b-b576-26b42d8dbb6d", "address": "fa:16:3e:9d:e3:8f", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae5b451-36", "ovs_interfaceid": "1ae5b451-36d3-474b-b576-26b42d8dbb6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-331013a4-d999-4ea7-b613-d486fecdc99c req-78508efe-be31-4fc6-ab61-f67179efffe5 service nova] Releasing lock "refresh_cache-d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG nova.objects.instance [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lazy-loading 'flavor' on Instance uuid cb230370-0feb-46b5-8837-35fea366b34f {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:56:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d7b33da2-b8af-4058-bdfb-4907527e0d4c tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lock "cb230370-0feb-46b5-8837-35fea366b34f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.779s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Removed pending event for 7391a8ce-7ce5-47ec-97f6-6159645688ea due to event {{(pid=72504) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 19:56:14 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919774.108943, 7391a8ce-7ce5-47ec-97f6-6159645688ea => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:56:14 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] VM Resumed (Lifecycle Event)
Aug 01 19:56:14 user nova-compute[72504]: DEBUG nova.compute.manager [None req-5e2ad82d-015d-4e23-ba91-f7b990dd58e3 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:56:14 user nova-compute[72504]: DEBUG nova.compute.manager [req-c91946b8-552d-40c6-b09f-db50c6959654 req-2f5db9fe-669c-451a-8c2d-7456362ad571 service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Received event network-vif-plugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:56:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c91946b8-552d-40c6-b09f-db50c6959654 req-2f5db9fe-669c-451a-8c2d-7456362ad571 service nova] Acquiring lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c91946b8-552d-40c6-b09f-db50c6959654 req-2f5db9fe-669c-451a-8c2d-7456362ad571 service nova] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c91946b8-552d-40c6-b09f-db50c6959654 req-2f5db9fe-669c-451a-8c2d-7456362ad571 service nova] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:14 user nova-compute[72504]: DEBUG nova.compute.manager [req-c91946b8-552d-40c6-b09f-db50c6959654 req-2f5db9fe-669c-451a-8c2d-7456362ad571 service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] No waiting events found dispatching network-vif-plugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:56:14 user nova-compute[72504]: WARNING nova.compute.manager [req-c91946b8-552d-40c6-b09f-db50c6959654 req-2f5db9fe-669c-451a-8c2d-7456362ad571 service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Received unexpected event network-vif-plugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 for instance with vm_state rescued and task_state unrescuing.
Aug 01 19:56:14 user nova-compute[72504]: DEBUG nova.compute.manager [req-c91946b8-552d-40c6-b09f-db50c6959654 req-2f5db9fe-669c-451a-8c2d-7456362ad571 service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Received event network-vif-plugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:56:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c91946b8-552d-40c6-b09f-db50c6959654 req-2f5db9fe-669c-451a-8c2d-7456362ad571 service nova] Acquiring lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c91946b8-552d-40c6-b09f-db50c6959654 req-2f5db9fe-669c-451a-8c2d-7456362ad571 service nova] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c91946b8-552d-40c6-b09f-db50c6959654 req-2f5db9fe-669c-451a-8c2d-7456362ad571 service nova] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:14 user nova-compute[72504]: DEBUG nova.compute.manager [req-c91946b8-552d-40c6-b09f-db50c6959654 req-2f5db9fe-669c-451a-8c2d-7456362ad571 service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] No waiting events found dispatching network-vif-plugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:56:14 user nova-compute[72504]: WARNING nova.compute.manager [req-c91946b8-552d-40c6-b09f-db50c6959654 req-2f5db9fe-669c-451a-8c2d-7456362ad571 service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Received unexpected event network-vif-plugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 for instance with vm_state rescued and task_state unrescuing.
Aug 01 19:56:14 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:56:14 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:56:14 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 19:56:14 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919774.109069, 7391a8ce-7ce5-47ec-97f6-6159645688ea => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:56:14 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] VM Started (Lifecycle Event)
Aug 01 19:56:14 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:56:14 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:56:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:15 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:56:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:15 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:56:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb230370-0feb-46b5-8837-35fea366b34f/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb230370-0feb-46b5-8837-35fea366b34f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb230370-0feb-46b5-8837-35fea366b34f/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb230370-0feb-46b5-8837-35fea366b34f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:56:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:56:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:18 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:56:18 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:56:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=7567MB free_disk=25.348804473876953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:56:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:56:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 7391a8ce-7ce5-47ec-97f6-6159645688ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:56:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:56:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 128c2981-363c-4ae9-b46d-15b5e5d9cac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:56:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 5193c770-80ca-44c3-9950-cb25c65e94e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:56:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance cb230370-0feb-46b5-8837-35fea366b34f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:56:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:56:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 88f95d20-e391-4100-93b2-da29bfcf9704 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:56:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:56:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:56:19 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:56:19 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:56:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:56:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:19 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690919764.817129, 76aa3861-0ca1-4e7f-9a15-9219037bc1ee => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:56:19 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] VM Stopped (Lifecycle Event)
Aug 01 19:56:19 user nova-compute[72504]: DEBUG nova.compute.manager [None req-d4859e01-c964-46ab-b936-d73e8ba794fb None None] [instance: 76aa3861-0ca1-4e7f-9a15-9219037bc1ee] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:56:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "9078e730-73ae-4581-901c-418ab48b20ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "9078e730-73ae-4581-901c-418ab48b20ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:20 user nova-compute[72504]: DEBUG nova.compute.manager [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 19:56:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:21 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:56:21 user nova-compute[72504]: INFO nova.compute.claims [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Claim successful on node user
Aug 01 19:56:21 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:56:21 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:56:21 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:56:21 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:56:21 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:56:21 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:56:21 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:56:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:21 user nova-compute[72504]: DEBUG nova.compute.manager [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 19:56:21 user nova-compute[72504]: DEBUG nova.compute.manager [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 19:56:21 user nova-compute[72504]: DEBUG nova.network.neutron [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 19:56:21 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 19:56:21 user nova-compute[72504]: DEBUG nova.compute.manager [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 19:56:21 user nova-compute[72504]: DEBUG nova.policy [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '451baacc96384f35bd8bbb87626ac52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cc01820f324654b0959d5fb2adefc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 19:56:21 user nova-compute[72504]: DEBUG nova.compute.manager [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 19:56:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:56:21 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Creating image(s)
Aug 01 19:56:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "/opt/stack/data/nova/instances/9078e730-73ae-4581-901c-418ab48b20ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "/opt/stack/data/nova/instances/9078e730-73ae-4581-901c-418ab48b20ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "/opt/stack/data/nova/instances/9078e730-73ae-4581-901c-418ab48b20ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.148s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.134s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/9078e730-73ae-4581-901c-418ab48b20ff/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/9078e730-73ae-4581-901c-418ab48b20ff/disk 1073741824" returned: 0 in 0.059s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:22 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9078e730-73ae-4581-901c-418ab48b20ff/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 19:56:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9078e730-73ae-4581-901c-418ab48b20ff/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:22 user nova-compute[72504]: DEBUG nova.network.neutron [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Successfully created port: 4398feea-5235-4138-a257-4c557d89ae8f {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:56:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9078e730-73ae-4581-901c-418ab48b20ff/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:22 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Cannot resize image /opt/stack/data/nova/instances/9078e730-73ae-4581-901c-418ab48b20ff/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 19:56:22 user nova-compute[72504]: DEBUG nova.objects.instance [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lazy-loading 'migration_context' on Instance uuid 9078e730-73ae-4581-901c-418ab48b20ff {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:56:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 19:56:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Ensure instance console log exists: /opt/stack/data/nova/instances/9078e730-73ae-4581-901c-418ab48b20ff/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:56:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:22 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:56:22 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:56:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Acquiring lock "dad07310-5f62-48f9-a17f-6e960dcf5060" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "dad07310-5f62-48f9-a17f-6e960dcf5060" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:22 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 19:56:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-5193c770-80ca-44c3-9950-cb25c65e94e8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:56:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-5193c770-80ca-44c3-9950-cb25c65e94e8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:56:22 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 19:56:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:22 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:56:22 user nova-compute[72504]: INFO nova.compute.claims [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Claim successful on node user
Aug 01 19:56:23 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Updating instance_info_cache with network_info: [{"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG nova.network.neutron [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 19:56:23 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 19:56:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-5193c770-80ca-44c3-9950-cb25c65e94e8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG nova.network.neutron [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Successfully updated port: 4398feea-5235-4138-a257-4c557d89ae8f {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "refresh_cache-9078e730-73ae-4581-901c-418ab48b20ff" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquired lock "refresh_cache-9078e730-73ae-4581-901c-418ab48b20ff" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG nova.network.neutron [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:56:23 user nova-compute[72504]: INFO nova.virt.block_device [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Booting with volume 313801ef-59d1-4715-8154-c9f8e67c5c51 at /dev/vda
Aug 01 19:56:23 user nova-compute[72504]: DEBUG nova.policy [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '97ef13eef2a345909187312f5a62e0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9540d878e5ea4bfda3d342e5a78035f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG nova.compute.manager [req-4240d64f-564e-4023-a240-b46dfec54941 req-c3f03589-9982-4a01-bbfd-05e2d3371bd9 service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Received event network-changed-4398feea-5235-4138-a257-4c557d89ae8f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG nova.compute.manager [req-4240d64f-564e-4023-a240-b46dfec54941 req-c3f03589-9982-4a01-bbfd-05e2d3371bd9 service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Refreshing instance network info cache due to event network-changed-4398feea-5235-4138-a257-4c557d89ae8f. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4240d64f-564e-4023-a240-b46dfec54941 req-c3f03589-9982-4a01-bbfd-05e2d3371bd9 service nova] Acquiring lock "refresh_cache-9078e730-73ae-4581-901c-418ab48b20ff" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG os_brick.utils [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[259321db-459c-4d0f-be61-ea4dffd822cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG nova.network.neutron [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e3e0dc-dd2b-4e2f-9afd-da927baeb076]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43b6b83-6f5d-4402-8607-d87546262d8c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[08593c53-111d-4c37-a8e9-a57c37003af9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:56:23 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:56:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a631c43-a4a1-4120-abc6-51ed562db30a]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG os_brick.utils [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:56:23 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Updating existing volume attachment record: 33906cdc-981a-4002-bf31-0e1d857dd6f9 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Acquiring lock "348a0df3-4865-46b2-a618-a8a519b51c3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Lock "348a0df3-4865-46b2-a618-a8a519b51c3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:56:24 user nova-compute[72504]: INFO nova.compute.claims [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Claim successful on node user
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.network.neutron [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Updating instance_info_cache with network_info: [{"id": "4398feea-5235-4138-a257-4c557d89ae8f", "address": "fa:16:3e:98:07:e4", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4398feea-52", "ovs_interfaceid": "4398feea-5235-4138-a257-4c557d89ae8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Releasing lock "refresh_cache-9078e730-73ae-4581-901c-418ab48b20ff" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.compute.manager [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Instance network_info: |[{"id": "4398feea-5235-4138-a257-4c557d89ae8f", "address": "fa:16:3e:98:07:e4", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4398feea-52", "ovs_interfaceid": "4398feea-5235-4138-a257-4c557d89ae8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4240d64f-564e-4023-a240-b46dfec54941 req-c3f03589-9982-4a01-bbfd-05e2d3371bd9 service nova] Acquired lock "refresh_cache-9078e730-73ae-4581-901c-418ab48b20ff" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.network.neutron [req-4240d64f-564e-4023-a240-b46dfec54941 req-c3f03589-9982-4a01-bbfd-05e2d3371bd9 service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Refreshing network info cache for port 4398feea-5235-4138-a257-4c557d89ae8f {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Start _get_guest_xml network_info=[{"id": "4398feea-5235-4138-a257-4c557d89ae8f", "address": "fa:16:3e:98:07:e4", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4398feea-52", "ovs_interfaceid": "4398feea-5235-4138-a257-4c557d89ae8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:56:24 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:56:24 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:56:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-572656543',display_name='tempest-AttachVolumeNegativeTest-server-572656543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-572656543',id=19,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+olELGZvZIbN0OYRQuQIBgcyHlJqyuM1COdASqQ4TQxNqRSVgaNGVUBWrcCsBKRHRKhvNPxHwZq+0xCHe9ffukcsUTDvB3bxakk8Ep9y/EZWxsp84oiv2ovz/BpQ9azw==',key_name='tempest-keypair-1722664367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15cc01820f324654b0959d5fb2adefc3',ramdisk_id='',reservation_id='r-wjpjqptb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2109955223',owner_user_name='tempest-AttachVolumeNegativeTest-2109955223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:56:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='451baacc96384f35bd8bbb87626ac52d',uuid=9078e730-73ae-4581-901c-418ab48b20ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4398feea-5235-4138-a257-4c557d89ae8f", "address": "fa:16:3e:98:07:e4", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4398feea-52", "ovs_interfaceid": "4398feea-5235-4138-a257-4c557d89ae8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Converting VIF {"id": "4398feea-5235-4138-a257-4c557d89ae8f", "address": "fa:16:3e:98:07:e4", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4398feea-52", "ovs_interfaceid": "4398feea-5235-4138-a257-4c557d89ae8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:07:e4,bridge_name='br-int',has_traffic_filtering=True,id=4398feea-5235-4138-a257-4c557d89ae8f,network=Network(67292f1d-2643-4cfa-aaf6-0a698d87bfd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4398feea-52') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.objects.instance [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lazy-loading 'pci_devices' on Instance uuid 9078e730-73ae-4581-901c-418ab48b20ff {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:56:24 user nova-compute[72504]:   <uuid>9078e730-73ae-4581-901c-418ab48b20ff</uuid>
Aug 01 19:56:24 user nova-compute[72504]:   <name>instance-00000013</name>
Aug 01 19:56:24 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:56:24 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:56:24 user nova-compute[72504]:   <metadata>
Aug 01 19:56:24 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:56:24 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:56:24 user nova-compute[72504]:       <nova:name>tempest-AttachVolumeNegativeTest-server-572656543</nova:name>
Aug 01 19:56:24 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:56:24</nova:creationTime>
Aug 01 19:56:24 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:56:24 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:56:24 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:56:24 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:56:24 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:56:24 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:56:24 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:56:24 user nova-compute[72504]:       <nova:owner>
Aug 01 19:56:24 user nova-compute[72504]:         <nova:user uuid="451baacc96384f35bd8bbb87626ac52d">tempest-AttachVolumeNegativeTest-2109955223-project-member</nova:user>
Aug 01 19:56:24 user nova-compute[72504]:         <nova:project uuid="15cc01820f324654b0959d5fb2adefc3">tempest-AttachVolumeNegativeTest-2109955223</nova:project>
Aug 01 19:56:24 user nova-compute[72504]:       </nova:owner>
Aug 01 19:56:24 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:56:24 user nova-compute[72504]:       <nova:ports>
Aug 01 19:56:24 user nova-compute[72504]:         <nova:port uuid="4398feea-5235-4138-a257-4c557d89ae8f">
Aug 01 19:56:24 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 19:56:24 user nova-compute[72504]:         </nova:port>
Aug 01 19:56:24 user nova-compute[72504]:       </nova:ports>
Aug 01 19:56:24 user nova-compute[72504]:     </nova:instance>
Aug 01 19:56:24 user nova-compute[72504]:   </metadata>
Aug 01 19:56:24 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:56:24 user nova-compute[72504]:     <system>
Aug 01 19:56:24 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:56:24 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:56:24 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:56:24 user nova-compute[72504]:       <entry name="serial">9078e730-73ae-4581-901c-418ab48b20ff</entry>
Aug 01 19:56:24 user nova-compute[72504]:       <entry name="uuid">9078e730-73ae-4581-901c-418ab48b20ff</entry>
Aug 01 19:56:24 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:56:24 user nova-compute[72504]:     </system>
Aug 01 19:56:24 user nova-compute[72504]:   </sysinfo>
Aug 01 19:56:24 user nova-compute[72504]:   <os>
Aug 01 19:56:24 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:56:24 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:56:24 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:56:24 user nova-compute[72504]:   </os>
Aug 01 19:56:24 user nova-compute[72504]:   <features>
Aug 01 19:56:24 user nova-compute[72504]:     <acpi/>
Aug 01 19:56:24 user nova-compute[72504]:     <apic/>
Aug 01 19:56:24 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:56:24 user nova-compute[72504]:   </features>
Aug 01 19:56:24 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:56:24 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:56:24 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:56:24 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:56:24 user nova-compute[72504]:   </clock>
Aug 01 19:56:24 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:56:24 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:56:24 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:56:24 user nova-compute[72504]:   </cpu>
Aug 01 19:56:24 user nova-compute[72504]:   <devices>
Aug 01 19:56:24 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:56:24 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:56:24 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/9078e730-73ae-4581-901c-418ab48b20ff/disk"/>
Aug 01 19:56:24 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:56:24 user nova-compute[72504]:     </disk>
Aug 01 19:56:24 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:56:24 user nova-compute[72504]:       <mac address="fa:16:3e:98:07:e4"/>
Aug 01 19:56:24 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:56:24 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:56:24 user nova-compute[72504]:       <target dev="tap4398feea-52"/>
Aug 01 19:56:24 user nova-compute[72504]:     </interface>
Aug 01 19:56:24 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:56:24 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/9078e730-73ae-4581-901c-418ab48b20ff/console.log" append="off"/>
Aug 01 19:56:24 user nova-compute[72504]:     </serial>
Aug 01 19:56:24 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:56:24 user nova-compute[72504]:     <video>
Aug 01 19:56:24 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:56:24 user nova-compute[72504]:     </video>
Aug 01 19:56:24 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:56:24 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:56:24 user nova-compute[72504]:     </rng>
Aug 01 19:56:24 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:56:24 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:56:24 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:56:24 user nova-compute[72504]:     </memballoon>
Aug 01 19:56:24 user nova-compute[72504]:   </devices>
Aug 01 19:56:24 user nova-compute[72504]: </domain>
Aug 01 19:56:24 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:56:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-572656543',display_name='tempest-AttachVolumeNegativeTest-server-572656543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-572656543',id=19,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+olELGZvZIbN0OYRQuQIBgcyHlJqyuM1COdASqQ4TQxNqRSVgaNGVUBWrcCsBKRHRKhvNPxHwZq+0xCHe9ffukcsUTDvB3bxakk8Ep9y/EZWxsp84oiv2ovz/BpQ9azw==',key_name='tempest-keypair-1722664367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15cc01820f324654b0959d5fb2adefc3',ramdisk_id='',reservation_id='r-wjpjqptb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2109955223',owner_user_name='tempest-AttachVolumeNegativeTest-2109955223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:56:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='451baacc96384f35bd8bbb87626ac52d',uuid=9078e730-73ae-4581-901c-418ab48b20ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4398feea-5235-4138-a257-4c557d89ae8f", "address": "fa:16:3e:98:07:e4", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4398feea-52", "ovs_interfaceid": "4398feea-5235-4138-a257-4c557d89ae8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Converting VIF {"id": "4398feea-5235-4138-a257-4c557d89ae8f", "address": "fa:16:3e:98:07:e4", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4398feea-52", "ovs_interfaceid": "4398feea-5235-4138-a257-4c557d89ae8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:07:e4,bridge_name='br-int',has_traffic_filtering=True,id=4398feea-5235-4138-a257-4c557d89ae8f,network=Network(67292f1d-2643-4cfa-aaf6-0a698d87bfd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4398feea-52') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG os_vif [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:07:e4,bridge_name='br-int',has_traffic_filtering=True,id=4398feea-5235-4138-a257-4c557d89ae8f,network=Network(67292f1d-2643-4cfa-aaf6-0a698d87bfd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4398feea-52') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4398feea-52, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4398feea-52, col_values=(('external_ids', {'iface-id': '4398feea-5235-4138-a257-4c557d89ae8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:07:e4', 'vm-uuid': '9078e730-73ae-4581-901c-418ab48b20ff'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:24 user nova-compute[72504]: INFO os_vif [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:07:e4,bridge_name='br-int',has_traffic_filtering=True,id=4398feea-5235-4138-a257-4c557d89ae8f,network=Network(67292f1d-2643-4cfa-aaf6-0a698d87bfd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4398feea-52')
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.network.neutron [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Successfully created port: 6f553f59-1aca-4d1a-af20-0228b74af2f8 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] No VIF found with MAC fa:16:3e:98:07:e4, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 19:56:24 user nova-compute[72504]: DEBUG nova.network.neutron [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 19:56:25 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 19:56:25 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG nova.network.neutron [req-4240d64f-564e-4023-a240-b46dfec54941 req-c3f03589-9982-4a01-bbfd-05e2d3371bd9 service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Updated VIF entry in instance network info cache for port 4398feea-5235-4138-a257-4c557d89ae8f. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG nova.network.neutron [req-4240d64f-564e-4023-a240-b46dfec54941 req-c3f03589-9982-4a01-bbfd-05e2d3371bd9 service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Updating instance_info_cache with network_info: [{"id": "4398feea-5235-4138-a257-4c557d89ae8f", "address": "fa:16:3e:98:07:e4", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4398feea-52", "ovs_interfaceid": "4398feea-5235-4138-a257-4c557d89ae8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4240d64f-564e-4023-a240-b46dfec54941 req-c3f03589-9982-4a01-bbfd-05e2d3371bd9 service nova] Releasing lock "refresh_cache-9078e730-73ae-4581-901c-418ab48b20ff" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:56:25 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Creating image(s)
Aug 01 19:56:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Acquiring lock "/opt/stack/data/nova/instances/348a0df3-4865-46b2-a618-a8a519b51c3a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Lock "/opt/stack/data/nova/instances/348a0df3-4865-46b2-a618-a8a519b51c3a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Lock "/opt/stack/data/nova/instances/348a0df3-4865-46b2-a618-a8a519b51c3a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG nova.policy [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bbf49580d2404bb4a6da432a1a1cb400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d19948bb5cd45aea5387d3d85e3a857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.136s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/348a0df3-4865-46b2-a618-a8a519b51c3a/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG nova.network.neutron [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Successfully updated port: 6f553f59-1aca-4d1a-af20-0228b74af2f8 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG nova.compute.manager [req-4f35c25b-0d0e-473d-88ea-7b309e566d3a req-18f93a7b-0d39-449b-a74a-bdbeb9235d4f service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Received event network-changed-6f553f59-1aca-4d1a-af20-0228b74af2f8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG nova.compute.manager [req-4f35c25b-0d0e-473d-88ea-7b309e566d3a req-18f93a7b-0d39-449b-a74a-bdbeb9235d4f service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Refreshing instance network info cache due to event network-changed-6f553f59-1aca-4d1a-af20-0228b74af2f8. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4f35c25b-0d0e-473d-88ea-7b309e566d3a req-18f93a7b-0d39-449b-a74a-bdbeb9235d4f service nova] Acquiring lock "refresh_cache-dad07310-5f62-48f9-a17f-6e960dcf5060" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4f35c25b-0d0e-473d-88ea-7b309e566d3a req-18f93a7b-0d39-449b-a74a-bdbeb9235d4f service nova] Acquired lock "refresh_cache-dad07310-5f62-48f9-a17f-6e960dcf5060" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG nova.network.neutron [req-4f35c25b-0d0e-473d-88ea-7b309e566d3a req-18f93a7b-0d39-449b-a74a-bdbeb9235d4f service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Refreshing network info cache for port 6f553f59-1aca-4d1a-af20-0228b74af2f8 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/348a0df3-4865-46b2-a618-a8a519b51c3a/disk 1073741824" returned: 0 in 0.058s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Acquiring lock "refresh_cache-dad07310-5f62-48f9-a17f-6e960dcf5060" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG nova.network.neutron [req-4f35c25b-0d0e-473d-88ea-7b309e566d3a req-18f93a7b-0d39-449b-a74a-bdbeb9235d4f service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.136s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Checking if we can resize image /opt/stack/data/nova/instances/348a0df3-4865-46b2-a618-a8a519b51c3a/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/348a0df3-4865-46b2-a618-a8a519b51c3a/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/348a0df3-4865-46b2-a618-a8a519b51c3a/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Cannot resize image /opt/stack/data/nova/instances/348a0df3-4865-46b2-a618-a8a519b51c3a/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG nova.objects.instance [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Lazy-loading 'migration_context' on Instance uuid 348a0df3-4865-46b2-a618-a8a519b51c3a {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG nova.network.neutron [req-4f35c25b-0d0e-473d-88ea-7b309e566d3a req-18f93a7b-0d39-449b-a74a-bdbeb9235d4f service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Ensure instance console log exists: /opt/stack/data/nova/instances/348a0df3-4865-46b2-a618-a8a519b51c3a/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4f35c25b-0d0e-473d-88ea-7b309e566d3a req-18f93a7b-0d39-449b-a74a-bdbeb9235d4f service nova] Releasing lock "refresh_cache-dad07310-5f62-48f9-a17f-6e960dcf5060" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Acquired lock "refresh_cache-dad07310-5f62-48f9-a17f-6e960dcf5060" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG nova.network.neutron [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG nova.network.neutron [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:56:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:26 user nova-compute[72504]: DEBUG nova.network.neutron [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Successfully created port: 26948185-b1bd-4055-b9c0-fdc3f580e619 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:56:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:26 user nova-compute[72504]: DEBUG nova.network.neutron [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Updating instance_info_cache with network_info: [{"id": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "address": "fa:16:3e:a0:c5:9b", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f553f59-1a", "ovs_interfaceid": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:56:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Releasing lock "refresh_cache-dad07310-5f62-48f9-a17f-6e960dcf5060" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:56:26 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Instance network_info: |[{"id": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "address": "fa:16:3e:a0:c5:9b", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f553f59-1a", "ovs_interfaceid": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 19:56:26 user nova-compute[72504]: DEBUG nova.compute.manager [req-1226ee4e-5676-4279-9dc7-e62f9c57fda5 req-e9f7bd67-5edf-4f90-8833-7581ed66cc07 service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Received event network-vif-plugged-4398feea-5235-4138-a257-4c557d89ae8f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:56:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1226ee4e-5676-4279-9dc7-e62f9c57fda5 req-e9f7bd67-5edf-4f90-8833-7581ed66cc07 service nova] Acquiring lock "9078e730-73ae-4581-901c-418ab48b20ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1226ee4e-5676-4279-9dc7-e62f9c57fda5 req-e9f7bd67-5edf-4f90-8833-7581ed66cc07 service nova] Lock "9078e730-73ae-4581-901c-418ab48b20ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1226ee4e-5676-4279-9dc7-e62f9c57fda5 req-e9f7bd67-5edf-4f90-8833-7581ed66cc07 service nova] Lock "9078e730-73ae-4581-901c-418ab48b20ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:26 user nova-compute[72504]: DEBUG nova.compute.manager [req-1226ee4e-5676-4279-9dc7-e62f9c57fda5 req-e9f7bd67-5edf-4f90-8833-7581ed66cc07 service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] No waiting events found dispatching network-vif-plugged-4398feea-5235-4138-a257-4c557d89ae8f {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:56:26 user nova-compute[72504]: WARNING nova.compute.manager [req-1226ee4e-5676-4279-9dc7-e62f9c57fda5 req-e9f7bd67-5edf-4f90-8833-7581ed66cc07 service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Received unexpected event network-vif-plugged-4398feea-5235-4138-a257-4c557d89ae8f for instance with vm_state building and task_state spawning.
Aug 01 19:56:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.network.neutron [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Successfully updated port: 26948185-b1bd-4055-b9c0-fdc3f580e619 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Acquiring lock "refresh_cache-348a0df3-4865-46b2-a618-a8a519b51c3a" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Acquired lock "refresh_cache-348a0df3-4865-46b2-a618-a8a519b51c3a" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.network.neutron [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.network.neutron [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.network.neutron [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Updating instance_info_cache with network_info: [{"id": "26948185-b1bd-4055-b9c0-fdc3f580e619", "address": "fa:16:3e:b0:53:85", "network": {"id": "0cdf7e28-364b-4bad-909a-04203f8a82aa", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1f3ccc9682a3432089e1cf9400f15af5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26948185-b1", "ovs_interfaceid": "26948185-b1bd-4055-b9c0-fdc3f580e619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Releasing lock "refresh_cache-348a0df3-4865-46b2-a618-a8a519b51c3a" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Instance network_info: |[{"id": "26948185-b1bd-4055-b9c0-fdc3f580e619", "address": "fa:16:3e:b0:53:85", "network": {"id": "0cdf7e28-364b-4bad-909a-04203f8a82aa", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1f3ccc9682a3432089e1cf9400f15af5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26948185-b1", "ovs_interfaceid": "26948185-b1bd-4055-b9c0-fdc3f580e619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Start _get_guest_xml network_info=[{"id": "26948185-b1bd-4055-b9c0-fdc3f580e619", "address": "fa:16:3e:b0:53:85", "network": {"id": "0cdf7e28-364b-4bad-909a-04203f8a82aa", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1f3ccc9682a3432089e1cf9400f15af5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26948185-b1", "ovs_interfaceid": "26948185-b1bd-4055-b9c0-fdc3f580e619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:56:27 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:56:27 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:56:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1119823466',display_name='tempest-VolumesNegativeTest-instance-1119823466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1119823466',id=21,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d19948bb5cd45aea5387d3d85e3a857',ramdisk_id='',reservation_id='r-r78skqk8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1554442262',owner_user_name='tempest-VolumesNegativeTest-1554442262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:56:25Z,user_data=None,user_id='bbf49580d2404bb4a6da432a1a1cb400',uuid=348a0df3-4865-46b2-a618-a8a519b51c3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26948185-b1bd-4055-b9c0-fdc3f580e619", "address": "fa:16:3e:b0:53:85", "network": {"id": "0cdf7e28-364b-4bad-909a-04203f8a82aa", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1f3ccc9682a3432089e1cf9400f15af5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26948185-b1", "ovs_interfaceid": "26948185-b1bd-4055-b9c0-fdc3f580e619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Converting VIF {"id": "26948185-b1bd-4055-b9c0-fdc3f580e619", "address": "fa:16:3e:b0:53:85", "network": {"id": "0cdf7e28-364b-4bad-909a-04203f8a82aa", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1f3ccc9682a3432089e1cf9400f15af5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26948185-b1", "ovs_interfaceid": "26948185-b1bd-4055-b9c0-fdc3f580e619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:85,bridge_name='br-int',has_traffic_filtering=True,id=26948185-b1bd-4055-b9c0-fdc3f580e619,network=Network(0cdf7e28-364b-4bad-909a-04203f8a82aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26948185-b1') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.objects.instance [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Lazy-loading 'pci_devices' on Instance uuid 348a0df3-4865-46b2-a618-a8a519b51c3a {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:56:27 user nova-compute[72504]:   <uuid>348a0df3-4865-46b2-a618-a8a519b51c3a</uuid>
Aug 01 19:56:27 user nova-compute[72504]:   <name>instance-00000015</name>
Aug 01 19:56:27 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:56:27 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:56:27 user nova-compute[72504]:   <metadata>
Aug 01 19:56:27 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:56:27 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:56:27 user nova-compute[72504]:       <nova:name>tempest-VolumesNegativeTest-instance-1119823466</nova:name>
Aug 01 19:56:27 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:56:27</nova:creationTime>
Aug 01 19:56:27 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:56:27 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:56:27 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:56:27 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:56:27 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:56:27 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:56:27 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:56:27 user nova-compute[72504]:       <nova:owner>
Aug 01 19:56:27 user nova-compute[72504]:         <nova:user uuid="bbf49580d2404bb4a6da432a1a1cb400">tempest-VolumesNegativeTest-1554442262-project-member</nova:user>
Aug 01 19:56:27 user nova-compute[72504]:         <nova:project uuid="0d19948bb5cd45aea5387d3d85e3a857">tempest-VolumesNegativeTest-1554442262</nova:project>
Aug 01 19:56:27 user nova-compute[72504]:       </nova:owner>
Aug 01 19:56:27 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:56:27 user nova-compute[72504]:       <nova:ports>
Aug 01 19:56:27 user nova-compute[72504]:         <nova:port uuid="26948185-b1bd-4055-b9c0-fdc3f580e619">
Aug 01 19:56:27 user nova-compute[72504]:           <nova:ip type="fixed" address="192.168.233.136" ipVersion="4"/>
Aug 01 19:56:27 user nova-compute[72504]:         </nova:port>
Aug 01 19:56:27 user nova-compute[72504]:       </nova:ports>
Aug 01 19:56:27 user nova-compute[72504]:     </nova:instance>
Aug 01 19:56:27 user nova-compute[72504]:   </metadata>
Aug 01 19:56:27 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:56:27 user nova-compute[72504]:     <system>
Aug 01 19:56:27 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:56:27 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:56:27 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:56:27 user nova-compute[72504]:       <entry name="serial">348a0df3-4865-46b2-a618-a8a519b51c3a</entry>
Aug 01 19:56:27 user nova-compute[72504]:       <entry name="uuid">348a0df3-4865-46b2-a618-a8a519b51c3a</entry>
Aug 01 19:56:27 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:56:27 user nova-compute[72504]:     </system>
Aug 01 19:56:27 user nova-compute[72504]:   </sysinfo>
Aug 01 19:56:27 user nova-compute[72504]:   <os>
Aug 01 19:56:27 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:56:27 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:56:27 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:56:27 user nova-compute[72504]:   </os>
Aug 01 19:56:27 user nova-compute[72504]:   <features>
Aug 01 19:56:27 user nova-compute[72504]:     <acpi/>
Aug 01 19:56:27 user nova-compute[72504]:     <apic/>
Aug 01 19:56:27 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:56:27 user nova-compute[72504]:   </features>
Aug 01 19:56:27 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:56:27 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:56:27 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:56:27 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:56:27 user nova-compute[72504]:   </clock>
Aug 01 19:56:27 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:56:27 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:56:27 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:56:27 user nova-compute[72504]:   </cpu>
Aug 01 19:56:27 user nova-compute[72504]:   <devices>
Aug 01 19:56:27 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:56:27 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:56:27 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/348a0df3-4865-46b2-a618-a8a519b51c3a/disk"/>
Aug 01 19:56:27 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:56:27 user nova-compute[72504]:     </disk>
Aug 01 19:56:27 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:56:27 user nova-compute[72504]:       <mac address="fa:16:3e:b0:53:85"/>
Aug 01 19:56:27 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:56:27 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:56:27 user nova-compute[72504]:       <target dev="tap26948185-b1"/>
Aug 01 19:56:27 user nova-compute[72504]:     </interface>
Aug 01 19:56:27 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:56:27 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/348a0df3-4865-46b2-a618-a8a519b51c3a/console.log" append="off"/>
Aug 01 19:56:27 user nova-compute[72504]:     </serial>
Aug 01 19:56:27 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:56:27 user nova-compute[72504]:     <video>
Aug 01 19:56:27 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:56:27 user nova-compute[72504]:     </video>
Aug 01 19:56:27 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:56:27 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:56:27 user nova-compute[72504]:     </rng>
Aug 01 19:56:27 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:56:27 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:56:27 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:56:27 user nova-compute[72504]:     </memballoon>
Aug 01 19:56:27 user nova-compute[72504]:   </devices>
Aug 01 19:56:27 user nova-compute[72504]: </domain>
Aug 01 19:56:27 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:56:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1119823466',display_name='tempest-VolumesNegativeTest-instance-1119823466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1119823466',id=21,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d19948bb5cd45aea5387d3d85e3a857',ramdisk_id='',reservation_id='r-r78skqk8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1554442262',owner_user_name='tempest-VolumesNegativeTest-1554442262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:56:25Z,user_data=None,user_id='bbf49580d2404bb4a6da432a1a1cb400',uuid=348a0df3-4865-46b2-a618-a8a519b51c3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26948185-b1bd-4055-b9c0-fdc3f580e619", "address": "fa:16:3e:b0:53:85", "network": {"id": "0cdf7e28-364b-4bad-909a-04203f8a82aa", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1f3ccc9682a3432089e1cf9400f15af5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26948185-b1", "ovs_interfaceid": "26948185-b1bd-4055-b9c0-fdc3f580e619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Converting VIF {"id": "26948185-b1bd-4055-b9c0-fdc3f580e619", "address": "fa:16:3e:b0:53:85", "network": {"id": "0cdf7e28-364b-4bad-909a-04203f8a82aa", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1f3ccc9682a3432089e1cf9400f15af5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26948185-b1", "ovs_interfaceid": "26948185-b1bd-4055-b9c0-fdc3f580e619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:85,bridge_name='br-int',has_traffic_filtering=True,id=26948185-b1bd-4055-b9c0-fdc3f580e619,network=Network(0cdf7e28-364b-4bad-909a-04203f8a82aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26948185-b1') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG os_vif [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:85,bridge_name='br-int',has_traffic_filtering=True,id=26948185-b1bd-4055-b9c0-fdc3f580e619,network=Network(0cdf7e28-364b-4bad-909a-04203f8a82aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26948185-b1') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26948185-b1, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap26948185-b1, col_values=(('external_ids', {'iface-id': '26948185-b1bd-4055-b9c0-fdc3f580e619', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:53:85', 'vm-uuid': '348a0df3-4865-46b2-a618-a8a519b51c3a'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:27 user nova-compute[72504]: INFO os_vif [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:85,bridge_name='br-int',has_traffic_filtering=True,id=26948185-b1bd-4055-b9c0-fdc3f580e619,network=Network(0cdf7e28-364b-4bad-909a-04203f8a82aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26948185-b1')
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:56:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] No VIF found with MAC fa:16:3e:b0:53:85, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:56:28 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919788.200271, 9078e730-73ae-4581-901c-418ab48b20ff => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:56:28 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] VM Resumed (Lifecycle Event)
Aug 01 19:56:28 user nova-compute[72504]: DEBUG nova.compute.manager [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:56:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:56:28 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Instance spawned successfully.
Aug 01 19:56:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 19:56:28 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:56:28 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:56:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:56:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:56:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:56:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:56:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:56:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:56:28 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:56:28 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919788.2014906, 9078e730-73ae-4581-901c-418ab48b20ff => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:56:28 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] VM Started (Lifecycle Event)
Aug 01 19:56:28 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:56:28 user nova-compute[72504]: INFO nova.compute.manager [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Took 6.64 seconds to spawn the instance on the hypervisor.
Aug 01 19:56:28 user nova-compute[72504]: DEBUG nova.compute.manager [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:56:28 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:56:28 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:56:28 user nova-compute[72504]: INFO nova.compute.manager [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Took 7.43 seconds to build instance.
Aug 01 19:56:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-40f9cca4-925b-4890-9a89-92b8060977b1 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "9078e730-73ae-4581-901c-418ab48b20ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.517s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:28 user nova-compute[72504]: DEBUG nova.compute.manager [req-53a17847-2d38-4d94-94f2-63554ecfee9b req-b4fa2806-db13-40a9-aca4-8160f267ff47 service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Received event network-vif-plugged-4398feea-5235-4138-a257-4c557d89ae8f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:56:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-53a17847-2d38-4d94-94f2-63554ecfee9b req-b4fa2806-db13-40a9-aca4-8160f267ff47 service nova] Acquiring lock "9078e730-73ae-4581-901c-418ab48b20ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-53a17847-2d38-4d94-94f2-63554ecfee9b req-b4fa2806-db13-40a9-aca4-8160f267ff47 service nova] Lock "9078e730-73ae-4581-901c-418ab48b20ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-53a17847-2d38-4d94-94f2-63554ecfee9b req-b4fa2806-db13-40a9-aca4-8160f267ff47 service nova] Lock "9078e730-73ae-4581-901c-418ab48b20ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:28 user nova-compute[72504]: DEBUG nova.compute.manager [req-53a17847-2d38-4d94-94f2-63554ecfee9b req-b4fa2806-db13-40a9-aca4-8160f267ff47 service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] No waiting events found dispatching network-vif-plugged-4398feea-5235-4138-a257-4c557d89ae8f {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:56:28 user nova-compute[72504]: WARNING nova.compute.manager [req-53a17847-2d38-4d94-94f2-63554ecfee9b req-b4fa2806-db13-40a9-aca4-8160f267ff47 service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Received unexpected event network-vif-plugged-4398feea-5235-4138-a257-4c557d89ae8f for instance with vm_state active and task_state None.
Aug 01 19:56:28 user nova-compute[72504]: DEBUG nova.compute.manager [req-53a17847-2d38-4d94-94f2-63554ecfee9b req-b4fa2806-db13-40a9-aca4-8160f267ff47 service nova] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Received event network-changed-26948185-b1bd-4055-b9c0-fdc3f580e619 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:56:28 user nova-compute[72504]: DEBUG nova.compute.manager [req-53a17847-2d38-4d94-94f2-63554ecfee9b req-b4fa2806-db13-40a9-aca4-8160f267ff47 service nova] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Refreshing instance network info cache due to event network-changed-26948185-b1bd-4055-b9c0-fdc3f580e619. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:56:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-53a17847-2d38-4d94-94f2-63554ecfee9b req-b4fa2806-db13-40a9-aca4-8160f267ff47 service nova] Acquiring lock "refresh_cache-348a0df3-4865-46b2-a618-a8a519b51c3a" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:56:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-53a17847-2d38-4d94-94f2-63554ecfee9b req-b4fa2806-db13-40a9-aca4-8160f267ff47 service nova] Acquired lock "refresh_cache-348a0df3-4865-46b2-a618-a8a519b51c3a" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:56:28 user nova-compute[72504]: DEBUG nova.network.neutron [req-53a17847-2d38-4d94-94f2-63554ecfee9b req-b4fa2806-db13-40a9-aca4-8160f267ff47 service nova] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Refreshing network info cache for port 26948185-b1bd-4055-b9c0-fdc3f580e619 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:56:29 user nova-compute[72504]: DEBUG nova.network.neutron [req-53a17847-2d38-4d94-94f2-63554ecfee9b req-b4fa2806-db13-40a9-aca4-8160f267ff47 service nova] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Updated VIF entry in instance network info cache for port 26948185-b1bd-4055-b9c0-fdc3f580e619. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:56:29 user nova-compute[72504]: DEBUG nova.network.neutron [req-53a17847-2d38-4d94-94f2-63554ecfee9b req-b4fa2806-db13-40a9-aca4-8160f267ff47 service nova] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Updating instance_info_cache with network_info: [{"id": "26948185-b1bd-4055-b9c0-fdc3f580e619", "address": "fa:16:3e:b0:53:85", "network": {"id": "0cdf7e28-364b-4bad-909a-04203f8a82aa", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1f3ccc9682a3432089e1cf9400f15af5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26948185-b1", "ovs_interfaceid": "26948185-b1bd-4055-b9c0-fdc3f580e619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:56:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-53a17847-2d38-4d94-94f2-63554ecfee9b req-b4fa2806-db13-40a9-aca4-8160f267ff47 service nova] Releasing lock "refresh_cache-348a0df3-4865-46b2-a618-a8a519b51c3a" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:56:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:29 user nova-compute[72504]: DEBUG nova.compute.manager [req-c36b3d28-588f-405d-b8fb-bcdabeb7c9ad req-1c135466-f94e-4ae8-b64f-57537707a6ff service nova] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Received event network-vif-plugged-26948185-b1bd-4055-b9c0-fdc3f580e619 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:56:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c36b3d28-588f-405d-b8fb-bcdabeb7c9ad req-1c135466-f94e-4ae8-b64f-57537707a6ff service nova] Acquiring lock "348a0df3-4865-46b2-a618-a8a519b51c3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c36b3d28-588f-405d-b8fb-bcdabeb7c9ad req-1c135466-f94e-4ae8-b64f-57537707a6ff service nova] Lock "348a0df3-4865-46b2-a618-a8a519b51c3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c36b3d28-588f-405d-b8fb-bcdabeb7c9ad req-1c135466-f94e-4ae8-b64f-57537707a6ff service nova] Lock "348a0df3-4865-46b2-a618-a8a519b51c3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:29 user nova-compute[72504]: DEBUG nova.compute.manager [req-c36b3d28-588f-405d-b8fb-bcdabeb7c9ad req-1c135466-f94e-4ae8-b64f-57537707a6ff service nova] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] No waiting events found dispatching network-vif-plugged-26948185-b1bd-4055-b9c0-fdc3f580e619 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:56:29 user nova-compute[72504]: WARNING nova.compute.manager [req-c36b3d28-588f-405d-b8fb-bcdabeb7c9ad req-1c135466-f94e-4ae8-b64f-57537707a6ff service nova] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Received unexpected event network-vif-plugged-26948185-b1bd-4055-b9c0-fdc3f580e619 for instance with vm_state building and task_state spawning.
Aug 01 19:56:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919791.512701, 348a0df3-4865-46b2-a618-a8a519b51c3a => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:56:31 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] VM Resumed (Lifecycle Event)
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:56:31 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Instance spawned successfully.
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:56:31 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919791.5146747, 348a0df3-4865-46b2-a618-a8a519b51c3a => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:56:31 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] VM Started (Lifecycle Event)
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:56:31 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:56:31 user nova-compute[72504]: INFO nova.compute.manager [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Took 6.50 seconds to spawn the instance on the hypervisor.
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.compute.manager [req-d0687665-e9d2-43c6-ac8c-abb51db5ae87 req-59683184-8ec7-4715-b71e-19ac357632c0 service nova] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Received event network-vif-plugged-26948185-b1bd-4055-b9c0-fdc3f580e619 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d0687665-e9d2-43c6-ac8c-abb51db5ae87 req-59683184-8ec7-4715-b71e-19ac357632c0 service nova] Acquiring lock "348a0df3-4865-46b2-a618-a8a519b51c3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d0687665-e9d2-43c6-ac8c-abb51db5ae87 req-59683184-8ec7-4715-b71e-19ac357632c0 service nova] Lock "348a0df3-4865-46b2-a618-a8a519b51c3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d0687665-e9d2-43c6-ac8c-abb51db5ae87 req-59683184-8ec7-4715-b71e-19ac357632c0 service nova] Lock "348a0df3-4865-46b2-a618-a8a519b51c3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.compute.manager [req-d0687665-e9d2-43c6-ac8c-abb51db5ae87 req-59683184-8ec7-4715-b71e-19ac357632c0 service nova] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] No waiting events found dispatching network-vif-plugged-26948185-b1bd-4055-b9c0-fdc3f580e619 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:56:31 user nova-compute[72504]: WARNING nova.compute.manager [req-d0687665-e9d2-43c6-ac8c-abb51db5ae87 req-59683184-8ec7-4715-b71e-19ac357632c0 service nova] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Received unexpected event network-vif-plugged-26948185-b1bd-4055-b9c0-fdc3f580e619 for instance with vm_state building and task_state spawning.
Aug 01 19:56:31 user nova-compute[72504]: INFO nova.compute.manager [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Took 7.34 seconds to build instance.
Aug 01 19:56:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1dce3903-0a68-4072-bbd2-0e456a20790c tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Lock "348a0df3-4865-46b2-a618-a8a519b51c3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.428s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:56:31 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Creating image(s)
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Did not create local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Ensure instance console log exists: /opt/stack/data/nova/instances/dad07310-5f62-48f9-a17f-6e960dcf5060/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Start _get_guest_xml network_info=[{"id": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "address": "fa:16:3e:a0:c5:9b", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f553f59-1a", "ovs_interfaceid": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOqgLyDT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dad07310-5f62-48f9-a17f-6e960dcf5060', 'attached_at': '', 'detached_at': '', 'volume_id': '313801ef-59d1-4715-8154-c9f8e67c5c51', 'serial': '313801ef-59d1-4715-8154-c9f8e67c5c51'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': '33906cdc-981a-4002-bf31-0e1d857dd6f9', 'volume_type': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:56:31 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:56:31 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:56:31 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOqgLyDT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:56:32 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:56:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:56:32 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:56:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:56:32 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[13726170-afb4-4775-a019-e2ff422003e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:56:32 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8190c3d6-2f19-469f-b442-7dade44beef5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51] added
Aug 01 19:56:32 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7853fe-93f5-44fa-8889-42dc8af08ae3]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a6eee2-b81b-4d3b-88f4-60b2dbd723bb]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YOqgLyDT {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YOqgLyDT" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed83a05-d91f-4b73-a6c5-654f3f8d1ee2]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YOqgLyDT'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9418fe06-f295-426a-95fb-287834e74e85]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[171e3f58-74e9-42e0-8ecf-0e05f1598b73]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:56:32 user nova-compute[72504]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)
Aug 01 19:56:32 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:56:32 user nova-compute[72504]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)
Aug 01 19:56:32 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28e16ff-20be-4854-a878-db437a3d29f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51, portal: 172.16.0.220,3260]
Aug 01 19:56:32 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51, portal: 172.16.0.220,3260] successful.
Aug 01 19:56:32 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a45592-dc4b-4724-9a81-72ec662bc33d]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae3c828-28f5-4035-b347-ffa8df344851]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:56:32 user nova-compute[72504]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)
Aug 01 19:56:32 user nova-compute[72504]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 19:56:32 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:56:32 user nova-compute[72504]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)
Aug 01 19:56:32 user nova-compute[72504]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 19:56:32 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e8be88-87fc-4fc4-a13e-22d052270e11]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOqgLyDT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:56:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23035646361373564', 'path': '/dev/sdd'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:56:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035646361373564', 'path': '/dev/sdd'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:56:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:56:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2125575619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2125575619',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNFzrQ0g9QApzL7h1e01mQviWJQOB+SVoER7DPTzwMDbyzkhT5MJnGE/g2zrEUSsO0fJfQUhubC+mYoonyHOW7N9HSstbnfIyRNkNXhsxk8LTIryb8PGpHTGai5hrxzhA==',key_name='tempest-keypair-451141470',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9540d878e5ea4bfda3d342e5a78035f5',ramdisk_id='',reservation_id='r-dfez9e0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-2015428092',owner_user_name='tempest-ServerActionsV293TestJSON-2015428092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:56:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97ef13eef2a345909187312f5a62e0f6',uuid=dad07310-5f62-48f9-a17f-6e960dcf5060,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "address": "fa:16:3e:a0:c5:9b", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f553f59-1a", "ovs_interfaceid": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:56:33 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Converting VIF {"id": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "address": "fa:16:3e:a0:c5:9b", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f553f59-1a", "ovs_interfaceid": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:56:33 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:c5:9b,bridge_name='br-int',has_traffic_filtering=True,id=6f553f59-1aca-4d1a-af20-0228b74af2f8,network=Network(d4da5ad8-9045-4076-9f31-ea9faaf8e6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f553f59-1a') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:56:33 user nova-compute[72504]: DEBUG nova.objects.instance [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lazy-loading 'pci_devices' on Instance uuid dad07310-5f62-48f9-a17f-6e960dcf5060 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:56:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:56:33 user nova-compute[72504]:   <uuid>dad07310-5f62-48f9-a17f-6e960dcf5060</uuid>
Aug 01 19:56:33 user nova-compute[72504]:   <name>instance-00000014</name>
Aug 01 19:56:33 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:56:33 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:56:33 user nova-compute[72504]:   <metadata>
Aug 01 19:56:33 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:56:33 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:56:33 user nova-compute[72504]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2125575619</nova:name>
Aug 01 19:56:33 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:56:31</nova:creationTime>
Aug 01 19:56:33 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:56:33 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:56:33 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:56:33 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:56:33 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:56:33 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:56:33 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:56:33 user nova-compute[72504]:       <nova:owner>
Aug 01 19:56:33 user nova-compute[72504]:         <nova:user uuid="97ef13eef2a345909187312f5a62e0f6">tempest-ServerActionsV293TestJSON-2015428092-project-member</nova:user>
Aug 01 19:56:33 user nova-compute[72504]:         <nova:project uuid="9540d878e5ea4bfda3d342e5a78035f5">tempest-ServerActionsV293TestJSON-2015428092</nova:project>
Aug 01 19:56:33 user nova-compute[72504]:       </nova:owner>
Aug 01 19:56:33 user nova-compute[72504]:       <nova:ports>
Aug 01 19:56:33 user nova-compute[72504]:         <nova:port uuid="6f553f59-1aca-4d1a-af20-0228b74af2f8">
Aug 01 19:56:33 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 19:56:33 user nova-compute[72504]:         </nova:port>
Aug 01 19:56:33 user nova-compute[72504]:       </nova:ports>
Aug 01 19:56:33 user nova-compute[72504]:     </nova:instance>
Aug 01 19:56:33 user nova-compute[72504]:   </metadata>
Aug 01 19:56:33 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:56:33 user nova-compute[72504]:     <system>
Aug 01 19:56:33 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:56:33 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:56:33 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:56:33 user nova-compute[72504]:       <entry name="serial">dad07310-5f62-48f9-a17f-6e960dcf5060</entry>
Aug 01 19:56:33 user nova-compute[72504]:       <entry name="uuid">dad07310-5f62-48f9-a17f-6e960dcf5060</entry>
Aug 01 19:56:33 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:56:33 user nova-compute[72504]:     </system>
Aug 01 19:56:33 user nova-compute[72504]:   </sysinfo>
Aug 01 19:56:33 user nova-compute[72504]:   <os>
Aug 01 19:56:33 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:56:33 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:56:33 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:56:33 user nova-compute[72504]:   </os>
Aug 01 19:56:33 user nova-compute[72504]:   <features>
Aug 01 19:56:33 user nova-compute[72504]:     <acpi/>
Aug 01 19:56:33 user nova-compute[72504]:     <apic/>
Aug 01 19:56:33 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:56:33 user nova-compute[72504]:   </features>
Aug 01 19:56:33 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:56:33 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:56:33 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:56:33 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:56:33 user nova-compute[72504]:   </clock>
Aug 01 19:56:33 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:56:33 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:56:33 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:56:33 user nova-compute[72504]:   </cpu>
Aug 01 19:56:33 user nova-compute[72504]:   <devices>
Aug 01 19:56:33 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 19:56:33 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:56:33 user nova-compute[72504]:       <source dev="/dev/sdd"/>
Aug 01 19:56:33 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:56:33 user nova-compute[72504]:       <serial>313801ef-59d1-4715-8154-c9f8e67c5c51</serial>
Aug 01 19:56:33 user nova-compute[72504]:     </disk>
Aug 01 19:56:33 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:56:33 user nova-compute[72504]:       <mac address="fa:16:3e:a0:c5:9b"/>
Aug 01 19:56:33 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:56:33 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:56:33 user nova-compute[72504]:       <target dev="tap6f553f59-1a"/>
Aug 01 19:56:33 user nova-compute[72504]:     </interface>
Aug 01 19:56:33 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:56:33 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/dad07310-5f62-48f9-a17f-6e960dcf5060/console.log" append="off"/>
Aug 01 19:56:33 user nova-compute[72504]:     </serial>
Aug 01 19:56:33 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:56:33 user nova-compute[72504]:     <video>
Aug 01 19:56:33 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:56:33 user nova-compute[72504]:     </video>
Aug 01 19:56:33 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:56:33 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:56:33 user nova-compute[72504]:     </rng>
Aug 01 19:56:33 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:56:33 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:56:33 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:56:33 user nova-compute[72504]:     </memballoon>
Aug 01 19:56:33 user nova-compute[72504]:   </devices>
Aug 01 19:56:33 user nova-compute[72504]: </domain>
Aug 01 19:56:33 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:56:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:56:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2125575619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2125575619',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNFzrQ0g9QApzL7h1e01mQviWJQOB+SVoER7DPTzwMDbyzkhT5MJnGE/g2zrEUSsO0fJfQUhubC+mYoonyHOW7N9HSstbnfIyRNkNXhsxk8LTIryb8PGpHTGai5hrxzhA==',key_name='tempest-keypair-451141470',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9540d878e5ea4bfda3d342e5a78035f5',ramdisk_id='',reservation_id='r-dfez9e0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-2015428092',owner_user_name='tempest-ServerActionsV293TestJSON-2015428092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:56:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97ef13eef2a345909187312f5a62e0f6',uuid=dad07310-5f62-48f9-a17f-6e960dcf5060,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "address": "fa:16:3e:a0:c5:9b", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f553f59-1a", "ovs_interfaceid": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:56:33 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Converting VIF {"id": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "address": "fa:16:3e:a0:c5:9b", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f553f59-1a", "ovs_interfaceid": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:56:33 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:c5:9b,bridge_name='br-int',has_traffic_filtering=True,id=6f553f59-1aca-4d1a-af20-0228b74af2f8,network=Network(d4da5ad8-9045-4076-9f31-ea9faaf8e6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f553f59-1a') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:56:33 user nova-compute[72504]: DEBUG os_vif [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:c5:9b,bridge_name='br-int',has_traffic_filtering=True,id=6f553f59-1aca-4d1a-af20-0228b74af2f8,network=Network(d4da5ad8-9045-4076-9f31-ea9faaf8e6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f553f59-1a') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:56:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:56:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:56:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f553f59-1a, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:56:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6f553f59-1a, col_values=(('external_ids', {'iface-id': '6f553f59-1aca-4d1a-af20-0228b74af2f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:c5:9b', 'vm-uuid': 'dad07310-5f62-48f9-a17f-6e960dcf5060'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:56:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:56:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:33 user nova-compute[72504]: INFO os_vif [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:c5:9b,bridge_name='br-int',has_traffic_filtering=True,id=6f553f59-1aca-4d1a-af20-0228b74af2f8,network=Network(d4da5ad8-9045-4076-9f31-ea9faaf8e6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f553f59-1a')
Aug 01 19:56:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:56:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] No VIF found with MAC fa:16:3e:a0:c5:9b, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:56:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:35 user nova-compute[72504]: DEBUG nova.compute.manager [req-79e37752-fd38-4b0e-8a76-3a8ac97f8acc req-56134d4e-635c-4caf-8eb0-6bd1955a721c service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Received event network-vif-plugged-6f553f59-1aca-4d1a-af20-0228b74af2f8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:56:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-79e37752-fd38-4b0e-8a76-3a8ac97f8acc req-56134d4e-635c-4caf-8eb0-6bd1955a721c service nova] Acquiring lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-79e37752-fd38-4b0e-8a76-3a8ac97f8acc req-56134d4e-635c-4caf-8eb0-6bd1955a721c service nova] Lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-79e37752-fd38-4b0e-8a76-3a8ac97f8acc req-56134d4e-635c-4caf-8eb0-6bd1955a721c service nova] Lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:35 user nova-compute[72504]: DEBUG nova.compute.manager [req-79e37752-fd38-4b0e-8a76-3a8ac97f8acc req-56134d4e-635c-4caf-8eb0-6bd1955a721c service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] No waiting events found dispatching network-vif-plugged-6f553f59-1aca-4d1a-af20-0228b74af2f8 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:56:35 user nova-compute[72504]: WARNING nova.compute.manager [req-79e37752-fd38-4b0e-8a76-3a8ac97f8acc req-56134d4e-635c-4caf-8eb0-6bd1955a721c service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Received unexpected event network-vif-plugged-6f553f59-1aca-4d1a-af20-0228b74af2f8 for instance with vm_state building and task_state spawning.
Aug 01 19:56:37 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919797.0178158, dad07310-5f62-48f9-a17f-6e960dcf5060 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:56:37 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] VM Resumed (Lifecycle Event)
Aug 01 19:56:37 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:56:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:56:37 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Instance spawned successfully.
Aug 01 19:56:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 19:56:37 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:56:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:56:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:56:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:56:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:56:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:56:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:56:37 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:56:37 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:56:37 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919797.0216124, dad07310-5f62-48f9-a17f-6e960dcf5060 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:56:37 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] VM Started (Lifecycle Event)
Aug 01 19:56:37 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:56:37 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:56:37 user nova-compute[72504]: INFO nova.compute.manager [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Took 5.20 seconds to spawn the instance on the hypervisor.
Aug 01 19:56:37 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:56:37 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:56:37 user nova-compute[72504]: INFO nova.compute.manager [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Took 14.31 seconds to build instance.
Aug 01 19:56:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7722c166-34b9-449f-a257-07e70ad9a010 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "dad07310-5f62-48f9-a17f-6e960dcf5060" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.438s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:37 user nova-compute[72504]: DEBUG nova.compute.manager [req-3bc4f106-3f78-4d3a-9fc4-7696065e3178 req-393f6c00-06c0-4034-9728-338ec2265df8 service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Received event network-vif-plugged-6f553f59-1aca-4d1a-af20-0228b74af2f8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:56:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3bc4f106-3f78-4d3a-9fc4-7696065e3178 req-393f6c00-06c0-4034-9728-338ec2265df8 service nova] Acquiring lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3bc4f106-3f78-4d3a-9fc4-7696065e3178 req-393f6c00-06c0-4034-9728-338ec2265df8 service nova] Lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3bc4f106-3f78-4d3a-9fc4-7696065e3178 req-393f6c00-06c0-4034-9728-338ec2265df8 service nova] Lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:37 user nova-compute[72504]: DEBUG nova.compute.manager [req-3bc4f106-3f78-4d3a-9fc4-7696065e3178 req-393f6c00-06c0-4034-9728-338ec2265df8 service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] No waiting events found dispatching network-vif-plugged-6f553f59-1aca-4d1a-af20-0228b74af2f8 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:56:37 user nova-compute[72504]: WARNING nova.compute.manager [req-3bc4f106-3f78-4d3a-9fc4-7696065e3178 req-393f6c00-06c0-4034-9728-338ec2265df8 service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Received unexpected event network-vif-plugged-6f553f59-1aca-4d1a-af20-0228b74af2f8 for instance with vm_state active and task_state None.
Aug 01 19:56:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "6377103d-7606-4a5d-a905-6b1439e52c93" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "6377103d-7606-4a5d-a905-6b1439e52c93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:58 user nova-compute[72504]: DEBUG nova.compute.manager [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 19:56:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:58 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:56:58 user nova-compute[72504]: INFO nova.compute.claims [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Claim successful on node user
Aug 01 19:56:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:56:58 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:56:58 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:56:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.512s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:58 user nova-compute[72504]: DEBUG nova.compute.manager [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 19:56:59 user nova-compute[72504]: DEBUG nova.compute.manager [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 19:56:59 user nova-compute[72504]: DEBUG nova.network.neutron [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 19:56:59 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 19:56:59 user nova-compute[72504]: DEBUG nova.compute.manager [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 19:56:59 user nova-compute[72504]: DEBUG nova.policy [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6260679430fa4828b07bc890c62878c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04aaa8143b44d5aa21f59a89cd57ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 19:56:59 user nova-compute[72504]: DEBUG nova.compute.manager [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 19:56:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:56:59 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Creating image(s)
Aug 01 19:56:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "/opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "/opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "/opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.144s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk 1073741824" returned: 0 in 0.059s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:56:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.155s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:59 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 19:56:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:56:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:56:59 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Cannot resize image /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 19:56:59 user nova-compute[72504]: DEBUG nova.objects.instance [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lazy-loading 'migration_context' on Instance uuid 6377103d-7606-4a5d-a905-6b1439e52c93 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:56:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 19:56:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Ensure instance console log exists: /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:56:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:56:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:56:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:57:00 user nova-compute[72504]: DEBUG nova.network.neutron [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Successfully created port: 9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:57:00 user nova-compute[72504]: DEBUG nova.compute.manager [req-df8bc42d-1d8b-4eac-95d3-8f05491f5dd9 req-00dbe55a-4b5a-4e50-a077-dddc002b0833 service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Received event network-changed-3a4ace30-3ca6-4cc9-8125-599cc4097662 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:57:00 user nova-compute[72504]: DEBUG nova.compute.manager [req-df8bc42d-1d8b-4eac-95d3-8f05491f5dd9 req-00dbe55a-4b5a-4e50-a077-dddc002b0833 service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Refreshing instance network info cache due to event network-changed-3a4ace30-3ca6-4cc9-8125-599cc4097662. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:57:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-df8bc42d-1d8b-4eac-95d3-8f05491f5dd9 req-00dbe55a-4b5a-4e50-a077-dddc002b0833 service nova] Acquiring lock "refresh_cache-88f95d20-e391-4100-93b2-da29bfcf9704" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:57:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-df8bc42d-1d8b-4eac-95d3-8f05491f5dd9 req-00dbe55a-4b5a-4e50-a077-dddc002b0833 service nova] Acquired lock "refresh_cache-88f95d20-e391-4100-93b2-da29bfcf9704" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:57:00 user nova-compute[72504]: DEBUG nova.network.neutron [req-df8bc42d-1d8b-4eac-95d3-8f05491f5dd9 req-00dbe55a-4b5a-4e50-a077-dddc002b0833 service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Refreshing network info cache for port 3a4ace30-3ca6-4cc9-8125-599cc4097662 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:57:01 user nova-compute[72504]: DEBUG nova.network.neutron [req-df8bc42d-1d8b-4eac-95d3-8f05491f5dd9 req-00dbe55a-4b5a-4e50-a077-dddc002b0833 service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Updated VIF entry in instance network info cache for port 3a4ace30-3ca6-4cc9-8125-599cc4097662. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:57:01 user nova-compute[72504]: DEBUG nova.network.neutron [req-df8bc42d-1d8b-4eac-95d3-8f05491f5dd9 req-00dbe55a-4b5a-4e50-a077-dddc002b0833 service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Updating instance_info_cache with network_info: [{"id": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "address": "fa:16:3e:c3:aa:1c", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a4ace30-3c", "ovs_interfaceid": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:57:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-df8bc42d-1d8b-4eac-95d3-8f05491f5dd9 req-00dbe55a-4b5a-4e50-a077-dddc002b0833 service nova] Releasing lock "refresh_cache-88f95d20-e391-4100-93b2-da29bfcf9704" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:57:01 user nova-compute[72504]: DEBUG nova.network.neutron [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Successfully updated port: 9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:57:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "refresh_cache-6377103d-7606-4a5d-a905-6b1439e52c93" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:57:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquired lock "refresh_cache-6377103d-7606-4a5d-a905-6b1439e52c93" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:57:01 user nova-compute[72504]: DEBUG nova.network.neutron [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:57:01 user nova-compute[72504]: DEBUG nova.network.neutron [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:57:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.network.neutron [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Updating instance_info_cache with network_info: [{"id": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "address": "fa:16:3e:3e:71:62", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9af0b4bf-bc", "ovs_interfaceid": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Releasing lock "refresh_cache-6377103d-7606-4a5d-a905-6b1439e52c93" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.compute.manager [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Instance network_info: |[{"id": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "address": "fa:16:3e:3e:71:62", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9af0b4bf-bc", "ovs_interfaceid": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Start _get_guest_xml network_info=[{"id": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "address": "fa:16:3e:3e:71:62", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9af0b4bf-bc", "ovs_interfaceid": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:57:02 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:57:02 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-166257871',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-166257871',id=22,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+wl8rcNpZ1mqzCl3rGvjYe+0M4mVedb0jJNstGOFGDnMLONV5/yGL7F28WYBgjT0J58cwNLWa81cZxxdYgg2c9g087PvPGLb9nXvb0L3iX84/jpo1Bt/FyUc3dte3RhQ==',key_name='tempest-keypair-1753450990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da04aaa8143b44d5aa21f59a89cd57ee',ramdisk_id='',reservation_id='r-mdxab4hw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-836718209',owner_user_name='tempest-AttachVolumeShelveTestJSON-836718209-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:56:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6260679430fa4828b07bc890c62878c3',uuid=6377103d-7606-4a5d-a905-6b1439e52c93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "address": "fa:16:3e:3e:71:62", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9af0b4bf-bc", "ovs_interfaceid": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Converting VIF {"id": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "address": "fa:16:3e:3e:71:62", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9af0b4bf-bc", "ovs_interfaceid": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:71:62,bridge_name='br-int',has_traffic_filtering=True,id=9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e,network=Network(40b3d49e-3592-411a-93d6-5a44019ef136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9af0b4bf-bc') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.objects.instance [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lazy-loading 'pci_devices' on Instance uuid 6377103d-7606-4a5d-a905-6b1439e52c93 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:57:02 user nova-compute[72504]:   <uuid>6377103d-7606-4a5d-a905-6b1439e52c93</uuid>
Aug 01 19:57:02 user nova-compute[72504]:   <name>instance-00000016</name>
Aug 01 19:57:02 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:57:02 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:57:02 user nova-compute[72504]:   <metadata>
Aug 01 19:57:02 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:57:02 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:57:02 user nova-compute[72504]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-166257871</nova:name>
Aug 01 19:57:02 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:57:02</nova:creationTime>
Aug 01 19:57:02 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:57:02 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:57:02 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:57:02 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:57:02 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:57:02 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:57:02 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:57:02 user nova-compute[72504]:       <nova:owner>
Aug 01 19:57:02 user nova-compute[72504]:         <nova:user uuid="6260679430fa4828b07bc890c62878c3">tempest-AttachVolumeShelveTestJSON-836718209-project-member</nova:user>
Aug 01 19:57:02 user nova-compute[72504]:         <nova:project uuid="da04aaa8143b44d5aa21f59a89cd57ee">tempest-AttachVolumeShelveTestJSON-836718209</nova:project>
Aug 01 19:57:02 user nova-compute[72504]:       </nova:owner>
Aug 01 19:57:02 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:57:02 user nova-compute[72504]:       <nova:ports>
Aug 01 19:57:02 user nova-compute[72504]:         <nova:port uuid="9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e">
Aug 01 19:57:02 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 19:57:02 user nova-compute[72504]:         </nova:port>
Aug 01 19:57:02 user nova-compute[72504]:       </nova:ports>
Aug 01 19:57:02 user nova-compute[72504]:     </nova:instance>
Aug 01 19:57:02 user nova-compute[72504]:   </metadata>
Aug 01 19:57:02 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:57:02 user nova-compute[72504]:     <system>
Aug 01 19:57:02 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:57:02 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:57:02 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:57:02 user nova-compute[72504]:       <entry name="serial">6377103d-7606-4a5d-a905-6b1439e52c93</entry>
Aug 01 19:57:02 user nova-compute[72504]:       <entry name="uuid">6377103d-7606-4a5d-a905-6b1439e52c93</entry>
Aug 01 19:57:02 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:57:02 user nova-compute[72504]:     </system>
Aug 01 19:57:02 user nova-compute[72504]:   </sysinfo>
Aug 01 19:57:02 user nova-compute[72504]:   <os>
Aug 01 19:57:02 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:57:02 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:57:02 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:57:02 user nova-compute[72504]:   </os>
Aug 01 19:57:02 user nova-compute[72504]:   <features>
Aug 01 19:57:02 user nova-compute[72504]:     <acpi/>
Aug 01 19:57:02 user nova-compute[72504]:     <apic/>
Aug 01 19:57:02 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:57:02 user nova-compute[72504]:   </features>
Aug 01 19:57:02 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:57:02 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:57:02 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:57:02 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:57:02 user nova-compute[72504]:   </clock>
Aug 01 19:57:02 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:57:02 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:57:02 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:57:02 user nova-compute[72504]:   </cpu>
Aug 01 19:57:02 user nova-compute[72504]:   <devices>
Aug 01 19:57:02 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:57:02 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:57:02 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk"/>
Aug 01 19:57:02 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:57:02 user nova-compute[72504]:     </disk>
Aug 01 19:57:02 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:57:02 user nova-compute[72504]:       <mac address="fa:16:3e:3e:71:62"/>
Aug 01 19:57:02 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:57:02 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:57:02 user nova-compute[72504]:       <target dev="tap9af0b4bf-bc"/>
Aug 01 19:57:02 user nova-compute[72504]:     </interface>
Aug 01 19:57:02 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:57:02 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/console.log" append="off"/>
Aug 01 19:57:02 user nova-compute[72504]:     </serial>
Aug 01 19:57:02 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:57:02 user nova-compute[72504]:     <video>
Aug 01 19:57:02 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:57:02 user nova-compute[72504]:     </video>
Aug 01 19:57:02 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:57:02 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:57:02 user nova-compute[72504]:     </rng>
Aug 01 19:57:02 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:57:02 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:57:02 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:57:02 user nova-compute[72504]:     </memballoon>
Aug 01 19:57:02 user nova-compute[72504]:   </devices>
Aug 01 19:57:02 user nova-compute[72504]: </domain>
Aug 01 19:57:02 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-166257871',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-166257871',id=22,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+wl8rcNpZ1mqzCl3rGvjYe+0M4mVedb0jJNstGOFGDnMLONV5/yGL7F28WYBgjT0J58cwNLWa81cZxxdYgg2c9g087PvPGLb9nXvb0L3iX84/jpo1Bt/FyUc3dte3RhQ==',key_name='tempest-keypair-1753450990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da04aaa8143b44d5aa21f59a89cd57ee',ramdisk_id='',reservation_id='r-mdxab4hw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-836718209',owner_user_name='tempest-AttachVolumeShelveTestJSON-836718209-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:56:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6260679430fa4828b07bc890c62878c3',uuid=6377103d-7606-4a5d-a905-6b1439e52c93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "address": "fa:16:3e:3e:71:62", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9af0b4bf-bc", "ovs_interfaceid": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Converting VIF {"id": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "address": "fa:16:3e:3e:71:62", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9af0b4bf-bc", "ovs_interfaceid": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:71:62,bridge_name='br-int',has_traffic_filtering=True,id=9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e,network=Network(40b3d49e-3592-411a-93d6-5a44019ef136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9af0b4bf-bc') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG os_vif [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:71:62,bridge_name='br-int',has_traffic_filtering=True,id=9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e,network=Network(40b3d49e-3592-411a-93d6-5a44019ef136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9af0b4bf-bc') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9af0b4bf-bc, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9af0b4bf-bc, col_values=(('external_ids', {'iface-id': '9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:71:62', 'vm-uuid': '6377103d-7606-4a5d-a905-6b1439e52c93'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:02 user nova-compute[72504]: INFO os_vif [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:71:62,bridge_name='br-int',has_traffic_filtering=True,id=9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e,network=Network(40b3d49e-3592-411a-93d6-5a44019ef136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9af0b4bf-bc')
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] No VIF found with MAC fa:16:3e:3e:71:62, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.compute.manager [req-4a145c48-fe9e-4065-a4e8-63c3ef45a796 req-46bc3104-f972-48a4-bd31-e73d62579025 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received event network-changed-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.compute.manager [req-4a145c48-fe9e-4065-a4e8-63c3ef45a796 req-46bc3104-f972-48a4-bd31-e73d62579025 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Refreshing instance network info cache due to event network-changed-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4a145c48-fe9e-4065-a4e8-63c3ef45a796 req-46bc3104-f972-48a4-bd31-e73d62579025 service nova] Acquiring lock "refresh_cache-6377103d-7606-4a5d-a905-6b1439e52c93" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4a145c48-fe9e-4065-a4e8-63c3ef45a796 req-46bc3104-f972-48a4-bd31-e73d62579025 service nova] Acquired lock "refresh_cache-6377103d-7606-4a5d-a905-6b1439e52c93" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:57:02 user nova-compute[72504]: DEBUG nova.network.neutron [req-4a145c48-fe9e-4065-a4e8-63c3ef45a796 req-46bc3104-f972-48a4-bd31-e73d62579025 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Refreshing network info cache for port 9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:57:03 user nova-compute[72504]: DEBUG nova.network.neutron [req-4a145c48-fe9e-4065-a4e8-63c3ef45a796 req-46bc3104-f972-48a4-bd31-e73d62579025 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Updated VIF entry in instance network info cache for port 9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:57:03 user nova-compute[72504]: DEBUG nova.network.neutron [req-4a145c48-fe9e-4065-a4e8-63c3ef45a796 req-46bc3104-f972-48a4-bd31-e73d62579025 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Updating instance_info_cache with network_info: [{"id": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "address": "fa:16:3e:3e:71:62", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9af0b4bf-bc", "ovs_interfaceid": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:57:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4a145c48-fe9e-4065-a4e8-63c3ef45a796 req-46bc3104-f972-48a4-bd31-e73d62579025 service nova] Releasing lock "refresh_cache-6377103d-7606-4a5d-a905-6b1439e52c93" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:57:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-cae1195d-ff66-4cd1-9ab9-199d2a283ade req-b50a6975-63ce-4aa3-9c31-93dc29fd11cd service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received event network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:57:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cae1195d-ff66-4cd1-9ab9-199d2a283ade req-b50a6975-63ce-4aa3-9c31-93dc29fd11cd service nova] Acquiring lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:57:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cae1195d-ff66-4cd1-9ab9-199d2a283ade req-b50a6975-63ce-4aa3-9c31-93dc29fd11cd service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:57:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cae1195d-ff66-4cd1-9ab9-199d2a283ade req-b50a6975-63ce-4aa3-9c31-93dc29fd11cd service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:57:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-cae1195d-ff66-4cd1-9ab9-199d2a283ade req-b50a6975-63ce-4aa3-9c31-93dc29fd11cd service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] No waiting events found dispatching network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:57:04 user nova-compute[72504]: WARNING nova.compute.manager [req-cae1195d-ff66-4cd1-9ab9-199d2a283ade req-b50a6975-63ce-4aa3-9c31-93dc29fd11cd service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received unexpected event network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e for instance with vm_state building and task_state spawning.
Aug 01 19:57:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:06 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919826.1700392, 6377103d-7606-4a5d-a905-6b1439e52c93 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:57:06 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] VM Resumed (Lifecycle Event)
Aug 01 19:57:06 user nova-compute[72504]: DEBUG nova.compute.manager [req-c5b03eb9-b35d-49f3-8f72-66e8a9bd49ec req-af9c245e-7b81-4b2f-9a78-e91f1fd37d8e service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received event network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:57:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c5b03eb9-b35d-49f3-8f72-66e8a9bd49ec req-af9c245e-7b81-4b2f-9a78-e91f1fd37d8e service nova] Acquiring lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:57:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c5b03eb9-b35d-49f3-8f72-66e8a9bd49ec req-af9c245e-7b81-4b2f-9a78-e91f1fd37d8e service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:57:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c5b03eb9-b35d-49f3-8f72-66e8a9bd49ec req-af9c245e-7b81-4b2f-9a78-e91f1fd37d8e service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:57:06 user nova-compute[72504]: DEBUG nova.compute.manager [req-c5b03eb9-b35d-49f3-8f72-66e8a9bd49ec req-af9c245e-7b81-4b2f-9a78-e91f1fd37d8e service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] No waiting events found dispatching network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:57:06 user nova-compute[72504]: WARNING nova.compute.manager [req-c5b03eb9-b35d-49f3-8f72-66e8a9bd49ec req-af9c245e-7b81-4b2f-9a78-e91f1fd37d8e service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received unexpected event network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e for instance with vm_state building and task_state spawning.
Aug 01 19:57:06 user nova-compute[72504]: DEBUG nova.compute.manager [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:57:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:57:06 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Instance spawned successfully.
Aug 01 19:57:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 19:57:06 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:57:06 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:57:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:57:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:57:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:57:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:57:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:57:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:57:06 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:57:06 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919826.1814637, 6377103d-7606-4a5d-a905-6b1439e52c93 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:57:06 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] VM Started (Lifecycle Event)
Aug 01 19:57:06 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:57:06 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:57:06 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:57:06 user nova-compute[72504]: INFO nova.compute.manager [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Took 7.08 seconds to spawn the instance on the hypervisor.
Aug 01 19:57:06 user nova-compute[72504]: DEBUG nova.compute.manager [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:57:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:06 user nova-compute[72504]: INFO nova.compute.manager [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Took 7.98 seconds to build instance.
Aug 01 19:57:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-17405867-53c4-4313-8e98-66537c02ceba tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "6377103d-7606-4a5d-a905-6b1439e52c93" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.071s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:57:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e97e4fc6-a5c6-448e-9efb-d4c56a94a9a1 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Acquiring lock "cb230370-0feb-46b5-8837-35fea366b34f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:57:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e97e4fc6-a5c6-448e-9efb-d4c56a94a9a1 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lock "cb230370-0feb-46b5-8837-35fea366b34f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:57:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e97e4fc6-a5c6-448e-9efb-d4c56a94a9a1 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Acquiring lock "cb230370-0feb-46b5-8837-35fea366b34f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:57:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e97e4fc6-a5c6-448e-9efb-d4c56a94a9a1 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lock "cb230370-0feb-46b5-8837-35fea366b34f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:57:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e97e4fc6-a5c6-448e-9efb-d4c56a94a9a1 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lock "cb230370-0feb-46b5-8837-35fea366b34f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:57:08 user nova-compute[72504]: INFO nova.compute.manager [None req-e97e4fc6-a5c6-448e-9efb-d4c56a94a9a1 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Terminating instance
Aug 01 19:57:08 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e97e4fc6-a5c6-448e-9efb-d4c56a94a9a1 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 19:57:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:08 user nova-compute[72504]: DEBUG nova.compute.manager [req-3206051e-1f67-43f7-8334-c8ae8523a404 req-27dae972-7831-4309-90ae-b9139e13bee0 service nova] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Received event network-vif-unplugged-e342b987-cf5d-4e32-ba7c-d18fa3519229 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:57:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3206051e-1f67-43f7-8334-c8ae8523a404 req-27dae972-7831-4309-90ae-b9139e13bee0 service nova] Acquiring lock "cb230370-0feb-46b5-8837-35fea366b34f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:57:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3206051e-1f67-43f7-8334-c8ae8523a404 req-27dae972-7831-4309-90ae-b9139e13bee0 service nova] Lock "cb230370-0feb-46b5-8837-35fea366b34f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:57:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3206051e-1f67-43f7-8334-c8ae8523a404 req-27dae972-7831-4309-90ae-b9139e13bee0 service nova] Lock "cb230370-0feb-46b5-8837-35fea366b34f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:57:08 user nova-compute[72504]: DEBUG nova.compute.manager [req-3206051e-1f67-43f7-8334-c8ae8523a404 req-27dae972-7831-4309-90ae-b9139e13bee0 service nova] [instance: cb230370-0feb-46b5-8837-35fea366b34f] No waiting events found dispatching network-vif-unplugged-e342b987-cf5d-4e32-ba7c-d18fa3519229 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:57:08 user nova-compute[72504]: DEBUG nova.compute.manager [req-3206051e-1f67-43f7-8334-c8ae8523a404 req-27dae972-7831-4309-90ae-b9139e13bee0 service nova] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Received event network-vif-unplugged-e342b987-cf5d-4e32-ba7c-d18fa3519229 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:57:09 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Instance destroyed successfully.
Aug 01 19:57:09 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e97e4fc6-a5c6-448e-9efb-d4c56a94a9a1 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lazy-loading 'resources' on Instance uuid cb230370-0feb-46b5-8837-35fea366b34f {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:57:09 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-e97e4fc6-a5c6-448e-9efb-d4c56a94a9a1 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:54:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2056322209',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2056322209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2056322',id=16,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRIyW2FBXcvI67fmCRGig/d6LUthuWq1woC8+/Eir391DE5iEKV5UloI9MtOykxG+Ke7U5bxnTaEWJf5t7OkGCpEgoPZzx07e412yl8eyklOrsWf+W54ZftTSPXV+4r8g==',key_name='tempest-keypair-1800767565',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:54:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2aa32d6ef3fa4cf3b5d229f868e34045',ramdisk_id='',reservation_id='r-noa5n77e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-337134775',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:54:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7336874664f446a3ae318c21643a7925',uuid=cb230370-0feb-46b5-8837-35fea366b34f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e342b987-cf5d-4e32-ba7c-d18fa3519229", "address": "fa:16:3e:ba:56:6f", "network": {"id": "63ff1aab-acfc-4e7b-aee4-4bcd09b47a06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1427520461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aa32d6ef3fa4cf3b5d229f868e34045", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape342b987-cf", "ovs_interfaceid": "e342b987-cf5d-4e32-ba7c-d18fa3519229", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:57:09 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e97e4fc6-a5c6-448e-9efb-d4c56a94a9a1 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Converting VIF {"id": "e342b987-cf5d-4e32-ba7c-d18fa3519229", "address": "fa:16:3e:ba:56:6f", "network": {"id": "63ff1aab-acfc-4e7b-aee4-4bcd09b47a06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1427520461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2aa32d6ef3fa4cf3b5d229f868e34045", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape342b987-cf", "ovs_interfaceid": "e342b987-cf5d-4e32-ba7c-d18fa3519229", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:57:09 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e97e4fc6-a5c6-448e-9efb-d4c56a94a9a1 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:56:6f,bridge_name='br-int',has_traffic_filtering=True,id=e342b987-cf5d-4e32-ba7c-d18fa3519229,network=Network(63ff1aab-acfc-4e7b-aee4-4bcd09b47a06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape342b987-cf') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:57:09 user nova-compute[72504]: DEBUG os_vif [None req-e97e4fc6-a5c6-448e-9efb-d4c56a94a9a1 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:56:6f,bridge_name='br-int',has_traffic_filtering=True,id=e342b987-cf5d-4e32-ba7c-d18fa3519229,network=Network(63ff1aab-acfc-4e7b-aee4-4bcd09b47a06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape342b987-cf') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:57:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape342b987-cf, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:57:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:09 user nova-compute[72504]: INFO os_vif [None req-e97e4fc6-a5c6-448e-9efb-d4c56a94a9a1 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:56:6f,bridge_name='br-int',has_traffic_filtering=True,id=e342b987-cf5d-4e32-ba7c-d18fa3519229,network=Network(63ff1aab-acfc-4e7b-aee4-4bcd09b47a06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape342b987-cf')
Aug 01 19:57:09 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-e97e4fc6-a5c6-448e-9efb-d4c56a94a9a1 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Deleting instance files /opt/stack/data/nova/instances/cb230370-0feb-46b5-8837-35fea366b34f_del
Aug 01 19:57:09 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-e97e4fc6-a5c6-448e-9efb-d4c56a94a9a1 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Deletion of /opt/stack/data/nova/instances/cb230370-0feb-46b5-8837-35fea366b34f_del complete
Aug 01 19:57:09 user nova-compute[72504]: INFO nova.compute.manager [None req-e97e4fc6-a5c6-448e-9efb-d4c56a94a9a1 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 01 19:57:09 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-e97e4fc6-a5c6-448e-9efb-d4c56a94a9a1 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 19:57:09 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 19:57:09 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: cb230370-0feb-46b5-8837-35fea366b34f] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 19:57:10 user nova-compute[72504]: DEBUG nova.compute.manager [req-8e3cbc0e-ab25-4925-951c-b938304739b9 req-d7949b45-9b92-48e6-9f4d-cc0829571958 service nova] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Received event network-vif-plugged-e342b987-cf5d-4e32-ba7c-d18fa3519229 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:57:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-8e3cbc0e-ab25-4925-951c-b938304739b9 req-d7949b45-9b92-48e6-9f4d-cc0829571958 service nova] Acquiring lock "cb230370-0feb-46b5-8837-35fea366b34f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:57:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-8e3cbc0e-ab25-4925-951c-b938304739b9 req-d7949b45-9b92-48e6-9f4d-cc0829571958 service nova] Lock "cb230370-0feb-46b5-8837-35fea366b34f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:57:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-8e3cbc0e-ab25-4925-951c-b938304739b9 req-d7949b45-9b92-48e6-9f4d-cc0829571958 service nova] Lock "cb230370-0feb-46b5-8837-35fea366b34f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:57:10 user nova-compute[72504]: DEBUG nova.compute.manager [req-8e3cbc0e-ab25-4925-951c-b938304739b9 req-d7949b45-9b92-48e6-9f4d-cc0829571958 service nova] [instance: cb230370-0feb-46b5-8837-35fea366b34f] No waiting events found dispatching network-vif-plugged-e342b987-cf5d-4e32-ba7c-d18fa3519229 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:57:10 user nova-compute[72504]: WARNING nova.compute.manager [req-8e3cbc0e-ab25-4925-951c-b938304739b9 req-d7949b45-9b92-48e6-9f4d-cc0829571958 service nova] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Received unexpected event network-vif-plugged-e342b987-cf5d-4e32-ba7c-d18fa3519229 for instance with vm_state active and task_state deleting.
Aug 01 19:57:10 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:57:10 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Took 1.53 seconds to deallocate network for instance.
Aug 01 19:57:10 user nova-compute[72504]: DEBUG nova.compute.manager [req-8085b630-3175-4b18-8d9b-6cff2f6f9e6c req-9665592b-b14b-42ad-a1b6-89f2d590bad4 service nova] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Received event network-vif-deleted-e342b987-cf5d-4e32-ba7c-d18fa3519229 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:57:10 user nova-compute[72504]: INFO nova.compute.manager [req-8085b630-3175-4b18-8d9b-6cff2f6f9e6c req-9665592b-b14b-42ad-a1b6-89f2d590bad4 service nova] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Neutron deleted interface e342b987-cf5d-4e32-ba7c-d18fa3519229; detaching it from the instance and deleting it from the info cache
Aug 01 19:57:10 user nova-compute[72504]: DEBUG nova.network.neutron [req-8085b630-3175-4b18-8d9b-6cff2f6f9e6c req-9665592b-b14b-42ad-a1b6-89f2d590bad4 service nova] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:57:10 user nova-compute[72504]: DEBUG nova.compute.manager [req-8085b630-3175-4b18-8d9b-6cff2f6f9e6c req-9665592b-b14b-42ad-a1b6-89f2d590bad4 service nova] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Detach interface failed, port_id=e342b987-cf5d-4e32-ba7c-d18fa3519229, reason: Instance cb230370-0feb-46b5-8837-35fea366b34f could not be found. {{(pid=72504) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 19:57:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e97e4fc6-a5c6-448e-9efb-d4c56a94a9a1 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:57:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e97e4fc6-a5c6-448e-9efb-d4c56a94a9a1 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:57:11 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e97e4fc6-a5c6-448e-9efb-d4c56a94a9a1 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:57:11 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e97e4fc6-a5c6-448e-9efb-d4c56a94a9a1 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:57:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e97e4fc6-a5c6-448e-9efb-d4c56a94a9a1 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:57:11 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-e97e4fc6-a5c6-448e-9efb-d4c56a94a9a1 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Deleted allocations for instance cb230370-0feb-46b5-8837-35fea366b34f
Aug 01 19:57:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e97e4fc6-a5c6-448e-9efb-d4c56a94a9a1 tempest-TestServerVolumeAttachScenarioOldVersion-337134775 tempest-TestServerVolumeAttachScenarioOldVersion-337134775-project-member] Lock "cb230370-0feb-46b5-8837-35fea366b34f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.196s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:57:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:13 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:57:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:14 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:57:15 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:57:15 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:57:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:57:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:57:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:57:15 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:57:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/348a0df3-4865-46b2-a618-a8a519b51c3a/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:57:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/348a0df3-4865-46b2-a618-a8a519b51c3a/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:57:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/348a0df3-4865-46b2-a618-a8a519b51c3a/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:57:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/348a0df3-4865-46b2-a618-a8a519b51c3a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:57:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:57:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:57:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:57:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:57:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9078e730-73ae-4581-901c-418ab48b20ff/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:57:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9078e730-73ae-4581-901c-418ab48b20ff/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:57:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9078e730-73ae-4581-901c-418ab48b20ff/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:57:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9078e730-73ae-4581-901c-418ab48b20ff/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:57:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:57:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:57:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:57:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:57:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:57:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:57:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Acquiring lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:57:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:57:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:57:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:57:17 user nova-compute[72504]: DEBUG nova.compute.manager [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 19:57:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:57:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:57:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:57:17 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:57:17 user nova-compute[72504]: INFO nova.compute.claims [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Claim successful on node user
Aug 01 19:57:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:57:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:57:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:57:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:57:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG nova.network.neutron [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 19:57:18 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 19:57:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG nova.policy [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c54daf483b7e4ab7b177fe06a02c207e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961ea5d0c92447a9853b93335137b5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:57:18 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Creating image(s)
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Acquiring lock "/opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "/opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "/opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.150s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.143s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk 1073741824" returned: 0 in 0.050s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.151s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:57:18 user nova-compute[72504]: DEBUG nova.network.neutron [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Successfully created port: d46af6d6-430b-4d54-a553-937e9bf21d16 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Cannot resize image /opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG nova.objects.instance [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lazy-loading 'migration_context' on Instance uuid de2b2e01-4be0-4709-aacd-f6a7cc2897e0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Ensure instance console log exists: /opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:57:19 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:57:19 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:57:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=7202MB free_disk=25.3055419921875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG nova.network.neutron [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Successfully updated port: d46af6d6-430b-4d54-a553-937e9bf21d16 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Acquiring lock "refresh_cache-de2b2e01-4be0-4709-aacd-f6a7cc2897e0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Acquired lock "refresh_cache-de2b2e01-4be0-4709-aacd-f6a7cc2897e0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG nova.network.neutron [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG nova.compute.manager [req-23290168-5c3c-4619-bf4e-6533909fb797 req-4856eb38-4343-4f45-86f3-aa2d44a3048c service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Received event network-changed-d46af6d6-430b-4d54-a553-937e9bf21d16 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG nova.compute.manager [req-23290168-5c3c-4619-bf4e-6533909fb797 req-4856eb38-4343-4f45-86f3-aa2d44a3048c service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Refreshing instance network info cache due to event network-changed-d46af6d6-430b-4d54-a553-937e9bf21d16. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-23290168-5c3c-4619-bf4e-6533909fb797 req-4856eb38-4343-4f45-86f3-aa2d44a3048c service nova] Acquiring lock "refresh_cache-de2b2e01-4be0-4709-aacd-f6a7cc2897e0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 7391a8ce-7ce5-47ec-97f6-6159645688ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 128c2981-363c-4ae9-b46d-15b5e5d9cac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 5193c770-80ca-44c3-9950-cb25c65e94e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 88f95d20-e391-4100-93b2-da29bfcf9704 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 9078e730-73ae-4581-901c-418ab48b20ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance dad07310-5f62-48f9-a17f-6e960dcf5060 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 348a0df3-4865-46b2-a618-a8a519b51c3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 6377103d-7606-4a5d-a905-6b1439e52c93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance de2b2e01-4be0-4709-aacd-f6a7cc2897e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:57:19 user nova-compute[72504]: DEBUG nova.network.neutron [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.network.neutron [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Updating instance_info_cache with network_info: [{"id": "d46af6d6-430b-4d54-a553-937e9bf21d16", "address": "fa:16:3e:bf:32:31", "network": {"id": "8fe56054-7531-450f-9ddd-4c519a2e4577", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-45399222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd46af6d6-43", "ovs_interfaceid": "d46af6d6-430b-4d54-a553-937e9bf21d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Releasing lock "refresh_cache-de2b2e01-4be0-4709-aacd-f6a7cc2897e0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.compute.manager [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Instance network_info: |[{"id": "d46af6d6-430b-4d54-a553-937e9bf21d16", "address": "fa:16:3e:bf:32:31", "network": {"id": "8fe56054-7531-450f-9ddd-4c519a2e4577", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-45399222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd46af6d6-43", "ovs_interfaceid": "d46af6d6-430b-4d54-a553-937e9bf21d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-23290168-5c3c-4619-bf4e-6533909fb797 req-4856eb38-4343-4f45-86f3-aa2d44a3048c service nova] Acquired lock "refresh_cache-de2b2e01-4be0-4709-aacd-f6a7cc2897e0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.network.neutron [req-23290168-5c3c-4619-bf4e-6533909fb797 req-4856eb38-4343-4f45-86f3-aa2d44a3048c service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Refreshing network info cache for port d46af6d6-430b-4d54-a553-937e9bf21d16 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Start _get_guest_xml network_info=[{"id": "d46af6d6-430b-4d54-a553-937e9bf21d16", "address": "fa:16:3e:bf:32:31", "network": {"id": "8fe56054-7531-450f-9ddd-4c519a2e4577", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-45399222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd46af6d6-43", "ovs_interfaceid": "d46af6d6-430b-4d54-a553-937e9bf21d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:57:20 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:57:20 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2820075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2820075',id=23,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFR6MNT81m0077QoKPCZmUoTwZo1tmyWFZilUMLyic+9WyjHpZo/ciaWRQRs7DELWXer49Euo3w0BX2N62edjBrzmKu9DWAic/6QsdF1qlTj504N9KRmTcmwPyzz0oz/gg==',key_name='tempest-keypair-857323455',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='961ea5d0c92447a9853b93335137b5bc',ramdisk_id='',reservation_id='r-pstr5dkl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-740827412',owner_user_name='tempest-TaggedAttachmentsTest-740827412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:57:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54daf483b7e4ab7b177fe06a02c207e',uuid=de2b2e01-4be0-4709-aacd-f6a7cc2897e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d46af6d6-430b-4d54-a553-937e9bf21d16", "address": "fa:16:3e:bf:32:31", "network": {"id": "8fe56054-7531-450f-9ddd-4c519a2e4577", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-45399222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd46af6d6-43", "ovs_interfaceid": "d46af6d6-430b-4d54-a553-937e9bf21d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Converting VIF {"id": "d46af6d6-430b-4d54-a553-937e9bf21d16", "address": "fa:16:3e:bf:32:31", "network": {"id": "8fe56054-7531-450f-9ddd-4c519a2e4577", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-45399222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd46af6d6-43", "ovs_interfaceid": "d46af6d6-430b-4d54-a553-937e9bf21d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:32:31,bridge_name='br-int',has_traffic_filtering=True,id=d46af6d6-430b-4d54-a553-937e9bf21d16,network=Network(8fe56054-7531-450f-9ddd-4c519a2e4577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd46af6d6-43') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.objects.instance [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lazy-loading 'pci_devices' on Instance uuid de2b2e01-4be0-4709-aacd-f6a7cc2897e0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.580s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:57:20 user nova-compute[72504]:   <uuid>de2b2e01-4be0-4709-aacd-f6a7cc2897e0</uuid>
Aug 01 19:57:20 user nova-compute[72504]:   <name>instance-00000017</name>
Aug 01 19:57:20 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:57:20 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:57:20 user nova-compute[72504]:   <metadata>
Aug 01 19:57:20 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:57:20 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:57:20 user nova-compute[72504]:       <nova:name>tempest-device-tagging-server-2820075</nova:name>
Aug 01 19:57:20 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:57:20</nova:creationTime>
Aug 01 19:57:20 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:57:20 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:57:20 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:57:20 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:57:20 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:57:20 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:57:20 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:57:20 user nova-compute[72504]:       <nova:owner>
Aug 01 19:57:20 user nova-compute[72504]:         <nova:user uuid="c54daf483b7e4ab7b177fe06a02c207e">tempest-TaggedAttachmentsTest-740827412-project-member</nova:user>
Aug 01 19:57:20 user nova-compute[72504]:         <nova:project uuid="961ea5d0c92447a9853b93335137b5bc">tempest-TaggedAttachmentsTest-740827412</nova:project>
Aug 01 19:57:20 user nova-compute[72504]:       </nova:owner>
Aug 01 19:57:20 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:57:20 user nova-compute[72504]:       <nova:ports>
Aug 01 19:57:20 user nova-compute[72504]:         <nova:port uuid="d46af6d6-430b-4d54-a553-937e9bf21d16">
Aug 01 19:57:20 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 19:57:20 user nova-compute[72504]:         </nova:port>
Aug 01 19:57:20 user nova-compute[72504]:       </nova:ports>
Aug 01 19:57:20 user nova-compute[72504]:     </nova:instance>
Aug 01 19:57:20 user nova-compute[72504]:   </metadata>
Aug 01 19:57:20 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:57:20 user nova-compute[72504]:     <system>
Aug 01 19:57:20 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:57:20 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:57:20 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:57:20 user nova-compute[72504]:       <entry name="serial">de2b2e01-4be0-4709-aacd-f6a7cc2897e0</entry>
Aug 01 19:57:20 user nova-compute[72504]:       <entry name="uuid">de2b2e01-4be0-4709-aacd-f6a7cc2897e0</entry>
Aug 01 19:57:20 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:57:20 user nova-compute[72504]:     </system>
Aug 01 19:57:20 user nova-compute[72504]:   </sysinfo>
Aug 01 19:57:20 user nova-compute[72504]:   <os>
Aug 01 19:57:20 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:57:20 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:57:20 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:57:20 user nova-compute[72504]:   </os>
Aug 01 19:57:20 user nova-compute[72504]:   <features>
Aug 01 19:57:20 user nova-compute[72504]:     <acpi/>
Aug 01 19:57:20 user nova-compute[72504]:     <apic/>
Aug 01 19:57:20 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:57:20 user nova-compute[72504]:   </features>
Aug 01 19:57:20 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:57:20 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:57:20 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:57:20 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:57:20 user nova-compute[72504]:   </clock>
Aug 01 19:57:20 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:57:20 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:57:20 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:57:20 user nova-compute[72504]:   </cpu>
Aug 01 19:57:20 user nova-compute[72504]:   <devices>
Aug 01 19:57:20 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:57:20 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:57:20 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk"/>
Aug 01 19:57:20 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:57:20 user nova-compute[72504]:     </disk>
Aug 01 19:57:20 user nova-compute[72504]:     <disk type="file" device="cdrom">
Aug 01 19:57:20 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 19:57:20 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk.config"/>
Aug 01 19:57:20 user nova-compute[72504]:       <target dev="hda" bus="ide"/>
Aug 01 19:57:20 user nova-compute[72504]:     </disk>
Aug 01 19:57:20 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:57:20 user nova-compute[72504]:       <mac address="fa:16:3e:bf:32:31"/>
Aug 01 19:57:20 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:57:20 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:57:20 user nova-compute[72504]:       <target dev="tapd46af6d6-43"/>
Aug 01 19:57:20 user nova-compute[72504]:     </interface>
Aug 01 19:57:20 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:57:20 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/console.log" append="off"/>
Aug 01 19:57:20 user nova-compute[72504]:     </serial>
Aug 01 19:57:20 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:57:20 user nova-compute[72504]:     <video>
Aug 01 19:57:20 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:57:20 user nova-compute[72504]:     </video>
Aug 01 19:57:20 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:57:20 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:57:20 user nova-compute[72504]:     </rng>
Aug 01 19:57:20 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:57:20 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:57:20 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:57:20 user nova-compute[72504]:     </memballoon>
Aug 01 19:57:20 user nova-compute[72504]:   </devices>
Aug 01 19:57:20 user nova-compute[72504]: </domain>
Aug 01 19:57:20 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2820075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2820075',id=23,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFR6MNT81m0077QoKPCZmUoTwZo1tmyWFZilUMLyic+9WyjHpZo/ciaWRQRs7DELWXer49Euo3w0BX2N62edjBrzmKu9DWAic/6QsdF1qlTj504N9KRmTcmwPyzz0oz/gg==',key_name='tempest-keypair-857323455',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='961ea5d0c92447a9853b93335137b5bc',ramdisk_id='',reservation_id='r-pstr5dkl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-740827412',owner_user_name='tempest-TaggedAttachmentsTest-740827412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:57:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54daf483b7e4ab7b177fe06a02c207e',uuid=de2b2e01-4be0-4709-aacd-f6a7cc2897e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d46af6d6-430b-4d54-a553-937e9bf21d16", "address": "fa:16:3e:bf:32:31", "network": {"id": "8fe56054-7531-450f-9ddd-4c519a2e4577", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-45399222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd46af6d6-43", "ovs_interfaceid": "d46af6d6-430b-4d54-a553-937e9bf21d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Converting VIF {"id": "d46af6d6-430b-4d54-a553-937e9bf21d16", "address": "fa:16:3e:bf:32:31", "network": {"id": "8fe56054-7531-450f-9ddd-4c519a2e4577", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-45399222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd46af6d6-43", "ovs_interfaceid": "d46af6d6-430b-4d54-a553-937e9bf21d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:32:31,bridge_name='br-int',has_traffic_filtering=True,id=d46af6d6-430b-4d54-a553-937e9bf21d16,network=Network(8fe56054-7531-450f-9ddd-4c519a2e4577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd46af6d6-43') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG os_vif [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:32:31,bridge_name='br-int',has_traffic_filtering=True,id=d46af6d6-430b-4d54-a553-937e9bf21d16,network=Network(8fe56054-7531-450f-9ddd-4c519a2e4577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd46af6d6-43') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd46af6d6-43, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd46af6d6-43, col_values=(('external_ids', {'iface-id': 'd46af6d6-430b-4d54-a553-937e9bf21d16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:32:31', 'vm-uuid': 'de2b2e01-4be0-4709-aacd-f6a7cc2897e0'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:20 user nova-compute[72504]: INFO os_vif [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:32:31,bridge_name='br-int',has_traffic_filtering=True,id=d46af6d6-430b-4d54-a553-937e9bf21d16,network=Network(8fe56054-7531-450f-9ddd-4c519a2e4577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd46af6d6-43')
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] No BDM found with device name hda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] No VIF found with MAC fa:16:3e:bf:32:31, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:57:20 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Using config drive
Aug 01 19:57:20 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Creating config drive at /opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk.config
Aug 01 19:57:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmivzd8w1 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.network.neutron [req-23290168-5c3c-4619-bf4e-6533909fb797 req-4856eb38-4343-4f45-86f3-aa2d44a3048c service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Updated VIF entry in instance network info cache for port d46af6d6-430b-4d54-a553-937e9bf21d16. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG nova.network.neutron [req-23290168-5c3c-4619-bf4e-6533909fb797 req-4856eb38-4343-4f45-86f3-aa2d44a3048c service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Updating instance_info_cache with network_info: [{"id": "d46af6d6-430b-4d54-a553-937e9bf21d16", "address": "fa:16:3e:bf:32:31", "network": {"id": "8fe56054-7531-450f-9ddd-4c519a2e4577", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-45399222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd46af6d6-43", "ovs_interfaceid": "d46af6d6-430b-4d54-a553-937e9bf21d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-23290168-5c3c-4619-bf4e-6533909fb797 req-4856eb38-4343-4f45-86f3-aa2d44a3048c service nova] Releasing lock "refresh_cache-de2b2e01-4be0-4709-aacd-f6a7cc2897e0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:57:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmivzd8w1" returned: 0 in 0.084s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:57:21 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:57:21 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:57:21 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:57:21 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:57:21 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:57:21 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:57:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:22 user nova-compute[72504]: DEBUG nova.compute.manager [req-de77da14-176f-406a-bcef-8faa41d701a1 req-0c292a86-e7cb-4f23-b931-8b5c32c15d07 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Received event network-vif-plugged-d46af6d6-430b-4d54-a553-937e9bf21d16 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:57:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-de77da14-176f-406a-bcef-8faa41d701a1 req-0c292a86-e7cb-4f23-b931-8b5c32c15d07 service nova] Acquiring lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:57:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-de77da14-176f-406a-bcef-8faa41d701a1 req-0c292a86-e7cb-4f23-b931-8b5c32c15d07 service nova] Lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:57:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-de77da14-176f-406a-bcef-8faa41d701a1 req-0c292a86-e7cb-4f23-b931-8b5c32c15d07 service nova] Lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:57:22 user nova-compute[72504]: DEBUG nova.compute.manager [req-de77da14-176f-406a-bcef-8faa41d701a1 req-0c292a86-e7cb-4f23-b931-8b5c32c15d07 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] No waiting events found dispatching network-vif-plugged-d46af6d6-430b-4d54-a553-937e9bf21d16 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:57:22 user nova-compute[72504]: WARNING nova.compute.manager [req-de77da14-176f-406a-bcef-8faa41d701a1 req-0c292a86-e7cb-4f23-b931-8b5c32c15d07 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Received unexpected event network-vif-plugged-d46af6d6-430b-4d54-a553-937e9bf21d16 for instance with vm_state building and task_state spawning.
Aug 01 19:57:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:22 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:57:22 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:57:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-7391a8ce-7ce5-47ec-97f6-6159645688ea" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:57:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-7391a8ce-7ce5-47ec-97f6-6159645688ea" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:57:22 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 19:57:23 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Updating instance_info_cache with network_info: [{"id": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "address": "fa:16:3e:08:82:e6", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd06cd7-81", "ovs_interfaceid": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:57:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-7391a8ce-7ce5-47ec-97f6-6159645688ea" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:57:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 19:57:24 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690919829.001726, cb230370-0feb-46b5-8837-35fea366b34f => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:57:24 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: cb230370-0feb-46b5-8837-35fea366b34f] VM Stopped (Lifecycle Event)
Aug 01 19:57:24 user nova-compute[72504]: DEBUG nova.compute.manager [None req-8e297ecf-856a-49c3-a9ae-4dc398a8e3f4 None None] [instance: cb230370-0feb-46b5-8837-35fea366b34f] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:57:24 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919844.0266314, de2b2e01-4be0-4709-aacd-f6a7cc2897e0 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:57:24 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] VM Resumed (Lifecycle Event)
Aug 01 19:57:24 user nova-compute[72504]: DEBUG nova.compute.manager [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:57:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:57:24 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Instance spawned successfully.
Aug 01 19:57:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 19:57:24 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:57:24 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:57:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:57:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:57:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:57:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:57:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:57:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:57:24 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:57:24 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919844.0294147, de2b2e01-4be0-4709-aacd-f6a7cc2897e0 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:57:24 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] VM Started (Lifecycle Event)
Aug 01 19:57:24 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:57:24 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:57:24 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:57:24 user nova-compute[72504]: INFO nova.compute.manager [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Took 5.74 seconds to spawn the instance on the hypervisor.
Aug 01 19:57:24 user nova-compute[72504]: DEBUG nova.compute.manager [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:57:24 user nova-compute[72504]: DEBUG nova.compute.manager [req-032a251f-6fb1-46fc-beb3-92358668fd1d req-7405d02c-6a5f-4ec2-83cc-61d33ff68148 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Received event network-vif-plugged-d46af6d6-430b-4d54-a553-937e9bf21d16 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:57:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-032a251f-6fb1-46fc-beb3-92358668fd1d req-7405d02c-6a5f-4ec2-83cc-61d33ff68148 service nova] Acquiring lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:57:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-032a251f-6fb1-46fc-beb3-92358668fd1d req-7405d02c-6a5f-4ec2-83cc-61d33ff68148 service nova] Lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:57:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-032a251f-6fb1-46fc-beb3-92358668fd1d req-7405d02c-6a5f-4ec2-83cc-61d33ff68148 service nova] Lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:57:24 user nova-compute[72504]: DEBUG nova.compute.manager [req-032a251f-6fb1-46fc-beb3-92358668fd1d req-7405d02c-6a5f-4ec2-83cc-61d33ff68148 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] No waiting events found dispatching network-vif-plugged-d46af6d6-430b-4d54-a553-937e9bf21d16 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:57:24 user nova-compute[72504]: WARNING nova.compute.manager [req-032a251f-6fb1-46fc-beb3-92358668fd1d req-7405d02c-6a5f-4ec2-83cc-61d33ff68148 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Received unexpected event network-vif-plugged-d46af6d6-430b-4d54-a553-937e9bf21d16 for instance with vm_state building and task_state spawning.
Aug 01 19:57:24 user nova-compute[72504]: INFO nova.compute.manager [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Took 6.67 seconds to build instance.
Aug 01 19:57:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-78f655c0-7398-417d-a646-1abc8159ca3b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.820s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:57:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:57:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "54812de2-bfe3-46f1-a327-8081fbb80bec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "54812de2-bfe3-46f1-a327-8081fbb80bec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:01 user nova-compute[72504]: DEBUG nova.compute.manager [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 19:58:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:01 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:58:01 user nova-compute[72504]: INFO nova.compute.claims [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Claim successful on node user
Aug 01 19:58:02 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:58:02 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:58:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.624s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:02 user nova-compute[72504]: DEBUG nova.compute.manager [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 19:58:02 user nova-compute[72504]: DEBUG nova.compute.manager [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 19:58:02 user nova-compute[72504]: DEBUG nova.network.neutron [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 19:58:02 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 19:58:02 user nova-compute[72504]: DEBUG nova.compute.manager [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 19:58:02 user nova-compute[72504]: DEBUG nova.compute.manager [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 19:58:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:58:02 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Creating image(s)
Aug 01 19:58:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "/opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "/opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "/opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:02 user nova-compute[72504]: DEBUG nova.policy [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01263cb2c1874026be1c735abc966b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82898c99bce4f04afda7e9ff6e4d5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 19:58:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.180s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.155s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk 1073741824" returned: 0 in 0.071s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.151s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:03 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Checking if we can resize image /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 19:58:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:03 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Cannot resize image /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 19:58:03 user nova-compute[72504]: DEBUG nova.objects.instance [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lazy-loading 'migration_context' on Instance uuid 54812de2-bfe3-46f1-a327-8081fbb80bec {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:58:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 19:58:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Ensure instance console log exists: /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:58:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:03 user nova-compute[72504]: DEBUG nova.network.neutron [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Successfully created port: 2fd02224-faef-4646-ab99-a0871db9b1c2 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.network.neutron [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Successfully updated port: 2fd02224-faef-4646-ab99-a0871db9b1c2 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "refresh_cache-54812de2-bfe3-46f1-a327-8081fbb80bec" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquired lock "refresh_cache-54812de2-bfe3-46f1-a327-8081fbb80bec" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.network.neutron [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-04ee5170-a2cc-4095-bc4c-97e1ac9ec6f1 req-f5e13c40-7bf5-4e8a-9d5f-933e075a535b service nova] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Received event network-changed-2fd02224-faef-4646-ab99-a0871db9b1c2 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-04ee5170-a2cc-4095-bc4c-97e1ac9ec6f1 req-f5e13c40-7bf5-4e8a-9d5f-933e075a535b service nova] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Refreshing instance network info cache due to event network-changed-2fd02224-faef-4646-ab99-a0871db9b1c2. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-04ee5170-a2cc-4095-bc4c-97e1ac9ec6f1 req-f5e13c40-7bf5-4e8a-9d5f-933e075a535b service nova] Acquiring lock "refresh_cache-54812de2-bfe3-46f1-a327-8081fbb80bec" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.network.neutron [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.network.neutron [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Updating instance_info_cache with network_info: [{"id": "2fd02224-faef-4646-ab99-a0871db9b1c2", "address": "fa:16:3e:a7:6e:3a", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fd02224-fa", "ovs_interfaceid": "2fd02224-faef-4646-ab99-a0871db9b1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Releasing lock "refresh_cache-54812de2-bfe3-46f1-a327-8081fbb80bec" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.compute.manager [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Instance network_info: |[{"id": "2fd02224-faef-4646-ab99-a0871db9b1c2", "address": "fa:16:3e:a7:6e:3a", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fd02224-fa", "ovs_interfaceid": "2fd02224-faef-4646-ab99-a0871db9b1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-04ee5170-a2cc-4095-bc4c-97e1ac9ec6f1 req-f5e13c40-7bf5-4e8a-9d5f-933e075a535b service nova] Acquired lock "refresh_cache-54812de2-bfe3-46f1-a327-8081fbb80bec" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.network.neutron [req-04ee5170-a2cc-4095-bc4c-97e1ac9ec6f1 req-f5e13c40-7bf5-4e8a-9d5f-933e075a535b service nova] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Refreshing network info cache for port 2fd02224-faef-4646-ab99-a0871db9b1c2 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Start _get_guest_xml network_info=[{"id": "2fd02224-faef-4646-ab99-a0871db9b1c2", "address": "fa:16:3e:a7:6e:3a", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fd02224-fa", "ovs_interfaceid": "2fd02224-faef-4646-ab99-a0871db9b1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:58:04 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:58:04 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:58:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1282436828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1282436828',id=24,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b82898c99bce4f04afda7e9ff6e4d5db',ramdisk_id='',reservation_id='r-mkrj904w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-519115368',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:58:02Z,user_data=None,user_id='01263cb2c1874026be1c735abc966b45',uuid=54812de2-bfe3-46f1-a327-8081fbb80bec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fd02224-faef-4646-ab99-a0871db9b1c2", "address": "fa:16:3e:a7:6e:3a", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fd02224-fa", "ovs_interfaceid": "2fd02224-faef-4646-ab99-a0871db9b1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Converting VIF {"id": "2fd02224-faef-4646-ab99-a0871db9b1c2", "address": "fa:16:3e:a7:6e:3a", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fd02224-fa", "ovs_interfaceid": "2fd02224-faef-4646-ab99-a0871db9b1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:6e:3a,bridge_name='br-int',has_traffic_filtering=True,id=2fd02224-faef-4646-ab99-a0871db9b1c2,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fd02224-fa') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.objects.instance [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lazy-loading 'pci_devices' on Instance uuid 54812de2-bfe3-46f1-a327-8081fbb80bec {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:58:04 user nova-compute[72504]:   <uuid>54812de2-bfe3-46f1-a327-8081fbb80bec</uuid>
Aug 01 19:58:04 user nova-compute[72504]:   <name>instance-00000018</name>
Aug 01 19:58:04 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:58:04 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:58:04 user nova-compute[72504]:   <metadata>
Aug 01 19:58:04 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:58:04 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:58:04 user nova-compute[72504]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1282436828</nova:name>
Aug 01 19:58:04 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:58:04</nova:creationTime>
Aug 01 19:58:04 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:58:04 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:58:04 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:58:04 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:58:04 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:58:04 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:58:04 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:58:04 user nova-compute[72504]:       <nova:owner>
Aug 01 19:58:04 user nova-compute[72504]:         <nova:user uuid="01263cb2c1874026be1c735abc966b45">tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member</nova:user>
Aug 01 19:58:04 user nova-compute[72504]:         <nova:project uuid="b82898c99bce4f04afda7e9ff6e4d5db">tempest-ServerBootFromVolumeStableRescueTest-519115368</nova:project>
Aug 01 19:58:04 user nova-compute[72504]:       </nova:owner>
Aug 01 19:58:04 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:58:04 user nova-compute[72504]:       <nova:ports>
Aug 01 19:58:04 user nova-compute[72504]:         <nova:port uuid="2fd02224-faef-4646-ab99-a0871db9b1c2">
Aug 01 19:58:04 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 19:58:04 user nova-compute[72504]:         </nova:port>
Aug 01 19:58:04 user nova-compute[72504]:       </nova:ports>
Aug 01 19:58:04 user nova-compute[72504]:     </nova:instance>
Aug 01 19:58:04 user nova-compute[72504]:   </metadata>
Aug 01 19:58:04 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:58:04 user nova-compute[72504]:     <system>
Aug 01 19:58:04 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:58:04 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:58:04 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:58:04 user nova-compute[72504]:       <entry name="serial">54812de2-bfe3-46f1-a327-8081fbb80bec</entry>
Aug 01 19:58:04 user nova-compute[72504]:       <entry name="uuid">54812de2-bfe3-46f1-a327-8081fbb80bec</entry>
Aug 01 19:58:04 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:58:04 user nova-compute[72504]:     </system>
Aug 01 19:58:04 user nova-compute[72504]:   </sysinfo>
Aug 01 19:58:04 user nova-compute[72504]:   <os>
Aug 01 19:58:04 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:58:04 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:58:04 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:58:04 user nova-compute[72504]:   </os>
Aug 01 19:58:04 user nova-compute[72504]:   <features>
Aug 01 19:58:04 user nova-compute[72504]:     <acpi/>
Aug 01 19:58:04 user nova-compute[72504]:     <apic/>
Aug 01 19:58:04 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:58:04 user nova-compute[72504]:   </features>
Aug 01 19:58:04 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:58:04 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:58:04 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:58:04 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:58:04 user nova-compute[72504]:   </clock>
Aug 01 19:58:04 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:58:04 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:58:04 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:58:04 user nova-compute[72504]:   </cpu>
Aug 01 19:58:04 user nova-compute[72504]:   <devices>
Aug 01 19:58:04 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:58:04 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:58:04 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk"/>
Aug 01 19:58:04 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:58:04 user nova-compute[72504]:     </disk>
Aug 01 19:58:04 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:58:04 user nova-compute[72504]:       <mac address="fa:16:3e:a7:6e:3a"/>
Aug 01 19:58:04 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:58:04 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:58:04 user nova-compute[72504]:       <target dev="tap2fd02224-fa"/>
Aug 01 19:58:04 user nova-compute[72504]:     </interface>
Aug 01 19:58:04 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:58:04 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/console.log" append="off"/>
Aug 01 19:58:04 user nova-compute[72504]:     </serial>
Aug 01 19:58:04 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:58:04 user nova-compute[72504]:     <video>
Aug 01 19:58:04 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:58:04 user nova-compute[72504]:     </video>
Aug 01 19:58:04 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:58:04 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:58:04 user nova-compute[72504]:     </rng>
Aug 01 19:58:04 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:58:04 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:58:04 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:58:04 user nova-compute[72504]:     </memballoon>
Aug 01 19:58:04 user nova-compute[72504]:   </devices>
Aug 01 19:58:04 user nova-compute[72504]: </domain>
Aug 01 19:58:04 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:58:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1282436828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1282436828',id=24,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b82898c99bce4f04afda7e9ff6e4d5db',ramdisk_id='',reservation_id='r-mkrj904w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-519115368',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:58:02Z,user_data=None,user_id='01263cb2c1874026be1c735abc966b45',uuid=54812de2-bfe3-46f1-a327-8081fbb80bec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fd02224-faef-4646-ab99-a0871db9b1c2", "address": "fa:16:3e:a7:6e:3a", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fd02224-fa", "ovs_interfaceid": "2fd02224-faef-4646-ab99-a0871db9b1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Converting VIF {"id": "2fd02224-faef-4646-ab99-a0871db9b1c2", "address": "fa:16:3e:a7:6e:3a", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fd02224-fa", "ovs_interfaceid": "2fd02224-faef-4646-ab99-a0871db9b1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:6e:3a,bridge_name='br-int',has_traffic_filtering=True,id=2fd02224-faef-4646-ab99-a0871db9b1c2,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fd02224-fa') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG os_vif [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:6e:3a,bridge_name='br-int',has_traffic_filtering=True,id=2fd02224-faef-4646-ab99-a0871db9b1c2,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fd02224-fa') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2fd02224-fa, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2fd02224-fa, col_values=(('external_ids', {'iface-id': '2fd02224-faef-4646-ab99-a0871db9b1c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:6e:3a', 'vm-uuid': '54812de2-bfe3-46f1-a327-8081fbb80bec'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:04 user nova-compute[72504]: INFO os_vif [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:6e:3a,bridge_name='br-int',has_traffic_filtering=True,id=2fd02224-faef-4646-ab99-a0871db9b1c2,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fd02224-fa')
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:58:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] No VIF found with MAC fa:16:3e:a7:6e:3a, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:58:05 user nova-compute[72504]: DEBUG nova.network.neutron [req-04ee5170-a2cc-4095-bc4c-97e1ac9ec6f1 req-f5e13c40-7bf5-4e8a-9d5f-933e075a535b service nova] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Updated VIF entry in instance network info cache for port 2fd02224-faef-4646-ab99-a0871db9b1c2. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:58:05 user nova-compute[72504]: DEBUG nova.network.neutron [req-04ee5170-a2cc-4095-bc4c-97e1ac9ec6f1 req-f5e13c40-7bf5-4e8a-9d5f-933e075a535b service nova] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Updating instance_info_cache with network_info: [{"id": "2fd02224-faef-4646-ab99-a0871db9b1c2", "address": "fa:16:3e:a7:6e:3a", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fd02224-fa", "ovs_interfaceid": "2fd02224-faef-4646-ab99-a0871db9b1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:58:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-04ee5170-a2cc-4095-bc4c-97e1ac9ec6f1 req-f5e13c40-7bf5-4e8a-9d5f-933e075a535b service nova] Releasing lock "refresh_cache-54812de2-bfe3-46f1-a327-8081fbb80bec" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:58:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:06 user nova-compute[72504]: DEBUG nova.compute.manager [req-0d774308-f1d2-46a9-82d2-b41f1280cb8f req-8ac964b2-f858-444e-a1fc-08843326ee92 service nova] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Received event network-vif-plugged-2fd02224-faef-4646-ab99-a0871db9b1c2 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:58:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0d774308-f1d2-46a9-82d2-b41f1280cb8f req-8ac964b2-f858-444e-a1fc-08843326ee92 service nova] Acquiring lock "54812de2-bfe3-46f1-a327-8081fbb80bec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0d774308-f1d2-46a9-82d2-b41f1280cb8f req-8ac964b2-f858-444e-a1fc-08843326ee92 service nova] Lock "54812de2-bfe3-46f1-a327-8081fbb80bec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0d774308-f1d2-46a9-82d2-b41f1280cb8f req-8ac964b2-f858-444e-a1fc-08843326ee92 service nova] Lock "54812de2-bfe3-46f1-a327-8081fbb80bec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:06 user nova-compute[72504]: DEBUG nova.compute.manager [req-0d774308-f1d2-46a9-82d2-b41f1280cb8f req-8ac964b2-f858-444e-a1fc-08843326ee92 service nova] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] No waiting events found dispatching network-vif-plugged-2fd02224-faef-4646-ab99-a0871db9b1c2 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:58:06 user nova-compute[72504]: WARNING nova.compute.manager [req-0d774308-f1d2-46a9-82d2-b41f1280cb8f req-8ac964b2-f858-444e-a1fc-08843326ee92 service nova] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Received unexpected event network-vif-plugged-2fd02224-faef-4646-ab99-a0871db9b1c2 for instance with vm_state building and task_state spawning.
Aug 01 19:58:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:06 user nova-compute[72504]: INFO nova.compute.manager [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Rescuing
Aug 01 19:58:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "refresh_cache-1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:58:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquired lock "refresh_cache-1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:58:06 user nova-compute[72504]: DEBUG nova.network.neutron [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:58:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:07 user nova-compute[72504]: DEBUG nova.network.neutron [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Updating instance_info_cache with network_info: [{"id": "f0cefd5c-7285-4f5e-b771-61f61039f900", "address": "fa:16:3e:9a:5b:08", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cefd5c-72", "ovs_interfaceid": "f0cefd5c-7285-4f5e-b771-61f61039f900", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:58:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Releasing lock "refresh_cache-1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:58:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:07 user nova-compute[72504]: DEBUG nova.compute.manager [req-ae7f3db6-16cc-41b9-bc33-74cd48d50477 req-4f80a4a8-8952-4e10-a4d0-8dbfa958bf3c service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received event network-vif-unplugged-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:58:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ae7f3db6-16cc-41b9-bc33-74cd48d50477 req-4f80a4a8-8952-4e10-a4d0-8dbfa958bf3c service nova] Acquiring lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ae7f3db6-16cc-41b9-bc33-74cd48d50477 req-4f80a4a8-8952-4e10-a4d0-8dbfa958bf3c service nova] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ae7f3db6-16cc-41b9-bc33-74cd48d50477 req-4f80a4a8-8952-4e10-a4d0-8dbfa958bf3c service nova] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:07 user nova-compute[72504]: DEBUG nova.compute.manager [req-ae7f3db6-16cc-41b9-bc33-74cd48d50477 req-4f80a4a8-8952-4e10-a4d0-8dbfa958bf3c service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] No waiting events found dispatching network-vif-unplugged-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:58:07 user nova-compute[72504]: WARNING nova.compute.manager [req-ae7f3db6-16cc-41b9-bc33-74cd48d50477 req-4f80a4a8-8952-4e10-a4d0-8dbfa958bf3c service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received unexpected event network-vif-unplugged-f0cefd5c-7285-4f5e-b771-61f61039f900 for instance with vm_state active and task_state rescuing.
Aug 01 19:58:08 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Instance destroyed successfully.
Aug 01 19:58:08 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Attempting rescue
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72504) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Instance directory exists: not creating {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 19:58:08 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Creating image(s)
Aug 01 19:58:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "/opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "/opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "/opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.objects.instance [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk.rescue {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk.rescue" returned: 0 in 0.103s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.objects.instance [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'migration_context' on Instance uuid 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Start _get_guest_xml network_info=[{"id": "f0cefd5c-7285-4f5e-b771-61f61039f900", "address": "fa:16:3e:9a:5b:08", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "vif_mac": "fa:16:3e:9a:5b:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cefd5c-72", "ovs_interfaceid": "f0cefd5c-7285-4f5e-b771-61f61039f900", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.objects.instance [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'resources' on Instance uuid 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919888.4732616, 54812de2-bfe3-46f1-a327-8081fbb80bec => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:58:08 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] VM Resumed (Lifecycle Event)
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.compute.manager [req-4826d250-c23d-41d7-8e5f-04ebce98584f req-401e5f9f-72d5-4bdc-b2db-75f838bbb268 service nova] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Received event network-vif-plugged-2fd02224-faef-4646-ab99-a0871db9b1c2 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4826d250-c23d-41d7-8e5f-04ebce98584f req-401e5f9f-72d5-4bdc-b2db-75f838bbb268 service nova] Acquiring lock "54812de2-bfe3-46f1-a327-8081fbb80bec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4826d250-c23d-41d7-8e5f-04ebce98584f req-401e5f9f-72d5-4bdc-b2db-75f838bbb268 service nova] Lock "54812de2-bfe3-46f1-a327-8081fbb80bec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4826d250-c23d-41d7-8e5f-04ebce98584f req-401e5f9f-72d5-4bdc-b2db-75f838bbb268 service nova] Lock "54812de2-bfe3-46f1-a327-8081fbb80bec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.compute.manager [req-4826d250-c23d-41d7-8e5f-04ebce98584f req-401e5f9f-72d5-4bdc-b2db-75f838bbb268 service nova] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] No waiting events found dispatching network-vif-plugged-2fd02224-faef-4646-ab99-a0871db9b1c2 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:58:08 user nova-compute[72504]: WARNING nova.compute.manager [req-4826d250-c23d-41d7-8e5f-04ebce98584f req-401e5f9f-72d5-4bdc-b2db-75f838bbb268 service nova] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Received unexpected event network-vif-plugged-2fd02224-faef-4646-ab99-a0871db9b1c2 for instance with vm_state building and task_state spawning.
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.compute.manager [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.objects.instance [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'numa_topology' on Instance uuid 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:58:08 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Instance spawned successfully.
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:58:08 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:58:08 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:58:08 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919888.474964, 54812de2-bfe3-46f1-a327-8081fbb80bec => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:58:08 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] VM Started (Lifecycle Event)
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.objects.instance [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:53:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1870540243',display_name='tempest-ServerRescueNegativeTestJSON-server-1870540243',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1870540243',id=14,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:53:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='274aed6773224c4fb534aac970d6bb34',ramdisk_id='',reservation_id='r-lhs9qo3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-897201375',owner_user_name='tempest-ServerRescueNegativeTestJSON-897201375-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:53:30Z,user_data=None,user_id='be219e31095441269a1f140a77ad0d57',uuid=1cb0bb6e-66b2-4b74-ae9b-c447b764ec91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0cefd5c-7285-4f5e-b771-61f61039f900", "address": "fa:16:3e:9a:5b:08", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "vif_mac": "fa:16:3e:9a:5b:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cefd5c-72", "ovs_interfaceid": "f0cefd5c-7285-4f5e-b771-61f61039f900", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Converting VIF {"id": "f0cefd5c-7285-4f5e-b771-61f61039f900", "address": "fa:16:3e:9a:5b:08", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "vif_mac": "fa:16:3e:9a:5b:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cefd5c-72", "ovs_interfaceid": "f0cefd5c-7285-4f5e-b771-61f61039f900", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:5b:08,bridge_name='br-int',has_traffic_filtering=True,id=f0cefd5c-7285-4f5e-b771-61f61039f900,network=Network(9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0cefd5c-72') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.objects.instance [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'pci_devices' on Instance uuid 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:58:08 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:58:08 user nova-compute[72504]:   <uuid>1cb0bb6e-66b2-4b74-ae9b-c447b764ec91</uuid>
Aug 01 19:58:08 user nova-compute[72504]:   <name>instance-0000000e</name>
Aug 01 19:58:08 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:58:08 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:58:08 user nova-compute[72504]:   <metadata>
Aug 01 19:58:08 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:58:08 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:58:08 user nova-compute[72504]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1870540243</nova:name>
Aug 01 19:58:08 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:58:08</nova:creationTime>
Aug 01 19:58:08 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:58:08 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:58:08 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:58:08 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:58:08 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:58:08 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:58:08 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:58:08 user nova-compute[72504]:       <nova:owner>
Aug 01 19:58:08 user nova-compute[72504]:         <nova:user uuid="be219e31095441269a1f140a77ad0d57">tempest-ServerRescueNegativeTestJSON-897201375-project-member</nova:user>
Aug 01 19:58:08 user nova-compute[72504]:         <nova:project uuid="274aed6773224c4fb534aac970d6bb34">tempest-ServerRescueNegativeTestJSON-897201375</nova:project>
Aug 01 19:58:08 user nova-compute[72504]:       </nova:owner>
Aug 01 19:58:08 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:58:08 user nova-compute[72504]:       <nova:ports>
Aug 01 19:58:08 user nova-compute[72504]:         <nova:port uuid="f0cefd5c-7285-4f5e-b771-61f61039f900">
Aug 01 19:58:08 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 19:58:08 user nova-compute[72504]:         </nova:port>
Aug 01 19:58:08 user nova-compute[72504]:       </nova:ports>
Aug 01 19:58:08 user nova-compute[72504]:     </nova:instance>
Aug 01 19:58:08 user nova-compute[72504]:   </metadata>
Aug 01 19:58:08 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:58:08 user nova-compute[72504]:     <system>
Aug 01 19:58:08 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:58:08 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:58:08 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:58:08 user nova-compute[72504]:       <entry name="serial">1cb0bb6e-66b2-4b74-ae9b-c447b764ec91</entry>
Aug 01 19:58:08 user nova-compute[72504]:       <entry name="uuid">1cb0bb6e-66b2-4b74-ae9b-c447b764ec91</entry>
Aug 01 19:58:08 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:58:08 user nova-compute[72504]:     </system>
Aug 01 19:58:08 user nova-compute[72504]:   </sysinfo>
Aug 01 19:58:08 user nova-compute[72504]:   <os>
Aug 01 19:58:08 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:58:08 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:58:08 user nova-compute[72504]:   </os>
Aug 01 19:58:08 user nova-compute[72504]:   <features>
Aug 01 19:58:08 user nova-compute[72504]:     <acpi/>
Aug 01 19:58:08 user nova-compute[72504]:     <apic/>
Aug 01 19:58:08 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:58:08 user nova-compute[72504]:   </features>
Aug 01 19:58:08 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:58:08 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:58:08 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:58:08 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:58:08 user nova-compute[72504]:   </clock>
Aug 01 19:58:08 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:58:08 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:58:08 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:58:08 user nova-compute[72504]:   </cpu>
Aug 01 19:58:08 user nova-compute[72504]:   <devices>
Aug 01 19:58:08 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:58:08 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:58:08 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk.rescue"/>
Aug 01 19:58:08 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:58:08 user nova-compute[72504]:     </disk>
Aug 01 19:58:08 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:58:08 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:58:08 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk"/>
Aug 01 19:58:08 user nova-compute[72504]:       <target dev="vdb" bus="virtio"/>
Aug 01 19:58:08 user nova-compute[72504]:     </disk>
Aug 01 19:58:08 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:58:08 user nova-compute[72504]:       <mac address="fa:16:3e:9a:5b:08"/>
Aug 01 19:58:08 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:58:08 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:58:08 user nova-compute[72504]:       <target dev="tapf0cefd5c-72"/>
Aug 01 19:58:08 user nova-compute[72504]:     </interface>
Aug 01 19:58:08 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:58:08 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/console.log" append="off"/>
Aug 01 19:58:08 user nova-compute[72504]:     </serial>
Aug 01 19:58:08 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:58:08 user nova-compute[72504]:     <video>
Aug 01 19:58:08 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:58:08 user nova-compute[72504]:     </video>
Aug 01 19:58:08 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:58:08 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:58:08 user nova-compute[72504]:     </rng>
Aug 01 19:58:08 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:58:08 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:58:08 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:58:08 user nova-compute[72504]:     </memballoon>
Aug 01 19:58:08 user nova-compute[72504]:   </devices>
Aug 01 19:58:08 user nova-compute[72504]: </domain>
Aug 01 19:58:08 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:58:08 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Instance destroyed successfully.
Aug 01 19:58:08 user nova-compute[72504]: INFO nova.compute.manager [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Took 6.24 seconds to spawn the instance on the hypervisor.
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.compute.manager [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:58:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] No VIF found with MAC fa:16:3e:9a:5b:08, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:58:08 user nova-compute[72504]: INFO nova.compute.manager [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Took 7.29 seconds to build instance.
Aug 01 19:58:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c8ade130-a60f-4d34-b590-26553834a65f tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "54812de2-bfe3-46f1-a327-8081fbb80bec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.414s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:10 user nova-compute[72504]: DEBUG nova.compute.manager [req-b42087e3-0d48-4450-954c-fb27b33a709c req-c6998f1d-1b96-4617-8b07-7e6b71cb8da1 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received event network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:58:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b42087e3-0d48-4450-954c-fb27b33a709c req-c6998f1d-1b96-4617-8b07-7e6b71cb8da1 service nova] Acquiring lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b42087e3-0d48-4450-954c-fb27b33a709c req-c6998f1d-1b96-4617-8b07-7e6b71cb8da1 service nova] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b42087e3-0d48-4450-954c-fb27b33a709c req-c6998f1d-1b96-4617-8b07-7e6b71cb8da1 service nova] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:10 user nova-compute[72504]: DEBUG nova.compute.manager [req-b42087e3-0d48-4450-954c-fb27b33a709c req-c6998f1d-1b96-4617-8b07-7e6b71cb8da1 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] No waiting events found dispatching network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:58:10 user nova-compute[72504]: WARNING nova.compute.manager [req-b42087e3-0d48-4450-954c-fb27b33a709c req-c6998f1d-1b96-4617-8b07-7e6b71cb8da1 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received unexpected event network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 for instance with vm_state active and task_state rescuing.
Aug 01 19:58:10 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:10 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:10 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:10 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:10 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:10 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "5193c770-80ca-44c3-9950-cb25c65e94e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:11 user nova-compute[72504]: INFO nova.compute.manager [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Terminating instance
Aug 01 19:58:11 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 19:58:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG nova.compute.manager [req-e0841ffd-39a8-4fc1-8131-816c580003e2 req-4f5cf059-21d5-429a-9894-abbaa7f9381e service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Received event network-vif-unplugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e0841ffd-39a8-4fc1-8131-816c580003e2 req-4f5cf059-21d5-429a-9894-abbaa7f9381e service nova] Acquiring lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e0841ffd-39a8-4fc1-8131-816c580003e2 req-4f5cf059-21d5-429a-9894-abbaa7f9381e service nova] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e0841ffd-39a8-4fc1-8131-816c580003e2 req-4f5cf059-21d5-429a-9894-abbaa7f9381e service nova] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG nova.compute.manager [req-e0841ffd-39a8-4fc1-8131-816c580003e2 req-4f5cf059-21d5-429a-9894-abbaa7f9381e service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] No waiting events found dispatching network-vif-unplugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG nova.compute.manager [req-e0841ffd-39a8-4fc1-8131-816c580003e2 req-4f5cf059-21d5-429a-9894-abbaa7f9381e service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Received event network-vif-unplugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG nova.compute.manager [req-0de935ff-c460-4f33-b178-4764cff5758f req-db218133-5289-44ad-b083-29aef5b0c652 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received event network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0de935ff-c460-4f33-b178-4764cff5758f req-db218133-5289-44ad-b083-29aef5b0c652 service nova] Acquiring lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0de935ff-c460-4f33-b178-4764cff5758f req-db218133-5289-44ad-b083-29aef5b0c652 service nova] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0de935ff-c460-4f33-b178-4764cff5758f req-db218133-5289-44ad-b083-29aef5b0c652 service nova] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG nova.compute.manager [req-0de935ff-c460-4f33-b178-4764cff5758f req-db218133-5289-44ad-b083-29aef5b0c652 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] No waiting events found dispatching network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:58:12 user nova-compute[72504]: WARNING nova.compute.manager [req-0de935ff-c460-4f33-b178-4764cff5758f req-db218133-5289-44ad-b083-29aef5b0c652 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received unexpected event network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 for instance with vm_state active and task_state rescuing.
Aug 01 19:58:12 user nova-compute[72504]: DEBUG nova.compute.manager [req-0de935ff-c460-4f33-b178-4764cff5758f req-db218133-5289-44ad-b083-29aef5b0c652 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received event network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0de935ff-c460-4f33-b178-4764cff5758f req-db218133-5289-44ad-b083-29aef5b0c652 service nova] Acquiring lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0de935ff-c460-4f33-b178-4764cff5758f req-db218133-5289-44ad-b083-29aef5b0c652 service nova] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0de935ff-c460-4f33-b178-4764cff5758f req-db218133-5289-44ad-b083-29aef5b0c652 service nova] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG nova.compute.manager [req-0de935ff-c460-4f33-b178-4764cff5758f req-db218133-5289-44ad-b083-29aef5b0c652 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] No waiting events found dispatching network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:58:12 user nova-compute[72504]: WARNING nova.compute.manager [req-0de935ff-c460-4f33-b178-4764cff5758f req-db218133-5289-44ad-b083-29aef5b0c652 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received unexpected event network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 for instance with vm_state active and task_state rescuing.
Aug 01 19:58:12 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Instance destroyed successfully.
Aug 01 19:58:12 user nova-compute[72504]: DEBUG nova.objects.instance [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lazy-loading 'resources' on Instance uuid 5193c770-80ca-44c3-9950-cb25c65e94e8 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:49:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1940907332',display_name='tempest-ServerActionsTestOtherB-server-1940907332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1940907332',id=3,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzhjBwv/fwyuXjW1x6h8vd/kIx1PP+lp3UGnSLHNEmFgbtKuVpQ2lyUbVPsnNcWUwbyAFXlofeww/O420ZBkncMBF2kewUMxpZllUL90MSl7NE91UoBCSbwKPcmnMcunA==',key_name='tempest-keypair-1272671103',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:55:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6958054d48748c68942fb4d36d5ca8b',ramdisk_id='',reservation_id='r-uhmjifqg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1731713993',owner_user_name='tempest-ServerActionsTestOtherB-1731713993-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:55:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98fd620d741b433ba699e5bbbc5ae1c0',uuid=5193c770-80ca-44c3-9950-cb25c65e94e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Converting VIF {"id": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "address": "fa:16:3e:46:8a:a8", "network": {"id": "a1278c28-de03-4929-8689-60655553da2a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-542724405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6958054d48748c68942fb4d36d5ca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cca03-e1", "ovs_interfaceid": "8f1cca03-e1f6-44db-b8d3-d7a305fc1461", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:8a:a8,bridge_name='br-int',has_traffic_filtering=True,id=8f1cca03-e1f6-44db-b8d3-d7a305fc1461,network=Network(a1278c28-de03-4929-8689-60655553da2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cca03-e1') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG os_vif [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:8a:a8,bridge_name='br-int',has_traffic_filtering=True,id=8f1cca03-e1f6-44db-b8d3-d7a305fc1461,network=Network(a1278c28-de03-4929-8689-60655553da2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cca03-e1') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f1cca03-e1, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:12 user nova-compute[72504]: INFO os_vif [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:8a:a8,bridge_name='br-int',has_traffic_filtering=True,id=8f1cca03-e1f6-44db-b8d3-d7a305fc1461,network=Network(a1278c28-de03-4929-8689-60655553da2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cca03-e1')
Aug 01 19:58:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAHmLCZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:58:12 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:58:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd18f74-8845-4a7a-b27b-53db82d8eeb6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa16e11-20d6-4ad1-9f66-042ad92cfc94]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:58:12 user nova-compute[72504]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)
Aug 01 19:58:12 user nova-compute[72504]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 19:58:12 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:58:12 user nova-compute[72504]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d (non-flash)
Aug 01 19:58:12 user nova-compute[72504]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 19:58:12 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3f4734040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d'): ({'sdc'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Removing single pathed devices sdc {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85e26be-ebac-4abf-954e-1028398060c2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG nova.compute.manager [req-5f214f5f-c401-4a44-bd8b-5e1d49a6b0bd req-86e74320-fa0e-430a-a1b3-2a75c4906cab service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Received event network-changed-4398feea-5235-4138-a257-4c557d89ae8f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG nova.compute.manager [req-5f214f5f-c401-4a44-bd8b-5e1d49a6b0bd req-86e74320-fa0e-430a-a1b3-2a75c4906cab service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Refreshing instance network info cache due to event network-changed-4398feea-5235-4138-a257-4c557d89ae8f. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5f214f5f-c401-4a44-bd8b-5e1d49a6b0bd req-86e74320-fa0e-430a-a1b3-2a75c4906cab service nova] Acquiring lock "refresh_cache-9078e730-73ae-4581-901c-418ab48b20ff" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5f214f5f-c401-4a44-bd8b-5e1d49a6b0bd req-86e74320-fa0e-430a-a1b3-2a75c4906cab service nova] Acquired lock "refresh_cache-9078e730-73ae-4581-901c-418ab48b20ff" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG nova.network.neutron [req-5f214f5f-c401-4a44-bd8b-5e1d49a6b0bd req-86e74320-fa0e-430a-a1b3-2a75c4906cab service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Refreshing network info cache for port 4398feea-5235-4138-a257-4c557d89ae8f {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a8d161-a183-4fa0-9ccc-edca93731471]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Removed pending event for 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 due to event {{(pid=72504) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919892.7401054, 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:58:12 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] VM Resumed (Lifecycle Event)
Aug 01 19:58:12 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Flushing IO for device /dev/sdc {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG nova.compute.manager [None req-13a4def9-2509-47a4-808f-192e0fd9eb29 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[445d1099-d844-417f-9afd-bb5db079fea6]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:58:12 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 19:58:12 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919892.7403657, 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:58:12 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] VM Started (Lifecycle Event)
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5153327a-4607-4f97-a224-caff2325de01]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f693998c-daed-4a99-9843-5d4fc49ac1a7]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5df631-0725-418b-930e-a448b081ce64]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d, portal: 172.16.0.220,3260]
Aug 01 19:58:12 user nova-compute[72504]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d, portal: 172.16.0.220,3260] successful.
Aug 01 19:58:12 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd436d31-78dd-4044-b044-840d1853718d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad73b1c1-116c-489c-8bb4-a406cc4a278b]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] <== disconnect_volume: return (363ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:58:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:58:12 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Deleting instance files /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8_del
Aug 01 19:58:12 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Deletion of /opt/stack/data/nova/instances/5193c770-80ca-44c3-9950-cb25c65e94e8_del complete
Aug 01 19:58:13 user nova-compute[72504]: INFO nova.compute.manager [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Took 1.31 seconds to destroy the instance on the hypervisor.
Aug 01 19:58:13 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 19:58:13 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 19:58:13 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 19:58:13 user nova-compute[72504]: DEBUG nova.network.neutron [req-5f214f5f-c401-4a44-bd8b-5e1d49a6b0bd req-86e74320-fa0e-430a-a1b3-2a75c4906cab service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Updated VIF entry in instance network info cache for port 4398feea-5235-4138-a257-4c557d89ae8f. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:58:13 user nova-compute[72504]: DEBUG nova.network.neutron [req-5f214f5f-c401-4a44-bd8b-5e1d49a6b0bd req-86e74320-fa0e-430a-a1b3-2a75c4906cab service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Updating instance_info_cache with network_info: [{"id": "4398feea-5235-4138-a257-4c557d89ae8f", "address": "fa:16:3e:98:07:e4", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4398feea-52", "ovs_interfaceid": "4398feea-5235-4138-a257-4c557d89ae8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:58:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5f214f5f-c401-4a44-bd8b-5e1d49a6b0bd req-86e74320-fa0e-430a-a1b3-2a75c4906cab service nova] Releasing lock "refresh_cache-9078e730-73ae-4581-901c-418ab48b20ff" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:58:14 user nova-compute[72504]: DEBUG nova.compute.manager [req-6f01ed85-4a04-4b7a-8fc4-44ee72aece72 req-362d4801-ea9a-456b-976a-79286b2a8239 service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Received event network-vif-plugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:58:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6f01ed85-4a04-4b7a-8fc4-44ee72aece72 req-362d4801-ea9a-456b-976a-79286b2a8239 service nova] Acquiring lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6f01ed85-4a04-4b7a-8fc4-44ee72aece72 req-362d4801-ea9a-456b-976a-79286b2a8239 service nova] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6f01ed85-4a04-4b7a-8fc4-44ee72aece72 req-362d4801-ea9a-456b-976a-79286b2a8239 service nova] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:14 user nova-compute[72504]: DEBUG nova.compute.manager [req-6f01ed85-4a04-4b7a-8fc4-44ee72aece72 req-362d4801-ea9a-456b-976a-79286b2a8239 service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] No waiting events found dispatching network-vif-plugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:58:14 user nova-compute[72504]: WARNING nova.compute.manager [req-6f01ed85-4a04-4b7a-8fc4-44ee72aece72 req-362d4801-ea9a-456b-976a-79286b2a8239 service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Received unexpected event network-vif-plugged-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 for instance with vm_state active and task_state deleting.
Aug 01 19:58:14 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:58:14 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Took 1.32 seconds to deallocate network for instance.
Aug 01 19:58:14 user nova-compute[72504]: DEBUG nova.compute.manager [req-a4faecd0-f96e-4594-b47a-c533067de8af req-a7754120-3a07-440f-b541-17535ab84d6d service nova] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Received event network-vif-deleted-8f1cca03-e1f6-44db-b8d3-d7a305fc1461 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:58:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3b417f14-8113-4651-8fb9-fbcb5f431484 tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Acquiring lock "348a0df3-4865-46b2-a618-a8a519b51c3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3b417f14-8113-4651-8fb9-fbcb5f431484 tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Lock "348a0df3-4865-46b2-a618-a8a519b51c3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3b417f14-8113-4651-8fb9-fbcb5f431484 tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Acquiring lock "348a0df3-4865-46b2-a618-a8a519b51c3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3b417f14-8113-4651-8fb9-fbcb5f431484 tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Lock "348a0df3-4865-46b2-a618-a8a519b51c3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3b417f14-8113-4651-8fb9-fbcb5f431484 tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Lock "348a0df3-4865-46b2-a618-a8a519b51c3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:15 user nova-compute[72504]: INFO nova.compute.manager [None req-3b417f14-8113-4651-8fb9-fbcb5f431484 tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Terminating instance
Aug 01 19:58:15 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3b417f14-8113-4651-8fb9-fbcb5f431484 tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 19:58:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:15 user nova-compute[72504]: INFO nova.compute.manager [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Took 1.00 seconds to detach 1 volumes for instance.
Aug 01 19:58:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:15 user nova-compute[72504]: INFO nova.compute.manager [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Rebuilding instance
Aug 01 19:58:15 user nova-compute[72504]: DEBUG nova.objects.instance [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lazy-loading 'trusted_certs' on Instance uuid dad07310-5f62-48f9-a17f-6e960dcf5060 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:58:15 user nova-compute[72504]: DEBUG nova.compute.manager [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:58:15 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:58:15 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Instance destroyed successfully.
Aug 01 19:58:15 user nova-compute[72504]: DEBUG nova.objects.instance [None req-3b417f14-8113-4651-8fb9-fbcb5f431484 tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Lazy-loading 'resources' on Instance uuid 348a0df3-4865-46b2-a618-a8a519b51c3a {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:58:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-3b417f14-8113-4651-8fb9-fbcb5f431484 tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:56:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1119823466',display_name='tempest-VolumesNegativeTest-instance-1119823466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1119823466',id=21,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:56:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d19948bb5cd45aea5387d3d85e3a857',ramdisk_id='',reservation_id='r-r78skqk8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1554442262',owner_user_name='tempest-VolumesNegativeTest-1554442262-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:56:32Z,user_data=None,user_id='bbf49580d2404bb4a6da432a1a1cb400',uuid=348a0df3-4865-46b2-a618-a8a519b51c3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26948185-b1bd-4055-b9c0-fdc3f580e619", "address": "fa:16:3e:b0:53:85", "network": {"id": "0cdf7e28-364b-4bad-909a-04203f8a82aa", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1f3ccc9682a3432089e1cf9400f15af5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26948185-b1", "ovs_interfaceid": "26948185-b1bd-4055-b9c0-fdc3f580e619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:58:15 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-3b417f14-8113-4651-8fb9-fbcb5f431484 tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Converting VIF {"id": "26948185-b1bd-4055-b9c0-fdc3f580e619", "address": "fa:16:3e:b0:53:85", "network": {"id": "0cdf7e28-364b-4bad-909a-04203f8a82aa", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1f3ccc9682a3432089e1cf9400f15af5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26948185-b1", "ovs_interfaceid": "26948185-b1bd-4055-b9c0-fdc3f580e619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:58:15 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-3b417f14-8113-4651-8fb9-fbcb5f431484 tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:85,bridge_name='br-int',has_traffic_filtering=True,id=26948185-b1bd-4055-b9c0-fdc3f580e619,network=Network(0cdf7e28-364b-4bad-909a-04203f8a82aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26948185-b1') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:58:15 user nova-compute[72504]: DEBUG os_vif [None req-3b417f14-8113-4651-8fb9-fbcb5f431484 tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:85,bridge_name='br-int',has_traffic_filtering=True,id=26948185-b1bd-4055-b9c0-fdc3f580e619,network=Network(0cdf7e28-364b-4bad-909a-04203f8a82aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26948185-b1') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:58:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26948185-b1, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:58:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:15 user nova-compute[72504]: INFO os_vif [None req-3b417f14-8113-4651-8fb9-fbcb5f431484 tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:85,bridge_name='br-int',has_traffic_filtering=True,id=26948185-b1bd-4055-b9c0-fdc3f580e619,network=Network(0cdf7e28-364b-4bad-909a-04203f8a82aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26948185-b1')
Aug 01 19:58:15 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-3b417f14-8113-4651-8fb9-fbcb5f431484 tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Deleting instance files /opt/stack/data/nova/instances/348a0df3-4865-46b2-a618-a8a519b51c3a_del
Aug 01 19:58:15 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-3b417f14-8113-4651-8fb9-fbcb5f431484 tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Deletion of /opt/stack/data/nova/instances/348a0df3-4865-46b2-a618-a8a519b51c3a_del complete
Aug 01 19:58:15 user nova-compute[72504]: DEBUG nova.objects.instance [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lazy-loading 'pci_requests' on Instance uuid dad07310-5f62-48f9-a17f-6e960dcf5060 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:58:15 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:58:15 user nova-compute[72504]: DEBUG nova.objects.instance [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lazy-loading 'pci_devices' on Instance uuid dad07310-5f62-48f9-a17f-6e960dcf5060 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG nova.objects.instance [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lazy-loading 'resources' on Instance uuid dad07310-5f62-48f9-a17f-6e960dcf5060 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG nova.objects.instance [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lazy-loading 'migration_context' on Instance uuid dad07310-5f62-48f9-a17f-6e960dcf5060 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.587s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG nova.objects.instance [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72504) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 19:58:16 user nova-compute[72504]: INFO nova.compute.manager [None req-3b417f14-8113-4651-8fb9-fbcb5f431484 tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 01 19:58:16 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-3b417f14-8113-4651-8fb9-fbcb5f431484 tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 19:58:16 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Deleted allocations for instance 5193c770-80ca-44c3-9950-cb25c65e94e8
Aug 01 19:58:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG nova.compute.manager [req-2798e29d-3fee-47b9-b665-6d8682061aa5 req-e0516117-19fd-43c3-a873-3b780609fee1 service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Received event network-changed-6f553f59-1aca-4d1a-af20-0228b74af2f8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG nova.compute.manager [req-2798e29d-3fee-47b9-b665-6d8682061aa5 req-e0516117-19fd-43c3-a873-3b780609fee1 service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Refreshing instance network info cache due to event network-changed-6f553f59-1aca-4d1a-af20-0228b74af2f8. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2798e29d-3fee-47b9-b665-6d8682061aa5 req-e0516117-19fd-43c3-a873-3b780609fee1 service nova] Acquiring lock "refresh_cache-dad07310-5f62-48f9-a17f-6e960dcf5060" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2798e29d-3fee-47b9-b665-6d8682061aa5 req-e0516117-19fd-43c3-a873-3b780609fee1 service nova] Acquired lock "refresh_cache-dad07310-5f62-48f9-a17f-6e960dcf5060" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG nova.network.neutron [req-2798e29d-3fee-47b9-b665-6d8682061aa5 req-e0516117-19fd-43c3-a873-3b780609fee1 service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Refreshing network info cache for port 6f553f59-1aca-4d1a-af20-0228b74af2f8 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7c8837f4-7b10-4201-8296-8f54971c5950 tempest-ServerActionsTestOtherB-1731713993 tempest-ServerActionsTestOtherB-1731713993-project-member] Lock "5193c770-80ca-44c3-9950-cb25c65e94e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.606s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG nova.compute.manager [req-914a7020-1aca-4dab-8ad1-acec9d188f37 req-d243a32a-3aa8-4cc0-a678-0d42f5d5da48 service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Received event network-vif-unplugged-6f553f59-1aca-4d1a-af20-0228b74af2f8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-914a7020-1aca-4dab-8ad1-acec9d188f37 req-d243a32a-3aa8-4cc0-a678-0d42f5d5da48 service nova] Acquiring lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-914a7020-1aca-4dab-8ad1-acec9d188f37 req-d243a32a-3aa8-4cc0-a678-0d42f5d5da48 service nova] Lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-914a7020-1aca-4dab-8ad1-acec9d188f37 req-d243a32a-3aa8-4cc0-a678-0d42f5d5da48 service nova] Lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG nova.compute.manager [req-914a7020-1aca-4dab-8ad1-acec9d188f37 req-d243a32a-3aa8-4cc0-a678-0d42f5d5da48 service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] No waiting events found dispatching network-vif-unplugged-6f553f59-1aca-4d1a-af20-0228b74af2f8 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:58:16 user nova-compute[72504]: WARNING nova.compute.manager [req-914a7020-1aca-4dab-8ad1-acec9d188f37 req-d243a32a-3aa8-4cc0-a678-0d42f5d5da48 service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Received unexpected event network-vif-unplugged-6f553f59-1aca-4d1a-af20-0228b74af2f8 for instance with vm_state active and task_state rebuilding.
Aug 01 19:58:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "9078e730-73ae-4581-901c-418ab48b20ff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "9078e730-73ae-4581-901c-418ab48b20ff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG nova.objects.instance [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lazy-loading 'flavor' on Instance uuid 9078e730-73ae-4581-901c-418ab48b20ff {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "9078e730-73ae-4581-901c-418ab48b20ff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.106s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:16 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Took 0.69 seconds to deallocate network for instance.
Aug 01 19:58:16 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG nova.compute.manager [req-b683c26b-ca4b-4d68-98c3-f15209957aae req-6cf03ded-5930-441d-82fe-095b799ebab8 service nova] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Received event network-vif-deleted-26948185-b1bd-4055-b9c0-fdc3f580e619 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3b417f14-8113-4651-8fb9-fbcb5f431484 tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3b417f14-8113-4651-8fb9-fbcb5f431484 tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:16 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Instance destroyed successfully.
Aug 01 19:58:16 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Instance destroyed successfully.
Aug 01 19:58:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:56:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1651287780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2125575619',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNFzrQ0g9QApzL7h1e01mQviWJQOB+SVoER7DPTzwMDbyzkhT5MJnGE/g2zrEUSsO0fJfQUhubC+mYoonyHOW7N9HSstbnfIyRNkNXhsxk8LTIryb8PGpHTGai5hrxzhA==',key_name='tempest-keypair-451141470',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:56:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9540d878e5ea4bfda3d342e5a78035f5',ramdisk_id='',reservation_id='r-dfez9e0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2015428092',owner_user_name='tempest-ServerActionsV293TestJSON-2015428092-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:58:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97ef13eef2a345909187312f5a62e0f6',uuid=dad07310-5f62-48f9-a17f-6e960dcf5060,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "address": "fa:16:3e:a0:c5:9b", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f553f59-1a", "ovs_interfaceid": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Converting VIF {"id": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "address": "fa:16:3e:a0:c5:9b", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f553f59-1a", "ovs_interfaceid": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:c5:9b,bridge_name='br-int',has_traffic_filtering=True,id=6f553f59-1aca-4d1a-af20-0228b74af2f8,network=Network(d4da5ad8-9045-4076-9f31-ea9faaf8e6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f553f59-1a') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG os_vif [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:c5:9b,bridge_name='br-int',has_traffic_filtering=True,id=6f553f59-1aca-4d1a-af20-0228b74af2f8,network=Network(d4da5ad8-9045-4076-9f31-ea9faaf8e6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f553f59-1a') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f553f59-1a, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:58:16 user nova-compute[72504]: INFO os_vif [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:c5:9b,bridge_name='br-int',has_traffic_filtering=True,id=6f553f59-1aca-4d1a-af20-0228b74af2f8,network=Network(d4da5ad8-9045-4076-9f31-ea9faaf8e6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f553f59-1a')
Aug 01 19:58:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOqgLyDT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:58:16 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 19:58:16 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3055de-a284-49e5-9f30-93f8237749d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "9078e730-73ae-4581-901c-418ab48b20ff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "9078e730-73ae-4581-901c-418ab48b20ff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:17 user nova-compute[72504]: INFO nova.compute.manager [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Attaching volume 137181f9-1cce-42c1-b544-2b84403339b3 to /dev/vdb
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bf9f40-87a4-4ae7-9bc3-66801560b3f7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:58:17 user nova-compute[72504]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 19:58:17 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:58:17 user nova-compute[72504]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 19:58:17 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff4142f9240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51'): ({'sdd'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Removing single pathed devices sdd {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[405add6c-67fc-4815-a0f4-fcedf7a2cdbb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.utils [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.032s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[831af034-1ac8-4300-987f-19aef621d3a0]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Flushing IO for device /dev/sdd {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.031s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4123e32-1f22-4348-80eb-1b6b16515eb5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.036s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ae72ad-cd57-4e58-ab3c-6bce6dc0d104]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.035s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ca946c-2c7c-475a-bd29-8daedcdbec86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3776d5bb-3454-4971-b4e9-97387ef1b5fa]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] SCSI volumes sdd have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03fd93b-215c-4671-8596-525c3150bf8f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO87ca6acc-05dca75d327dad25', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_87ca6acc', '/dev/disk/by-id/scsi-23035646361373564') {{(pid=83379) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[547705ac-618d-46c9-9855-8eb385187e05]: (4, None) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[db921cc9-057f-435b-aeff-d0865a439e33]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[11deeed1-640b-4782-87c5-d9f6e20bc942]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:58:17 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebaa270-1c4e-4aae-a847-8558a9ed04f1]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.utils [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] <== get_connector_properties: return (209ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Updating existing volume attachment record: 3c565d0a-8e99-4477-86ca-66ef6ccfef28 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a00f1c8-3033-431a-86d2-e9a451d60e94]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51, portal: 172.16.0.220,3260]
Aug 01 19:58:17 user nova-compute[72504]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51, portal: 172.16.0.220,3260] successful.
Aug 01 19:58:17 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8a328d-abfb-438e-a491-44cad679c451]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.441s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] <== disconnect_volume: return (442ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:58:17 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Deleting instance files /opt/stack/data/nova/instances/dad07310-5f62-48f9-a17f-6e960dcf5060_del
Aug 01 19:58:17 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Deletion of /opt/stack/data/nova/instances/dad07310-5f62-48f9-a17f-6e960dcf5060_del complete
Aug 01 19:58:17 user nova-compute[72504]: DEBUG nova.network.neutron [req-2798e29d-3fee-47b9-b665-6d8682061aa5 req-e0516117-19fd-43c3-a873-3b780609fee1 service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Updated VIF entry in instance network info cache for port 6f553f59-1aca-4d1a-af20-0228b74af2f8. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG nova.network.neutron [req-2798e29d-3fee-47b9-b665-6d8682061aa5 req-e0516117-19fd-43c3-a873-3b780609fee1 service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Updating instance_info_cache with network_info: [{"id": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "address": "fa:16:3e:a0:c5:9b", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f553f59-1a", "ovs_interfaceid": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2798e29d-3fee-47b9-b665-6d8682061aa5 req-e0516117-19fd-43c3-a873-3b780609fee1 service nova] Releasing lock "refresh_cache-dad07310-5f62-48f9-a17f-6e960dcf5060" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG nova.compute.manager [req-2798e29d-3fee-47b9-b665-6d8682061aa5 req-e0516117-19fd-43c3-a873-3b780609fee1 service nova] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Received event network-vif-unplugged-26948185-b1bd-4055-b9c0-fdc3f580e619 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2798e29d-3fee-47b9-b665-6d8682061aa5 req-e0516117-19fd-43c3-a873-3b780609fee1 service nova] Acquiring lock "348a0df3-4865-46b2-a618-a8a519b51c3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2798e29d-3fee-47b9-b665-6d8682061aa5 req-e0516117-19fd-43c3-a873-3b780609fee1 service nova] Lock "348a0df3-4865-46b2-a618-a8a519b51c3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2798e29d-3fee-47b9-b665-6d8682061aa5 req-e0516117-19fd-43c3-a873-3b780609fee1 service nova] Lock "348a0df3-4865-46b2-a618-a8a519b51c3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG nova.compute.manager [req-2798e29d-3fee-47b9-b665-6d8682061aa5 req-e0516117-19fd-43c3-a873-3b780609fee1 service nova] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] No waiting events found dispatching network-vif-unplugged-26948185-b1bd-4055-b9c0-fdc3f580e619 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG nova.compute.manager [req-2798e29d-3fee-47b9-b665-6d8682061aa5 req-e0516117-19fd-43c3-a873-3b780609fee1 service nova] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Received event network-vif-unplugged-26948185-b1bd-4055-b9c0-fdc3f580e619 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG nova.compute.manager [req-2798e29d-3fee-47b9-b665-6d8682061aa5 req-e0516117-19fd-43c3-a873-3b780609fee1 service nova] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Received event network-vif-plugged-26948185-b1bd-4055-b9c0-fdc3f580e619 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2798e29d-3fee-47b9-b665-6d8682061aa5 req-e0516117-19fd-43c3-a873-3b780609fee1 service nova] Acquiring lock "348a0df3-4865-46b2-a618-a8a519b51c3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2798e29d-3fee-47b9-b665-6d8682061aa5 req-e0516117-19fd-43c3-a873-3b780609fee1 service nova] Lock "348a0df3-4865-46b2-a618-a8a519b51c3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2798e29d-3fee-47b9-b665-6d8682061aa5 req-e0516117-19fd-43c3-a873-3b780609fee1 service nova] Lock "348a0df3-4865-46b2-a618-a8a519b51c3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG nova.compute.manager [req-2798e29d-3fee-47b9-b665-6d8682061aa5 req-e0516117-19fd-43c3-a873-3b780609fee1 service nova] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] No waiting events found dispatching network-vif-plugged-26948185-b1bd-4055-b9c0-fdc3f580e619 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:58:17 user nova-compute[72504]: WARNING nova.compute.manager [req-2798e29d-3fee-47b9-b665-6d8682061aa5 req-e0516117-19fd-43c3-a873-3b780609fee1 service nova] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Received unexpected event network-vif-plugged-26948185-b1bd-4055-b9c0-fdc3f580e619 for instance with vm_state active and task_state deleting.
Aug 01 19:58:17 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-3b417f14-8113-4651-8fb9-fbcb5f431484 tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-3b417f14-8113-4651-8fb9-fbcb5f431484 tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3b417f14-8113-4651-8fb9-fbcb5f431484 tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.680s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:17 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-3b417f14-8113-4651-8fb9-fbcb5f431484 tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Deleted allocations for instance 348a0df3-4865-46b2-a618-a8a519b51c3a
Aug 01 19:58:17 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance dad07310-5f62-48f9-a17f-6e960dcf5060 could not be found.
Aug 01 19:58:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOqgLyDT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:58:17 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4138858e-b6dc-488a-8cd6-5cca0cbe83a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3b417f14-8113-4651-8fb9-fbcb5f431484 tempest-VolumesNegativeTest-1554442262 tempest-VolumesNegativeTest-1554442262-project-member] Lock "348a0df3-4865-46b2-a618-a8a519b51c3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.643s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6297f6d-24e2-4090-a157-b0f1fb3787dc]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:58:17 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:58:17 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3f4595870>, {}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Disconnecting from: [] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.070s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] <== disconnect_volume: return (73ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:17 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:58:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:18 user nova-compute[72504]: DEBUG nova.compute.manager [req-00043c46-a5bf-4baf-bec2-d7e51ac7d84b req-8fdc2541-eb92-4405-a135-15b13dea8f0e service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Received event network-vif-plugged-6f553f59-1aca-4d1a-af20-0228b74af2f8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:58:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-00043c46-a5bf-4baf-bec2-d7e51ac7d84b req-8fdc2541-eb92-4405-a135-15b13dea8f0e service nova] Acquiring lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-00043c46-a5bf-4baf-bec2-d7e51ac7d84b req-8fdc2541-eb92-4405-a135-15b13dea8f0e service nova] Lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-00043c46-a5bf-4baf-bec2-d7e51ac7d84b req-8fdc2541-eb92-4405-a135-15b13dea8f0e service nova] Lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:18 user nova-compute[72504]: DEBUG nova.compute.manager [req-00043c46-a5bf-4baf-bec2-d7e51ac7d84b req-8fdc2541-eb92-4405-a135-15b13dea8f0e service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] No waiting events found dispatching network-vif-plugged-6f553f59-1aca-4d1a-af20-0228b74af2f8 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:58:18 user nova-compute[72504]: WARNING nova.compute.manager [req-00043c46-a5bf-4baf-bec2-d7e51ac7d84b req-8fdc2541-eb92-4405-a135-15b13dea8f0e service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Received unexpected event network-vif-plugged-6f553f59-1aca-4d1a-af20-0228b74af2f8 for instance with vm_state active and task_state rebuilding.
Aug 01 19:58:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Preparing to wait for external event volume-reimaged-313801ef-59d1-4715-8154-c9f8e67c5c51 {{(pid=72504) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 01 19:58:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Acquiring lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:58:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9078e730-73ae-4581-901c-418ab48b20ff/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9078e730-73ae-4581-901c-418ab48b20ff/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9078e730-73ae-4581-901c-418ab48b20ff/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9078e730-73ae-4581-901c-418ab48b20ff/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:22 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:58:22 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:58:22 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=7463MB free_disk=25.300235748291016GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:58:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:22 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:58:22 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 7391a8ce-7ce5-47ec-97f6-6159645688ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:58:22 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:58:22 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 128c2981-363c-4ae9-b46d-15b5e5d9cac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:58:22 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:58:22 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 88f95d20-e391-4100-93b2-da29bfcf9704 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:58:22 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 9078e730-73ae-4581-901c-418ab48b20ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:58:22 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance dad07310-5f62-48f9-a17f-6e960dcf5060 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:58:22 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 6377103d-7606-4a5d-a905-6b1439e52c93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:58:22 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance de2b2e01-4be0-4709-aacd-f6a7cc2897e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:58:22 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 54812de2-bfe3-46f1-a327-8081fbb80bec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:58:22 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:58:22 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:58:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:22 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:58:22 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:58:22 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:58:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.655s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:24 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:58:24 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:58:24 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:58:24 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:58:24 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:58:24 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:58:24 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:58:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:58:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:58:24 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Updating instance_info_cache with network_info: [{"id": "f0cefd5c-7285-4f5e-b771-61f61039f900", "address": "fa:16:3e:9a:5b:08", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cefd5c-72", "ovs_interfaceid": "f0cefd5c-7285-4f5e-b771-61f61039f900", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'skRUeISK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:58:25 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:58:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:58:25 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:58:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:58:25 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[761b9bfc-50f4-4c6b-9def-84ed91ad0f8c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:58:25 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[294db45b-f9cd-4fcf-89cd-6d4669f3b2f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3] added
Aug 01 19:58:25 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5b77c0-1fd3-4211-bf28-c4d94c103fb8]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a8ad8f-8cb6-4b4b-a0bb-9257377b8f16]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v skRUeISK {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v skRUeISK" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5acfbbb-8487-43d0-bd03-d17138a7e871]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'skRUeISK'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa98c8ea-30f7-44c8-a43b-293380737449]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e552c62-c260-4511-a2b3-309f0b0856bd]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:58:25 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:58:25 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e97a0a-b1ea-443d-98d1-cbe603052183]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3, portal: 172.16.0.220,3260]
Aug 01 19:58:25 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3, portal: 172.16.0.220,3260] successful.
Aug 01 19:58:25 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1148f342-eafb-4380-af6b-4280d0f63775]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbce71e-c082-4580-bd60-077995d808f6]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:58:25 user nova-compute[72504]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3 (non-flash)
Aug 01 19:58:25 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:58:25 user nova-compute[72504]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3 (non-flash)
Aug 01 19:58:25 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b157bac9-2496-4388-8299-5bc4cbafb461]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:58:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'skRUeISK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:58:26 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:58:26 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23232353030386463', 'path': '/dev/sdc'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:58:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232353030386463', 'path': '/dev/sdc'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:58:26 user nova-compute[72504]: DEBUG nova.objects.instance [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lazy-loading 'flavor' on Instance uuid 9078e730-73ae-4581-901c-418ab48b20ff {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:58:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 19:58:26 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:58:26 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 19:58:26 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:58:26 user nova-compute[72504]:   <serial>137181f9-1cce-42c1-b544-2b84403339b3</serial>
Aug 01 19:58:26 user nova-compute[72504]: </disk>
Aug 01 19:58:26 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 19:58:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:58:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:58:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] No VIF found with MAC fa:16:3e:98:07:e4, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:58:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3227c4d8-fa60-42c2-a88c-8de890b203e9 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "9078e730-73ae-4581-901c-418ab48b20ff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.419s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:27 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690919892.5424237, 5193c770-80ca-44c3-9950-cb25c65e94e8 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:58:27 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] VM Stopped (Lifecycle Event)
Aug 01 19:58:27 user nova-compute[72504]: DEBUG nova.compute.manager [None req-d897605f-ab77-4e96-884a-a218fcb3165d None None] [instance: 5193c770-80ca-44c3-9950-cb25c65e94e8] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:58:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "9078e730-73ae-4581-901c-418ab48b20ff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "9078e730-73ae-4581-901c-418ab48b20ff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:28 user nova-compute[72504]: INFO nova.compute.manager [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Detaching volume 137181f9-1cce-42c1-b544-2b84403339b3
Aug 01 19:58:28 user nova-compute[72504]: INFO nova.virt.block_device [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Attempting to driver detach volume 137181f9-1cce-42c1-b544-2b84403339b3 from mountpoint /dev/vdb
Aug 01 19:58:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Attempting to detach device vdb from instance 9078e730-73ae-4581-901c-418ab48b20ff from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:58:28 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:58:28 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 19:58:28 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:58:28 user nova-compute[72504]:   <serial>137181f9-1cce-42c1-b544-2b84403339b3</serial>
Aug 01 19:58:28 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 19:58:28 user nova-compute[72504]: </disk>
Aug 01 19:58:28 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:58:28 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Successfully detached device vdb from instance 9078e730-73ae-4581-901c-418ab48b20ff from the persistent domain config.
Aug 01 19:58:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9078e730-73ae-4581-901c-418ab48b20ff from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:58:28 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:58:28 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 19:58:28 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:58:28 user nova-compute[72504]:   <serial>137181f9-1cce-42c1-b544-2b84403339b3</serial>
Aug 01 19:58:28 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 19:58:28 user nova-compute[72504]: </disk>
Aug 01 19:58:28 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690919908.8102975, 9078e730-73ae-4581-901c-418ab48b20ff => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9078e730-73ae-4581-901c-418ab48b20ff {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 19:58:28 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Successfully detached device vdb from instance 9078e730-73ae-4581-901c-418ab48b20ff from the live domain config.
Aug 01 19:58:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'skRUeISK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:58:28 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:58:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[823a426a-4f1f-4aea-8d35-8415a6a14645]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36ff2c2-9b19-49f6-ac35-5400749a904a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:58:28 user nova-compute[72504]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3 (non-flash)
Aug 01 19:58:28 user nova-compute[72504]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 19:58:28 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:58:28 user nova-compute[72504]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3 (non-flash)
Aug 01 19:58:28 user nova-compute[72504]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 19:58:28 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3f4736950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3'): ({'sdc'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Removing single pathed devices sdc {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9837e9a-4087-49bf-90c6-6809f0760958]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[da002632-ad12-4435-850c-fff49526d042]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Flushing IO for device /dev/sdc {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f1f92c-87e3-4cc9-b597-6c68548cb1d8]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28fabb6-0378-4eb6-ac5e-adbd5710d992]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:58:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:29 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f41d375-7078-4378-8c38-66160574613a]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:58:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:29 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0093653-06ac-43f1-b416-6f20b3312850]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3, portal: 172.16.0.220,3260]
Aug 01 19:58:29 user nova-compute[72504]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3, portal: 172.16.0.220,3260] successful.
Aug 01 19:58:29 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:58:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137181f9-1cce-42c1-b544-2b84403339b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:29 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14fc4c1-d784-43c3-ba3f-ad933d2daf48]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:58:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:58:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] <== disconnect_volume: return (280ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:58:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:58:29 user nova-compute[72504]: DEBUG nova.objects.instance [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lazy-loading 'flavor' on Instance uuid 9078e730-73ae-4581-901c-418ab48b20ff {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:58:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5841a5a2-a81c-4d8b-9c87-d07ae376a87b tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "9078e730-73ae-4581-901c-418ab48b20ff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.739s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:30 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690919895.8790014, 348a0df3-4865-46b2-a618-a8a519b51c3a => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:58:30 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] VM Stopped (Lifecycle Event)
Aug 01 19:58:30 user nova-compute[72504]: DEBUG nova.compute.manager [None req-4bb277f1-692b-4e56-a452-861c083718dc None None] [instance: 348a0df3-4865-46b2-a618-a8a519b51c3a] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:58:31 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690919896.885885, dad07310-5f62-48f9-a17f-6e960dcf5060 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:58:31 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] VM Stopped (Lifecycle Event)
Aug 01 19:58:31 user nova-compute[72504]: DEBUG nova.compute.manager [None req-dc70eda1-3842-474e-afe6-3cbca373b114 None None] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:58:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:35 user nova-compute[72504]: DEBUG nova.compute.manager [req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 req-a26b9cd4-4a84-4894-af09-cce37c16ba89 service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Received event volume-reimaged-313801ef-59d1-4715-8154-c9f8e67c5c51 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:58:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 req-a26b9cd4-4a84-4894-af09-cce37c16ba89 service nova] Acquiring lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 req-a26b9cd4-4a84-4894-af09-cce37c16ba89 service nova] Lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 req-a26b9cd4-4a84-4894-af09-cce37c16ba89 service nova] Lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:35 user nova-compute[72504]: DEBUG nova.compute.manager [req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 req-a26b9cd4-4a84-4894-af09-cce37c16ba89 service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Processing event volume-reimaged-313801ef-59d1-4715-8154-c9f8e67c5c51 {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 01 19:58:35 user nova-compute[72504]: DEBUG nova.compute.manager [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Instance event wait completed in 16 seconds for volume-reimaged {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:58:35 user nova-compute[72504]: INFO nova.virt.block_device [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Booting with volume 313801ef-59d1-4715-8154-c9f8e67c5c51 at /dev/vda
Aug 01 19:58:35 user nova-compute[72504]: DEBUG os_brick.utils [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:58:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:35 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b694fb79-3a3a-41c7-bb21-e05f163077ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:35 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[faefe3a8-a78c-447a-8ab0-4a9df54273d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:35 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d256f770-121a-4dce-89c7-651a13cef62a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:35 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6716fc-a28e-43d3-af56-50f823876b67]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:58:35 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:58:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:58:35 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:58:35 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7229ea-be83-4ca2-b8db-7c4137cfdeb7]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:35 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:58:35 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:58:35 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:58:35 user nova-compute[72504]: DEBUG os_brick.utils [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:58:35 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Updating existing volume attachment record: 0614ccd8-06dc-4bbe-be06-5f9563b21b2e {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:58:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:58:43 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Creating image(s)
Aug 01 19:58:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Did not create local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Ensure instance console log exists: /opt/stack/data/nova/instances/dad07310-5f62-48f9-a17f-6e960dcf5060/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Start _get_guest_xml network_info=[{"id": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "address": "fa:16:3e:a0:c5:9b", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f553f59-1a", "ovs_interfaceid": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOqgLyDT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dad07310-5f62-48f9-a17f-6e960dcf5060', 'attached_at': '', 'detached_at': '', 'volume_id': '313801ef-59d1-4715-8154-c9f8e67c5c51', 'serial': '313801ef-59d1-4715-8154-c9f8e67c5c51'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': '0614ccd8-06dc-4bbe-be06-5f9563b21b2e', 'volume_type': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:58:43 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 19:58:43 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 19:58:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG nova.objects.instance [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lazy-loading 'vcpu_model' on Instance uuid dad07310-5f62-48f9-a17f-6e960dcf5060 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOqgLyDT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:58:43 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 19:58:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:58:43 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 19:58:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:58:43 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab1f217-4724-48a6-ba6b-cb733837b5e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:58:43 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[559b00f7-4443-4488-b600-2186cf829c6d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51] added
Aug 01 19:58:43 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c6f25b-88c6-4cf1-85a1-c08348680092]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f613e255-9c78-45af-9605-30d5cd3f893a]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YOqgLyDT {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YOqgLyDT" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[56653e2c-0dd7-45e0-802f-9a544a0b80b7]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YOqgLyDT'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d98332-5aba-4025-b9ed-17300f3701db]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[19256e71-14ab-4eef-8b0d-ac68ce388d3e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ec0650-86b3-43d7-b56f-f4cffe77614a (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:58:43 user nova-compute[72504]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ec0650-86b3-43d7-b56f-f4cffe77614a (non-flash)
Aug 01 19:58:43 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:58:43 user nova-compute[72504]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ec0650-86b3-43d7-b56f-f4cffe77614a (non-flash)
Aug 01 19:58:43 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[be418fdd-d214-465c-bf15-7202929875b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51, portal: 172.16.0.220,3260]
Aug 01 19:58:43 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51, portal: 172.16.0.220,3260] successful.
Aug 01 19:58:43 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dbde88-48a1-42c3-955c-0c4694571075]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb16c0a-5c54-4e43-a79d-5ff92192e87a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ec0650-86b3-43d7-b56f-f4cffe77614a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:58:43 user nova-compute[72504]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ec0650-86b3-43d7-b56f-f4cffe77614a (non-flash)
Aug 01 19:58:43 user nova-compute[72504]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 19:58:43 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:58:43 user nova-compute[72504]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ec0650-86b3-43d7-b56f-f4cffe77614a (non-flash)
Aug 01 19:58:43 user nova-compute[72504]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 19:58:43 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fa9cec-99a8-449f-bd7c-cccfa0bd0cb1]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:58:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOqgLyDT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:58:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:58:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23035646361373564', 'path': '/dev/sdd'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:58:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035646361373564', 'path': '/dev/sdd'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:58:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T19:56:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1651287780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2125575619',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNFzrQ0g9QApzL7h1e01mQviWJQOB+SVoER7DPTzwMDbyzkhT5MJnGE/g2zrEUSsO0fJfQUhubC+mYoonyHOW7N9HSstbnfIyRNkNXhsxk8LTIryb8PGpHTGai5hrxzhA==',key_name='tempest-keypair-451141470',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:56:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9540d878e5ea4bfda3d342e5a78035f5',ramdisk_id='',reservation_id='r-dfez9e0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2015428092',owner_user_name='tempest-ServerActionsV293TestJSON-2015428092-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97ef13eef2a345909187312f5a62e0f6',uuid=dad07310-5f62-48f9-a17f-6e960dcf5060,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "address": "fa:16:3e:a0:c5:9b", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f553f59-1a", "ovs_interfaceid": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:58:44 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Converting VIF {"id": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "address": "fa:16:3e:a0:c5:9b", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f553f59-1a", "ovs_interfaceid": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:58:44 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:c5:9b,bridge_name='br-int',has_traffic_filtering=True,id=6f553f59-1aca-4d1a-af20-0228b74af2f8,network=Network(d4da5ad8-9045-4076-9f31-ea9faaf8e6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f553f59-1a') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:58:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:58:44 user nova-compute[72504]:   <uuid>dad07310-5f62-48f9-a17f-6e960dcf5060</uuid>
Aug 01 19:58:44 user nova-compute[72504]:   <name>instance-00000014</name>
Aug 01 19:58:44 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:58:44 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:58:44 user nova-compute[72504]:   <metadata>
Aug 01 19:58:44 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:58:44 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:58:44 user nova-compute[72504]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1651287780</nova:name>
Aug 01 19:58:44 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:58:43</nova:creationTime>
Aug 01 19:58:44 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:58:44 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:58:44 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:58:44 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:58:44 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:58:44 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:58:44 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:58:44 user nova-compute[72504]:       <nova:owner>
Aug 01 19:58:44 user nova-compute[72504]:         <nova:user uuid="97ef13eef2a345909187312f5a62e0f6">tempest-ServerActionsV293TestJSON-2015428092-project-member</nova:user>
Aug 01 19:58:44 user nova-compute[72504]:         <nova:project uuid="9540d878e5ea4bfda3d342e5a78035f5">tempest-ServerActionsV293TestJSON-2015428092</nova:project>
Aug 01 19:58:44 user nova-compute[72504]:       </nova:owner>
Aug 01 19:58:44 user nova-compute[72504]:       <nova:ports>
Aug 01 19:58:44 user nova-compute[72504]:         <nova:port uuid="6f553f59-1aca-4d1a-af20-0228b74af2f8">
Aug 01 19:58:44 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 19:58:44 user nova-compute[72504]:         </nova:port>
Aug 01 19:58:44 user nova-compute[72504]:       </nova:ports>
Aug 01 19:58:44 user nova-compute[72504]:     </nova:instance>
Aug 01 19:58:44 user nova-compute[72504]:   </metadata>
Aug 01 19:58:44 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:58:44 user nova-compute[72504]:     <system>
Aug 01 19:58:44 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:58:44 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:58:44 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:58:44 user nova-compute[72504]:       <entry name="serial">dad07310-5f62-48f9-a17f-6e960dcf5060</entry>
Aug 01 19:58:44 user nova-compute[72504]:       <entry name="uuid">dad07310-5f62-48f9-a17f-6e960dcf5060</entry>
Aug 01 19:58:44 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:58:44 user nova-compute[72504]:     </system>
Aug 01 19:58:44 user nova-compute[72504]:   </sysinfo>
Aug 01 19:58:44 user nova-compute[72504]:   <os>
Aug 01 19:58:44 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:58:44 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:58:44 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:58:44 user nova-compute[72504]:   </os>
Aug 01 19:58:44 user nova-compute[72504]:   <features>
Aug 01 19:58:44 user nova-compute[72504]:     <acpi/>
Aug 01 19:58:44 user nova-compute[72504]:     <apic/>
Aug 01 19:58:44 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:58:44 user nova-compute[72504]:   </features>
Aug 01 19:58:44 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:58:44 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:58:44 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:58:44 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:58:44 user nova-compute[72504]:   </clock>
Aug 01 19:58:44 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:58:44 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:58:44 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:58:44 user nova-compute[72504]:   </cpu>
Aug 01 19:58:44 user nova-compute[72504]:   <devices>
Aug 01 19:58:44 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 19:58:44 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:58:44 user nova-compute[72504]:       <source dev="/dev/sdd"/>
Aug 01 19:58:44 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:58:44 user nova-compute[72504]:       <serial>313801ef-59d1-4715-8154-c9f8e67c5c51</serial>
Aug 01 19:58:44 user nova-compute[72504]:     </disk>
Aug 01 19:58:44 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:58:44 user nova-compute[72504]:       <mac address="fa:16:3e:a0:c5:9b"/>
Aug 01 19:58:44 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:58:44 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:58:44 user nova-compute[72504]:       <target dev="tap6f553f59-1a"/>
Aug 01 19:58:44 user nova-compute[72504]:     </interface>
Aug 01 19:58:44 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:58:44 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/dad07310-5f62-48f9-a17f-6e960dcf5060/console.log" append="off"/>
Aug 01 19:58:44 user nova-compute[72504]:     </serial>
Aug 01 19:58:44 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:58:44 user nova-compute[72504]:     <video>
Aug 01 19:58:44 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:58:44 user nova-compute[72504]:     </video>
Aug 01 19:58:44 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:58:44 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:58:44 user nova-compute[72504]:     </rng>
Aug 01 19:58:44 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:58:44 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:58:44 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:58:44 user nova-compute[72504]:     </memballoon>
Aug 01 19:58:44 user nova-compute[72504]:   </devices>
Aug 01 19:58:44 user nova-compute[72504]: </domain>
Aug 01 19:58:44 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:58:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T19:56:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1651287780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2125575619',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNFzrQ0g9QApzL7h1e01mQviWJQOB+SVoER7DPTzwMDbyzkhT5MJnGE/g2zrEUSsO0fJfQUhubC+mYoonyHOW7N9HSstbnfIyRNkNXhsxk8LTIryb8PGpHTGai5hrxzhA==',key_name='tempest-keypair-451141470',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:56:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9540d878e5ea4bfda3d342e5a78035f5',ramdisk_id='',reservation_id='r-dfez9e0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2015428092',owner_user_name='tempest-ServerActionsV293TestJSON-2015428092-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97ef13eef2a345909187312f5a62e0f6',uuid=dad07310-5f62-48f9-a17f-6e960dcf5060,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "address": "fa:16:3e:a0:c5:9b", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f553f59-1a", "ovs_interfaceid": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:58:44 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Converting VIF {"id": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "address": "fa:16:3e:a0:c5:9b", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f553f59-1a", "ovs_interfaceid": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:58:44 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:c5:9b,bridge_name='br-int',has_traffic_filtering=True,id=6f553f59-1aca-4d1a-af20-0228b74af2f8,network=Network(d4da5ad8-9045-4076-9f31-ea9faaf8e6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f553f59-1a') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:58:44 user nova-compute[72504]: DEBUG os_vif [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:c5:9b,bridge_name='br-int',has_traffic_filtering=True,id=6f553f59-1aca-4d1a-af20-0228b74af2f8,network=Network(d4da5ad8-9045-4076-9f31-ea9faaf8e6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f553f59-1a') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:58:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:58:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:58:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f553f59-1a, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:58:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6f553f59-1a, col_values=(('external_ids', {'iface-id': '6f553f59-1aca-4d1a-af20-0228b74af2f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:c5:9b', 'vm-uuid': 'dad07310-5f62-48f9-a17f-6e960dcf5060'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:58:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:58:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:44 user nova-compute[72504]: INFO os_vif [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:c5:9b,bridge_name='br-int',has_traffic_filtering=True,id=6f553f59-1aca-4d1a-af20-0228b74af2f8,network=Network(d4da5ad8-9045-4076-9f31-ea9faaf8e6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f553f59-1a')
Aug 01 19:58:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:58:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] No VIF found with MAC fa:16:3e:a0:c5:9b, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:58:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:45 user nova-compute[72504]: DEBUG nova.compute.manager [req-2bf9e61a-cb74-4631-b8f6-3d0e9a66719a req-5b8f356e-4dca-46b5-b93b-882f86ee794e service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Received event network-vif-plugged-6f553f59-1aca-4d1a-af20-0228b74af2f8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:58:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2bf9e61a-cb74-4631-b8f6-3d0e9a66719a req-5b8f356e-4dca-46b5-b93b-882f86ee794e service nova] Acquiring lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2bf9e61a-cb74-4631-b8f6-3d0e9a66719a req-5b8f356e-4dca-46b5-b93b-882f86ee794e service nova] Lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2bf9e61a-cb74-4631-b8f6-3d0e9a66719a req-5b8f356e-4dca-46b5-b93b-882f86ee794e service nova] Lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:45 user nova-compute[72504]: DEBUG nova.compute.manager [req-2bf9e61a-cb74-4631-b8f6-3d0e9a66719a req-5b8f356e-4dca-46b5-b93b-882f86ee794e service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] No waiting events found dispatching network-vif-plugged-6f553f59-1aca-4d1a-af20-0228b74af2f8 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:58:45 user nova-compute[72504]: WARNING nova.compute.manager [req-2bf9e61a-cb74-4631-b8f6-3d0e9a66719a req-5b8f356e-4dca-46b5-b93b-882f86ee794e service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Received unexpected event network-vif-plugged-6f553f59-1aca-4d1a-af20-0228b74af2f8 for instance with vm_state active and task_state rebuild_spawning.
Aug 01 19:58:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:48 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919928.0109367, dad07310-5f62-48f9-a17f-6e960dcf5060 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:58:48 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] VM Resumed (Lifecycle Event)
Aug 01 19:58:48 user nova-compute[72504]: DEBUG nova.compute.manager [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:58:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:58:48 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Instance spawned successfully.
Aug 01 19:58:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 19:58:48 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:58:48 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:58:48 user nova-compute[72504]: DEBUG nova.compute.manager [req-42d53d15-20dc-4d6e-ab1a-1fda3c8344ed req-c825c45e-8678-4140-946f-e65204f99b13 service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Received event network-vif-plugged-6f553f59-1aca-4d1a-af20-0228b74af2f8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:58:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-42d53d15-20dc-4d6e-ab1a-1fda3c8344ed req-c825c45e-8678-4140-946f-e65204f99b13 service nova] Acquiring lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-42d53d15-20dc-4d6e-ab1a-1fda3c8344ed req-c825c45e-8678-4140-946f-e65204f99b13 service nova] Lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-42d53d15-20dc-4d6e-ab1a-1fda3c8344ed req-c825c45e-8678-4140-946f-e65204f99b13 service nova] Lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:48 user nova-compute[72504]: DEBUG nova.compute.manager [req-42d53d15-20dc-4d6e-ab1a-1fda3c8344ed req-c825c45e-8678-4140-946f-e65204f99b13 service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] No waiting events found dispatching network-vif-plugged-6f553f59-1aca-4d1a-af20-0228b74af2f8 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:58:48 user nova-compute[72504]: WARNING nova.compute.manager [req-42d53d15-20dc-4d6e-ab1a-1fda3c8344ed req-c825c45e-8678-4140-946f-e65204f99b13 service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Received unexpected event network-vif-plugged-6f553f59-1aca-4d1a-af20-0228b74af2f8 for instance with vm_state active and task_state rebuild_spawning.
Aug 01 19:58:48 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 19:58:48 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919928.0206754, dad07310-5f62-48f9-a17f-6e960dcf5060 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:58:48 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] VM Started (Lifecycle Event)
Aug 01 19:58:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:58:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:58:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:58:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:58:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:58:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:58:48 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:58:48 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:58:48 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 19:58:48 user nova-compute[72504]: DEBUG nova.compute.manager [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:58:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:48 user nova-compute[72504]: DEBUG nova.objects.instance [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72504) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 19:58:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-bdcc16d1-0fee-4b49-b535-c9cf3a772163 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.119s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:50 user nova-compute[72504]: DEBUG nova.compute.manager [req-facab4a3-14dd-445b-84c4-cd7dc6800248 req-084d9658-f747-42d1-9cbf-ed161b05772c service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received event network-changed-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:58:50 user nova-compute[72504]: DEBUG nova.compute.manager [req-facab4a3-14dd-445b-84c4-cd7dc6800248 req-084d9658-f747-42d1-9cbf-ed161b05772c service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Refreshing instance network info cache due to event network-changed-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:58:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-facab4a3-14dd-445b-84c4-cd7dc6800248 req-084d9658-f747-42d1-9cbf-ed161b05772c service nova] Acquiring lock "refresh_cache-6377103d-7606-4a5d-a905-6b1439e52c93" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:58:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-facab4a3-14dd-445b-84c4-cd7dc6800248 req-084d9658-f747-42d1-9cbf-ed161b05772c service nova] Acquired lock "refresh_cache-6377103d-7606-4a5d-a905-6b1439e52c93" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:58:50 user nova-compute[72504]: DEBUG nova.network.neutron [req-facab4a3-14dd-445b-84c4-cd7dc6800248 req-084d9658-f747-42d1-9cbf-ed161b05772c service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Refreshing network info cache for port 9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:58:50 user nova-compute[72504]: DEBUG nova.network.neutron [req-facab4a3-14dd-445b-84c4-cd7dc6800248 req-084d9658-f747-42d1-9cbf-ed161b05772c service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Updated VIF entry in instance network info cache for port 9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:58:50 user nova-compute[72504]: DEBUG nova.network.neutron [req-facab4a3-14dd-445b-84c4-cd7dc6800248 req-084d9658-f747-42d1-9cbf-ed161b05772c service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Updating instance_info_cache with network_info: [{"id": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "address": "fa:16:3e:3e:71:62", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9af0b4bf-bc", "ovs_interfaceid": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:58:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-facab4a3-14dd-445b-84c4-cd7dc6800248 req-084d9658-f747-42d1-9cbf-ed161b05772c service nova] Releasing lock "refresh_cache-6377103d-7606-4a5d-a905-6b1439e52c93" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:58:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "6377103d-7606-4a5d-a905-6b1439e52c93" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "6377103d-7606-4a5d-a905-6b1439e52c93" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:54 user nova-compute[72504]: INFO nova.compute.manager [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Shelving
Aug 01 19:58:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-e7797d8c-8e3e-4de6-9851-1693519c6ec0 req-808a4880-bcc7-4fea-9bc2-43dd4c620a7c service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received event network-vif-unplugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:58:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e7797d8c-8e3e-4de6-9851-1693519c6ec0 req-808a4880-bcc7-4fea-9bc2-43dd4c620a7c service nova] Acquiring lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e7797d8c-8e3e-4de6-9851-1693519c6ec0 req-808a4880-bcc7-4fea-9bc2-43dd4c620a7c service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e7797d8c-8e3e-4de6-9851-1693519c6ec0 req-808a4880-bcc7-4fea-9bc2-43dd4c620a7c service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-e7797d8c-8e3e-4de6-9851-1693519c6ec0 req-808a4880-bcc7-4fea-9bc2-43dd4c620a7c service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] No waiting events found dispatching network-vif-unplugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:58:55 user nova-compute[72504]: WARNING nova.compute.manager [req-e7797d8c-8e3e-4de6-9851-1693519c6ec0 req-808a4880-bcc7-4fea-9bc2-43dd4c620a7c service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received unexpected event network-vif-unplugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e for instance with vm_state active and task_state shelving.
Aug 01 19:58:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:55 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Instance destroyed successfully.
Aug 01 19:58:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:55 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Beginning cold snapshot process
Aug 01 19:58:55 user nova-compute[72504]: DEBUG nova.privsep.utils [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72504) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 19:58:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk /opt/stack/data/nova/instances/snapshots/tmpmz1njeyq/33220228a5da4dc3a328e402843bea2d {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk /opt/stack/data/nova/instances/snapshots/tmpmz1njeyq/33220228a5da4dc3a328e402843bea2d" returned: 0 in 0.994s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:56 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Snapshot extracted, beginning image upload
Aug 01 19:58:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received event network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] Acquiring lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] No waiting events found dispatching network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:58:57 user nova-compute[72504]: WARNING nova.compute.manager [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received unexpected event network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e for instance with vm_state active and task_state shelving_image_uploading.
Aug 01 19:58:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received event network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] Acquiring lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] No waiting events found dispatching network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:58:57 user nova-compute[72504]: WARNING nova.compute.manager [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received unexpected event network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e for instance with vm_state active and task_state shelving_image_uploading.
Aug 01 19:58:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received event network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] Acquiring lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] No waiting events found dispatching network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:58:57 user nova-compute[72504]: WARNING nova.compute.manager [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received unexpected event network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e for instance with vm_state active and task_state shelving_image_uploading.
Aug 01 19:58:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received event network-vif-unplugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] Acquiring lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] No waiting events found dispatching network-vif-unplugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:58:57 user nova-compute[72504]: WARNING nova.compute.manager [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received unexpected event network-vif-unplugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e for instance with vm_state active and task_state shelving_image_uploading.
Aug 01 19:58:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received event network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] Acquiring lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] No waiting events found dispatching network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:58:57 user nova-compute[72504]: WARNING nova.compute.manager [req-b2e4fc10-ca4a-4206-99d5-43f5a20c7a13 req-6ec43497-5d73-4b9a-931f-b36a3968c11e service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received unexpected event network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e for instance with vm_state active and task_state shelving_image_uploading.
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "88f95d20-e391-4100-93b2-da29bfcf9704" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "88f95d20-e391-4100-93b2-da29bfcf9704" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG nova.objects.instance [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lazy-loading 'flavor' on Instance uuid 88f95d20-e391-4100-93b2-da29bfcf9704 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "88f95d20-e391-4100-93b2-da29bfcf9704" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "88f95d20-e391-4100-93b2-da29bfcf9704" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "88f95d20-e391-4100-93b2-da29bfcf9704" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:58:57 user nova-compute[72504]: INFO nova.compute.manager [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Attaching volume c3b5577d-9370-489d-b16f-1a88059a3d51 to /dev/vdb
Aug 01 19:58:57 user nova-compute[72504]: DEBUG os_brick.utils [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8272a437-ea78-4da0-88fe-1f14b4f796a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d68ca6a-f213-46b4-8a5c-f7200f282933]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7b70f0-b53b-4d0e-9242-712d8ee5775d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dd4649-1ac9-412e-979a-d64ab79ff64e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:58:57 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:58:57 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea85910-9fa3-4a4c-a396-b06cfd28bff8]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG os_brick.utils [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:58:57 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Updating existing volume attachment record: 02f58cb1-2055-47bd-b047-a5f4847cf8c0 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:58:59 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Snapshot image upload complete
Aug 01 19:58:59 user nova-compute[72504]: DEBUG nova.compute.manager [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:58:59 user nova-compute[72504]: INFO nova.compute.manager [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Shelve offloading
Aug 01 19:58:59 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Instance destroyed successfully.
Aug 01 19:58:59 user nova-compute[72504]: DEBUG nova.compute.manager [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:58:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "refresh_cache-6377103d-7606-4a5d-a905-6b1439e52c93" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:58:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquired lock "refresh_cache-6377103d-7606-4a5d-a905-6b1439e52c93" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:58:59 user nova-compute[72504]: DEBUG nova.network.neutron [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:58:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:58:59 user nova-compute[72504]: DEBUG nova.network.neutron [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Updating instance_info_cache with network_info: [{"id": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "address": "fa:16:3e:3e:71:62", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9af0b4bf-bc", "ovs_interfaceid": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:58:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Releasing lock "refresh_cache-6377103d-7606-4a5d-a905-6b1439e52c93" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:59:00 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Instance destroyed successfully.
Aug 01 19:59:00 user nova-compute[72504]: DEBUG nova.objects.instance [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lazy-loading 'resources' on Instance uuid 6377103d-7606-4a5d-a905-6b1439e52c93 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:59:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-166257871',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-166257871',id=22,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+wl8rcNpZ1mqzCl3rGvjYe+0M4mVedb0jJNstGOFGDnMLONV5/yGL7F28WYBgjT0J58cwNLWa81cZxxdYgg2c9g087PvPGLb9nXvb0L3iX84/jpo1Bt/FyUc3dte3RhQ==',key_name='tempest-keypair-1753450990',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:57:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='da04aaa8143b44d5aa21f59a89cd57ee',ramdisk_id='',reservation_id='r-mdxab4hw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-836718209',owner_user_name='tempest-AttachVolumeShelveTestJSON-836718209-project-member',shelved_at='2023-08-01T19:58:59.286128',shelved_host='user',shelved_image_id='dfbbb5cd-aae2-4264-aefd-8b44817a474c'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:58:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6260679430fa4828b07bc890c62878c3',uuid=6377103d-7606-4a5d-a905-6b1439e52c93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "address": "fa:16:3e:3e:71:62", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9af0b4bf-bc", "ovs_interfaceid": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:59:00 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Converting VIF {"id": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "address": "fa:16:3e:3e:71:62", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9af0b4bf-bc", "ovs_interfaceid": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:59:00 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:71:62,bridge_name='br-int',has_traffic_filtering=True,id=9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e,network=Network(40b3d49e-3592-411a-93d6-5a44019ef136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9af0b4bf-bc') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:59:00 user nova-compute[72504]: DEBUG os_vif [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:71:62,bridge_name='br-int',has_traffic_filtering=True,id=9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e,network=Network(40b3d49e-3592-411a-93d6-5a44019ef136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9af0b4bf-bc') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:59:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9af0b4bf-bc, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:59:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:00 user nova-compute[72504]: DEBUG nova.compute.manager [req-16b2de88-5305-481f-85d1-3054c1a02eb1 req-4e9d6326-18d0-4eb7-a054-c199d3901056 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received event network-changed-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:59:00 user nova-compute[72504]: DEBUG nova.compute.manager [req-16b2de88-5305-481f-85d1-3054c1a02eb1 req-4e9d6326-18d0-4eb7-a054-c199d3901056 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Refreshing instance network info cache due to event network-changed-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:59:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-16b2de88-5305-481f-85d1-3054c1a02eb1 req-4e9d6326-18d0-4eb7-a054-c199d3901056 service nova] Acquiring lock "refresh_cache-6377103d-7606-4a5d-a905-6b1439e52c93" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:59:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-16b2de88-5305-481f-85d1-3054c1a02eb1 req-4e9d6326-18d0-4eb7-a054-c199d3901056 service nova] Acquired lock "refresh_cache-6377103d-7606-4a5d-a905-6b1439e52c93" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:59:00 user nova-compute[72504]: DEBUG nova.network.neutron [req-16b2de88-5305-481f-85d1-3054c1a02eb1 req-4e9d6326-18d0-4eb7-a054-c199d3901056 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Refreshing network info cache for port 9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:59:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:59:00 user nova-compute[72504]: INFO os_vif [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:71:62,bridge_name='br-int',has_traffic_filtering=True,id=9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e,network=Network(40b3d49e-3592-411a-93d6-5a44019ef136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9af0b4bf-bc')
Aug 01 19:59:00 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Deleting instance files /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93_del
Aug 01 19:59:00 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Deletion of /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93_del complete
Aug 01 19:59:00 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Deleted allocations for instance 6377103d-7606-4a5d-a905-6b1439e52c93
Aug 01 19:59:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:00 user nova-compute[72504]: DEBUG nova.objects.instance [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lazy-loading 'numa_topology' on Instance uuid 6377103d-7606-4a5d-a905-6b1439e52c93 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:59:01 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:59:01 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:59:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:01 user nova-compute[72504]: DEBUG nova.network.neutron [req-16b2de88-5305-481f-85d1-3054c1a02eb1 req-4e9d6326-18d0-4eb7-a054-c199d3901056 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Updated VIF entry in instance network info cache for port 9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:59:01 user nova-compute[72504]: DEBUG nova.network.neutron [req-16b2de88-5305-481f-85d1-3054c1a02eb1 req-4e9d6326-18d0-4eb7-a054-c199d3901056 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Updating instance_info_cache with network_info: [{"id": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "address": "fa:16:3e:3e:71:62", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap9af0b4bf-bc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:59:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-16b2de88-5305-481f-85d1-3054c1a02eb1 req-4e9d6326-18d0-4eb7-a054-c199d3901056 service nova] Releasing lock "refresh_cache-6377103d-7606-4a5d-a905-6b1439e52c93" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:59:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cd8a1d52-46b9-4d0e-8f0d-99283480a70a tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "6377103d-7606-4a5d-a905-6b1439e52c93" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.725s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG nova.compute.manager [req-d9297d52-c190-4fad-b532-8ddc5cc7e8e9 req-34e59ce1-ee41-47b0-abde-c3f8d5bcbaa6 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Received event network-changed-d46af6d6-430b-4d54-a553-937e9bf21d16 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG nova.compute.manager [req-d9297d52-c190-4fad-b532-8ddc5cc7e8e9 req-34e59ce1-ee41-47b0-abde-c3f8d5bcbaa6 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Refreshing instance network info cache due to event network-changed-d46af6d6-430b-4d54-a553-937e9bf21d16. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d9297d52-c190-4fad-b532-8ddc5cc7e8e9 req-34e59ce1-ee41-47b0-abde-c3f8d5bcbaa6 service nova] Acquiring lock "refresh_cache-de2b2e01-4be0-4709-aacd-f6a7cc2897e0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d9297d52-c190-4fad-b532-8ddc5cc7e8e9 req-34e59ce1-ee41-47b0-abde-c3f8d5bcbaa6 service nova] Acquired lock "refresh_cache-de2b2e01-4be0-4709-aacd-f6a7cc2897e0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG nova.network.neutron [req-d9297d52-c190-4fad-b532-8ddc5cc7e8e9 req-34e59ce1-ee41-47b0-abde-c3f8d5bcbaa6 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Refreshing network info cache for port d46af6d6-430b-4d54-a553-937e9bf21d16 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OufDlhFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:59:08 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:59:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:59:08 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:59:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:59:08 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7286d306-774a-465e-81f5-40416a15d8a7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:59:08 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[399ff569-63b2-40f9-971d-4fbdb1022dc2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51] added
Aug 01 19:59:08 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f306e20-8497-4a4c-86b3-36109f03480f]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[41287db8-ca1b-4201-903b-08a6b4ca2883]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OufDlhFc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OufDlhFc" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96b579c-a350-42c4-b936-a3e270285fde]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OufDlhFc'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[426b2e54-8a94-45e1-a2eb-abd255e24e6f]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b36317-6ecf-4a4e-a21a-e4043a11c48f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:59:08 user nova-compute[72504]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 19:59:08 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:59:08 user nova-compute[72504]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 19:59:08 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd02b1e4-3c2d-43e2-b02d-17ccd5a9dc42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51, portal: 172.16.0.220,3260]
Aug 01 19:59:08 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51, portal: 172.16.0.220,3260] successful.
Aug 01 19:59:08 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3f2c2d-be6f-4fa2-920d-2bd308402eca]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86497d9-db1a-4562-bbc2-2fcc54ec7d0b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:59:08 user nova-compute[72504]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 19:59:08 user nova-compute[72504]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 (non-flash)
Aug 01 19:59:08 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:59:08 user nova-compute[72504]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 19:59:08 user nova-compute[72504]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 (non-flash)
Aug 01 19:59:08 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[855124b5-7b42-4683-bdbc-c7ca14815311]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:08 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: None {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:59:09 user nova-compute[72504]: DEBUG nova.network.neutron [req-d9297d52-c190-4fad-b532-8ddc5cc7e8e9 req-34e59ce1-ee41-47b0-abde-c3f8d5bcbaa6 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Updated VIF entry in instance network info cache for port d46af6d6-430b-4d54-a553-937e9bf21d16. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:59:09 user nova-compute[72504]: DEBUG nova.network.neutron [req-d9297d52-c190-4fad-b532-8ddc5cc7e8e9 req-34e59ce1-ee41-47b0-abde-c3f8d5bcbaa6 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Updating instance_info_cache with network_info: [{"id": "d46af6d6-430b-4d54-a553-937e9bf21d16", "address": "fa:16:3e:bf:32:31", "network": {"id": "8fe56054-7531-450f-9ddd-4c519a2e4577", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-45399222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd46af6d6-43", "ovs_interfaceid": "d46af6d6-430b-4d54-a553-937e9bf21d16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:59:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d9297d52-c190-4fad-b532-8ddc5cc7e8e9 req-34e59ce1-ee41-47b0-abde-c3f8d5bcbaa6 service nova] Releasing lock "refresh_cache-de2b2e01-4be0-4709-aacd-f6a7cc2897e0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:59:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f0c046b3-3efa-4c2c-a2cb-50cdc5051a7e tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Acquiring lock "interface-de2b2e01-4be0-4709-aacd-f6a7cc2897e0-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f0c046b3-3efa-4c2c-a2cb-50cdc5051a7e tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "interface-de2b2e01-4be0-4709-aacd-f6a7cc2897e0-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:09 user nova-compute[72504]: DEBUG nova.objects.instance [None req-f0c046b3-3efa-4c2c-a2cb-50cdc5051a7e tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lazy-loading 'flavor' on Instance uuid de2b2e01-4be0-4709-aacd-f6a7cc2897e0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:59:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:09 user nova-compute[72504]: DEBUG nova.objects.instance [None req-f0c046b3-3efa-4c2c-a2cb-50cdc5051a7e tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lazy-loading 'pci_requests' on Instance uuid de2b2e01-4be0-4709-aacd-f6a7cc2897e0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:59:09 user nova-compute[72504]: DEBUG nova.network.neutron [None req-f0c046b3-3efa-4c2c-a2cb-50cdc5051a7e tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 19:59:09 user nova-compute[72504]: DEBUG nova.policy [None req-f0c046b3-3efa-4c2c-a2cb-50cdc5051a7e tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c54daf483b7e4ab7b177fe06a02c207e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961ea5d0c92447a9853b93335137b5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 19:59:09 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:59:09 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OufDlhFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:59:09 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:59:09 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23566323335373431', 'path': '/dev/sdc'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:59:09 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566323335373431', 'path': '/dev/sdc'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:59:09 user nova-compute[72504]: DEBUG nova.objects.instance [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lazy-loading 'flavor' on Instance uuid 88f95d20-e391-4100-93b2-da29bfcf9704 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:59:10 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 19:59:10 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:59:10 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 19:59:10 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:59:10 user nova-compute[72504]:   <serial>c3b5577d-9370-489d-b16f-1a88059a3d51</serial>
Aug 01 19:59:10 user nova-compute[72504]: </disk>
Aug 01 19:59:10 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 19:59:10 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690919935.386838, 6377103d-7606-4a5d-a905-6b1439e52c93 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:59:10 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] VM Stopped (Lifecycle Event)
Aug 01 19:59:10 user nova-compute[72504]: DEBUG nova.compute.manager [None req-db5a4a32-538f-40c0-81fd-ddc157ff951c None None] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:59:10 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:59:10 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:59:10 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] No VIF found with MAC fa:16:3e:c3:aa:1c, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:59:10 user nova-compute[72504]: DEBUG nova.network.neutron [None req-f0c046b3-3efa-4c2c-a2cb-50cdc5051a7e tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Successfully created port: ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:59:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a1447dd9-5097-4cda-9eb8-a739fd529983 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "88f95d20-e391-4100-93b2-da29bfcf9704" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.892s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:10 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:11 user nova-compute[72504]: DEBUG nova.network.neutron [None req-f0c046b3-3efa-4c2c-a2cb-50cdc5051a7e tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Successfully updated port: ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:59:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f0c046b3-3efa-4c2c-a2cb-50cdc5051a7e tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Acquiring lock "refresh_cache-de2b2e01-4be0-4709-aacd-f6a7cc2897e0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:59:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f0c046b3-3efa-4c2c-a2cb-50cdc5051a7e tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Acquired lock "refresh_cache-de2b2e01-4be0-4709-aacd-f6a7cc2897e0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:59:11 user nova-compute[72504]: DEBUG nova.network.neutron [None req-f0c046b3-3efa-4c2c-a2cb-50cdc5051a7e tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:59:11 user nova-compute[72504]: DEBUG nova.compute.manager [req-62fdfad5-84c2-46a5-82f7-290269d07062 req-792fc789-6d72-4721-8488-a9183b29d2c1 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Received event network-changed-ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:59:11 user nova-compute[72504]: DEBUG nova.compute.manager [req-62fdfad5-84c2-46a5-82f7-290269d07062 req-792fc789-6d72-4721-8488-a9183b29d2c1 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Refreshing instance network info cache due to event network-changed-ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:59:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-62fdfad5-84c2-46a5-82f7-290269d07062 req-792fc789-6d72-4721-8488-a9183b29d2c1 service nova] Acquiring lock "refresh_cache-de2b2e01-4be0-4709-aacd-f6a7cc2897e0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:59:12 user nova-compute[72504]: INFO nova.compute.manager [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Rebuilding instance
Aug 01 19:59:12 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lazy-loading 'trusted_certs' on Instance uuid 88f95d20-e391-4100-93b2-da29bfcf9704 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lazy-loading 'pci_requests' on Instance uuid 88f95d20-e391-4100-93b2-da29bfcf9704 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lazy-loading 'pci_devices' on Instance uuid 88f95d20-e391-4100-93b2-da29bfcf9704 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lazy-loading 'resources' on Instance uuid 88f95d20-e391-4100-93b2-da29bfcf9704 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lazy-loading 'migration_context' on Instance uuid 88f95d20-e391-4100-93b2-da29bfcf9704 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72504) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG nova.network.neutron [None req-f0c046b3-3efa-4c2c-a2cb-50cdc5051a7e tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Updating instance_info_cache with network_info: [{"id": "d46af6d6-430b-4d54-a553-937e9bf21d16", "address": "fa:16:3e:bf:32:31", "network": {"id": "8fe56054-7531-450f-9ddd-4c519a2e4577", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-45399222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd46af6d6-43", "ovs_interfaceid": "d46af6d6-430b-4d54-a553-937e9bf21d16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f", "address": "fa:16:3e:c8:03:52", "network": {"id": "9fb4689b-a486-442a-a948-9fa0f27db6f9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1824983070", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1bc755-e6", "ovs_interfaceid": "ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f0c046b3-3efa-4c2c-a2cb-50cdc5051a7e tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Releasing lock "refresh_cache-de2b2e01-4be0-4709-aacd-f6a7cc2897e0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-62fdfad5-84c2-46a5-82f7-290269d07062 req-792fc789-6d72-4721-8488-a9183b29d2c1 service nova] Acquired lock "refresh_cache-de2b2e01-4be0-4709-aacd-f6a7cc2897e0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG nova.network.neutron [req-62fdfad5-84c2-46a5-82f7-290269d07062 req-792fc789-6d72-4721-8488-a9183b29d2c1 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Refreshing network info cache for port ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-f0c046b3-3efa-4c2c-a2cb-50cdc5051a7e tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2820075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2820075',id=23,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFR6MNT81m0077QoKPCZmUoTwZo1tmyWFZilUMLyic+9WyjHpZo/ciaWRQRs7DELWXer49Euo3w0BX2N62edjBrzmKu9DWAic/6QsdF1qlTj504N9KRmTcmwPyzz0oz/gg==',key_name='tempest-keypair-857323455',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:57:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='961ea5d0c92447a9853b93335137b5bc',ramdisk_id='',reservation_id='r-pstr5dkl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-740827412',owner_user_name='tempest-TaggedAttachmentsTest-740827412-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:57:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54daf483b7e4ab7b177fe06a02c207e',uuid=de2b2e01-4be0-4709-aacd-f6a7cc2897e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f", "address": "fa:16:3e:c8:03:52", "network": {"id": "9fb4689b-a486-442a-a948-9fa0f27db6f9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1824983070", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1bc755-e6", "ovs_interfaceid": "ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-f0c046b3-3efa-4c2c-a2cb-50cdc5051a7e tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Converting VIF {"id": "ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f", "address": "fa:16:3e:c8:03:52", "network": {"id": "9fb4689b-a486-442a-a948-9fa0f27db6f9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1824983070", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1bc755-e6", "ovs_interfaceid": "ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-f0c046b3-3efa-4c2c-a2cb-50cdc5051a7e tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:03:52,bridge_name='br-int',has_traffic_filtering=True,id=ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f,network=Network(9fb4689b-a486-442a-a948-9fa0f27db6f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae1bc755-e6') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG os_vif [None req-f0c046b3-3efa-4c2c-a2cb-50cdc5051a7e tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:03:52,bridge_name='br-int',has_traffic_filtering=True,id=ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f,network=Network(9fb4689b-a486-442a-a948-9fa0f27db6f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae1bc755-e6') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae1bc755-e6, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae1bc755-e6, col_values=(('external_ids', {'iface-id': 'ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:03:52', 'vm-uuid': 'de2b2e01-4be0-4709-aacd-f6a7cc2897e0'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:12 user nova-compute[72504]: INFO os_vif [None req-f0c046b3-3efa-4c2c-a2cb-50cdc5051a7e tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:03:52,bridge_name='br-int',has_traffic_filtering=True,id=ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f,network=Network(9fb4689b-a486-442a-a948-9fa0f27db6f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae1bc755-e6')
Aug 01 19:59:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-f0c046b3-3efa-4c2c-a2cb-50cdc5051a7e tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2820075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2820075',id=23,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFR6MNT81m0077QoKPCZmUoTwZo1tmyWFZilUMLyic+9WyjHpZo/ciaWRQRs7DELWXer49Euo3w0BX2N62edjBrzmKu9DWAic/6QsdF1qlTj504N9KRmTcmwPyzz0oz/gg==',key_name='tempest-keypair-857323455',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:57:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='961ea5d0c92447a9853b93335137b5bc',ramdisk_id='',reservation_id='r-pstr5dkl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-740827412',owner_user_name='tempest-TaggedAttachmentsTest-740827412-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:57:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54daf483b7e4ab7b177fe06a02c207e',uuid=de2b2e01-4be0-4709-aacd-f6a7cc2897e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f", "address": "fa:16:3e:c8:03:52", "network": {"id": "9fb4689b-a486-442a-a948-9fa0f27db6f9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1824983070", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1bc755-e6", "ovs_interfaceid": "ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-f0c046b3-3efa-4c2c-a2cb-50cdc5051a7e tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Converting VIF {"id": "ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f", "address": "fa:16:3e:c8:03:52", "network": {"id": "9fb4689b-a486-442a-a948-9fa0f27db6f9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1824983070", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1bc755-e6", "ovs_interfaceid": "ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-f0c046b3-3efa-4c2c-a2cb-50cdc5051a7e tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:03:52,bridge_name='br-int',has_traffic_filtering=True,id=ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f,network=Network(9fb4689b-a486-442a-a948-9fa0f27db6f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae1bc755-e6') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-f0c046b3-3efa-4c2c-a2cb-50cdc5051a7e tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] attach device xml: <interface type="ethernet">
Aug 01 19:59:12 user nova-compute[72504]:   <mac address="fa:16:3e:c8:03:52"/>
Aug 01 19:59:12 user nova-compute[72504]:   <model type="virtio"/>
Aug 01 19:59:12 user nova-compute[72504]:   <mtu size="1442"/>
Aug 01 19:59:12 user nova-compute[72504]:   <target dev="tapae1bc755-e6"/>
Aug 01 19:59:12 user nova-compute[72504]: </interface>
Aug 01 19:59:12 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 19:59:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:13 user nova-compute[72504]: DEBUG nova.compute.manager [req-834485bf-583a-42a4-a6d7-4589cb40715e req-f9126e95-bbae-41a2-b2d9-88ddf84a452a service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Received event network-vif-unplugged-3a4ace30-3ca6-4cc9-8125-599cc4097662 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:59:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-834485bf-583a-42a4-a6d7-4589cb40715e req-f9126e95-bbae-41a2-b2d9-88ddf84a452a service nova] Acquiring lock "88f95d20-e391-4100-93b2-da29bfcf9704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-834485bf-583a-42a4-a6d7-4589cb40715e req-f9126e95-bbae-41a2-b2d9-88ddf84a452a service nova] Lock "88f95d20-e391-4100-93b2-da29bfcf9704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-834485bf-583a-42a4-a6d7-4589cb40715e req-f9126e95-bbae-41a2-b2d9-88ddf84a452a service nova] Lock "88f95d20-e391-4100-93b2-da29bfcf9704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:13 user nova-compute[72504]: DEBUG nova.compute.manager [req-834485bf-583a-42a4-a6d7-4589cb40715e req-f9126e95-bbae-41a2-b2d9-88ddf84a452a service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] No waiting events found dispatching network-vif-unplugged-3a4ace30-3ca6-4cc9-8125-599cc4097662 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:59:13 user nova-compute[72504]: WARNING nova.compute.manager [req-834485bf-583a-42a4-a6d7-4589cb40715e req-f9126e95-bbae-41a2-b2d9-88ddf84a452a service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Received unexpected event network-vif-unplugged-3a4ace30-3ca6-4cc9-8125-599cc4097662 for instance with vm_state active and task_state rebuilding.
Aug 01 19:59:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-f0c046b3-3efa-4c2c-a2cb-50cdc5051a7e tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:59:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-f0c046b3-3efa-4c2c-a2cb-50cdc5051a7e tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] No BDM found with device name hda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:59:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-f0c046b3-3efa-4c2c-a2cb-50cdc5051a7e tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] No VIF found with MAC fa:16:3e:bf:32:31, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:59:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-f0c046b3-3efa-4c2c-a2cb-50cdc5051a7e tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:59:13 user nova-compute[72504]:   <nova:package version="0.0.0"/>
Aug 01 19:59:13 user nova-compute[72504]:   <nova:name>tempest-device-tagging-server-2820075</nova:name>
Aug 01 19:59:13 user nova-compute[72504]:   <nova:creationTime>2023-08-01 19:59:13</nova:creationTime>
Aug 01 19:59:13 user nova-compute[72504]:   <nova:flavor name="m1.tiny">
Aug 01 19:59:13 user nova-compute[72504]:     <nova:memory>512</nova:memory>
Aug 01 19:59:13 user nova-compute[72504]:     <nova:disk>1</nova:disk>
Aug 01 19:59:13 user nova-compute[72504]:     <nova:swap>0</nova:swap>
Aug 01 19:59:13 user nova-compute[72504]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:59:13 user nova-compute[72504]:     <nova:vcpus>1</nova:vcpus>
Aug 01 19:59:13 user nova-compute[72504]:   </nova:flavor>
Aug 01 19:59:13 user nova-compute[72504]:   <nova:owner>
Aug 01 19:59:13 user nova-compute[72504]:     <nova:user uuid="c54daf483b7e4ab7b177fe06a02c207e">tempest-TaggedAttachmentsTest-740827412-project-member</nova:user>
Aug 01 19:59:13 user nova-compute[72504]:     <nova:project uuid="961ea5d0c92447a9853b93335137b5bc">tempest-TaggedAttachmentsTest-740827412</nova:project>
Aug 01 19:59:13 user nova-compute[72504]:   </nova:owner>
Aug 01 19:59:13 user nova-compute[72504]:   <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:59:13 user nova-compute[72504]:   <nova:ports>
Aug 01 19:59:13 user nova-compute[72504]:     <nova:port uuid="d46af6d6-430b-4d54-a553-937e9bf21d16">
Aug 01 19:59:13 user nova-compute[72504]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 19:59:13 user nova-compute[72504]:     </nova:port>
Aug 01 19:59:13 user nova-compute[72504]:     <nova:port uuid="ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f">
Aug 01 19:59:13 user nova-compute[72504]:       <nova:ip type="fixed" address="10.10.10.78" ipVersion="4"/>
Aug 01 19:59:13 user nova-compute[72504]:     </nova:port>
Aug 01 19:59:13 user nova-compute[72504]:   </nova:ports>
Aug 01 19:59:13 user nova-compute[72504]: </nova:instance>
Aug 01 19:59:13 user nova-compute[72504]:  {{(pid=72504) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 01 19:59:13 user nova-compute[72504]: DEBUG nova.network.neutron [req-62fdfad5-84c2-46a5-82f7-290269d07062 req-792fc789-6d72-4721-8488-a9183b29d2c1 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Updated VIF entry in instance network info cache for port ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:59:13 user nova-compute[72504]: DEBUG nova.network.neutron [req-62fdfad5-84c2-46a5-82f7-290269d07062 req-792fc789-6d72-4721-8488-a9183b29d2c1 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Updating instance_info_cache with network_info: [{"id": "d46af6d6-430b-4d54-a553-937e9bf21d16", "address": "fa:16:3e:bf:32:31", "network": {"id": "8fe56054-7531-450f-9ddd-4c519a2e4577", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-45399222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd46af6d6-43", "ovs_interfaceid": "d46af6d6-430b-4d54-a553-937e9bf21d16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f", "address": "fa:16:3e:c8:03:52", "network": {"id": "9fb4689b-a486-442a-a948-9fa0f27db6f9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1824983070", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1bc755-e6", "ovs_interfaceid": "ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:59:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f0c046b3-3efa-4c2c-a2cb-50cdc5051a7e tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "interface-de2b2e01-4be0-4709-aacd-f6a7cc2897e0-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.325s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-62fdfad5-84c2-46a5-82f7-290269d07062 req-792fc789-6d72-4721-8488-a9183b29d2c1 service nova] Releasing lock "refresh_cache-de2b2e01-4be0-4709-aacd-f6a7cc2897e0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:59:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:13 user nova-compute[72504]: DEBUG nova.compute.manager [req-88ecf854-7262-43c0-93c0-d6d65b34498b req-7a4a5ae8-db79-4913-bb77-77dbb0f2913b service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Received event network-vif-plugged-ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:59:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-88ecf854-7262-43c0-93c0-d6d65b34498b req-7a4a5ae8-db79-4913-bb77-77dbb0f2913b service nova] Acquiring lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-88ecf854-7262-43c0-93c0-d6d65b34498b req-7a4a5ae8-db79-4913-bb77-77dbb0f2913b service nova] Lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-88ecf854-7262-43c0-93c0-d6d65b34498b req-7a4a5ae8-db79-4913-bb77-77dbb0f2913b service nova] Lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:13 user nova-compute[72504]: DEBUG nova.compute.manager [req-88ecf854-7262-43c0-93c0-d6d65b34498b req-7a4a5ae8-db79-4913-bb77-77dbb0f2913b service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] No waiting events found dispatching network-vif-plugged-ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:59:13 user nova-compute[72504]: WARNING nova.compute.manager [req-88ecf854-7262-43c0-93c0-d6d65b34498b req-7a4a5ae8-db79-4913-bb77-77dbb0f2913b service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Received unexpected event network-vif-plugged-ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f for instance with vm_state active and task_state None.
Aug 01 19:59:13 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Instance destroyed successfully.
Aug 01 19:59:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:13 user nova-compute[72504]: INFO nova.compute.manager [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Detaching volume c3b5577d-9370-489d-b16f-1a88059a3d51
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Acquiring lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG nova.objects.instance [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lazy-loading 'flavor' on Instance uuid de2b2e01-4be0-4709-aacd-f6a7cc2897e0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:59:14 user nova-compute[72504]: INFO nova.virt.block_device [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Attempting to driver detach volume c3b5577d-9370-489d-b16f-1a88059a3d51 from mountpoint /dev/vdb
Aug 01 19:59:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Attempting to detach device vdb from instance 88f95d20-e391-4100-93b2-da29bfcf9704 from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:59:14 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:59:14 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 19:59:14 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:59:14 user nova-compute[72504]:   <serial>c3b5577d-9370-489d-b16f-1a88059a3d51</serial>
Aug 01 19:59:14 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 19:59:14 user nova-compute[72504]: </disk>
Aug 01 19:59:14 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:59:14 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Successfully detached device vdb from instance 88f95d20-e391-4100-93b2-da29bfcf9704 from the persistent domain config.
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OufDlhFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:59:14 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 19:59:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[621437e9-9fea-44e7-8bfc-770e157740ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d8d693-a65a-45f2-b89a-897f0693bf62]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:59:14 user nova-compute[72504]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 19:59:14 user nova-compute[72504]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 (non-flash)
Aug 01 19:59:14 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:59:14 user nova-compute[72504]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 19:59:14 user nova-compute[72504]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 (non-flash)
Aug 01 19:59:14 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3f45a4940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51'): ({'sdc'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Removing single pathed devices sdc {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[199a7edd-8a9d-445d-9b66-34115508952f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a386ba8-71e7-4eb6-b476-e938f5e239ad]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Flushing IO for device /dev/sdc {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f184d6-9799-49e6-8766-8b68c8bf743c]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.027s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d8b221-0351-4cb6-ae13-e38622c36b1f]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a1c168-3f80-4727-b9f8-d0d1eeff11b8]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Acquiring lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:14 user nova-compute[72504]: INFO nova.compute.manager [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Attaching volume 6a6af80f-1bec-4389-9b6e-57fdc68ee269 to /dev/vdb
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c244f13-b82c-4b04-9142-c9e3a55e3c08]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51, portal: 172.16.0.220,3260]
Aug 01 19:59:14 user nova-compute[72504]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51, portal: 172.16.0.220,3260] successful.
Aug 01 19:59:14 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG os_brick.utils [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce7ab40-fc64-4abb-a6ad-95652474507d]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] <== disconnect_volume: return (297ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac6a8f8-fc3f-4556-a4f9-6535905f2452]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bb5b53-5d42-42f7-8c80-08c776491051]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c2d595-4e17-4941-a540-e3bc413d296b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2f7c1c-4281-439d-8245-8a70aada2af9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:59:14 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:59:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d50ddde-e485-4f1f-907d-68a670e0c79c]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG os_brick.utils [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:59:14 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Updating existing volume attachment record: 41392c01-4975-4bbf-9e2e-a943d1ddfae8 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:59:15 user nova-compute[72504]: DEBUG nova.compute.manager [req-5007249b-c7dd-4096-bf06-3aac0ff90095 req-7124747d-b586-44cd-8d22-3a3d76de623a service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Received event network-vif-plugged-3a4ace30-3ca6-4cc9-8125-599cc4097662 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:59:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5007249b-c7dd-4096-bf06-3aac0ff90095 req-7124747d-b586-44cd-8d22-3a3d76de623a service nova] Acquiring lock "88f95d20-e391-4100-93b2-da29bfcf9704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5007249b-c7dd-4096-bf06-3aac0ff90095 req-7124747d-b586-44cd-8d22-3a3d76de623a service nova] Lock "88f95d20-e391-4100-93b2-da29bfcf9704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5007249b-c7dd-4096-bf06-3aac0ff90095 req-7124747d-b586-44cd-8d22-3a3d76de623a service nova] Lock "88f95d20-e391-4100-93b2-da29bfcf9704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:15 user nova-compute[72504]: DEBUG nova.compute.manager [req-5007249b-c7dd-4096-bf06-3aac0ff90095 req-7124747d-b586-44cd-8d22-3a3d76de623a service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] No waiting events found dispatching network-vif-plugged-3a4ace30-3ca6-4cc9-8125-599cc4097662 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:59:15 user nova-compute[72504]: WARNING nova.compute.manager [req-5007249b-c7dd-4096-bf06-3aac0ff90095 req-7124747d-b586-44cd-8d22-3a3d76de623a service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Received unexpected event network-vif-plugged-3a4ace30-3ca6-4cc9-8125-599cc4097662 for instance with vm_state active and task_state rebuilding.
Aug 01 19:59:15 user nova-compute[72504]: DEBUG nova.compute.manager [req-870d8984-495e-4eb6-9b36-e5ba023ab226 req-e78170a9-a740-4828-8b2f-9307ff676816 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Received event network-vif-plugged-ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:59:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-870d8984-495e-4eb6-9b36-e5ba023ab226 req-e78170a9-a740-4828-8b2f-9307ff676816 service nova] Acquiring lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-870d8984-495e-4eb6-9b36-e5ba023ab226 req-e78170a9-a740-4828-8b2f-9307ff676816 service nova] Lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-870d8984-495e-4eb6-9b36-e5ba023ab226 req-e78170a9-a740-4828-8b2f-9307ff676816 service nova] Lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:15 user nova-compute[72504]: DEBUG nova.compute.manager [req-870d8984-495e-4eb6-9b36-e5ba023ab226 req-e78170a9-a740-4828-8b2f-9307ff676816 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] No waiting events found dispatching network-vif-plugged-ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:59:15 user nova-compute[72504]: WARNING nova.compute.manager [req-870d8984-495e-4eb6-9b36-e5ba023ab226 req-e78170a9-a740-4828-8b2f-9307ff676816 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Received unexpected event network-vif-plugged-ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f for instance with vm_state active and task_state None.
Aug 01 19:59:16 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:59:16 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:59:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:18 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Instance destroyed successfully.
Aug 01 19:59:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1800688900',display_name='tempest-ServerActionsTestOtherA-server-1216550078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1800688900',id=18,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLbPu5MF6DPaLmysryryb5dEvmDVe/ZpzyX1JNIgtOIXBuGnF7k0B3yFjfDeyUfOXvFKWH1T1tnnmguBKUJb6gDrcdFY/x4LtLMGVeolXUhKxLNh5O13uubFnujvAs7Sg==',key_name='tempest-keypair-2041585985',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:55:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='816239d15d3341cdaa785fc36c8e7cdb',ramdisk_id='',reservation_id='r-5qhy089r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1009670506',owner_user_name='tempest-ServerActionsTestOtherA-1009670506-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:59:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d76765d1d24342f99ce0d65f416d382b',uuid=88f95d20-e391-4100-93b2-da29bfcf9704,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "address": "fa:16:3e:c3:aa:1c", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a4ace30-3c", "ovs_interfaceid": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Converting VIF {"id": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "address": "fa:16:3e:c3:aa:1c", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a4ace30-3c", "ovs_interfaceid": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:aa:1c,bridge_name='br-int',has_traffic_filtering=True,id=3a4ace30-3ca6-4cc9-8125-599cc4097662,network=Network(92749f96-d369-4df5-85ce-252c277e7ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a4ace30-3c') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG os_vif [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:aa:1c,bridge_name='br-int',has_traffic_filtering=True,id=3a4ace30-3ca6-4cc9-8125-599cc4097662,network=Network(92749f96-d369-4df5-85ce-252c277e7ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a4ace30-3c') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a4ace30-3c, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:59:18 user nova-compute[72504]: INFO os_vif [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:aa:1c,bridge_name='br-int',has_traffic_filtering=True,id=3a4ace30-3ca6-4cc9-8125-599cc4097662,network=Network(92749f96-d369-4df5-85ce-252c277e7ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a4ace30-3c')
Aug 01 19:59:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OufDlhFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:59:18 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 19:59:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c192f0-136a-4d9f-ac8e-4415c9444a4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[410ecc04-f0f5-4532-bd66-9944d66c64a3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:59:18 user nova-compute[72504]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 19:59:18 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:59:18 user nova-compute[72504]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 19:59:18 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3f459bc70>, {}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Disconnecting from: [] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.048s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] <== disconnect_volume: return (50ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:59:18 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Deleting instance files /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704_del
Aug 01 19:59:18 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Deletion of /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704_del complete
Aug 01 19:59:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b72ec071-8691-4a5f-af39-c32524b530da tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "9078e730-73ae-4581-901c-418ab48b20ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b72ec071-8691-4a5f-af39-c32524b530da tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "9078e730-73ae-4581-901c-418ab48b20ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b72ec071-8691-4a5f-af39-c32524b530da tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "9078e730-73ae-4581-901c-418ab48b20ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b72ec071-8691-4a5f-af39-c32524b530da tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "9078e730-73ae-4581-901c-418ab48b20ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b72ec071-8691-4a5f-af39-c32524b530da tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "9078e730-73ae-4581-901c-418ab48b20ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:18 user nova-compute[72504]: INFO nova.compute.manager [None req-b72ec071-8691-4a5f-af39-c32524b530da tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Terminating instance
Aug 01 19:59:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-b72ec071-8691-4a5f-af39-c32524b530da tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:18 user nova-compute[72504]: INFO nova.virt.block_device [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Booting with volume c3b5577d-9370-489d-b16f-1a88059a3d51 at /dev/vdb
Aug 01 19:59:18 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG os_brick.utils [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[74343793-a0eb-4a56-a69b-23c9492c2a72]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[229e1475-8a1d-4420-a506-bbac9b7b6b49]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[263d2aaf-c85d-44e2-8556-76a2e8c3cf00]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d613206-0b45-4789-9c88-12f261d8c940]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG nova.compute.manager [req-88d25806-1f78-41b3-8a3a-c21df25cd8db req-593b677e-2cee-4d9f-a3be-3dd62a27e4fd service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Received event network-vif-unplugged-4398feea-5235-4138-a257-4c557d89ae8f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-88d25806-1f78-41b3-8a3a-c21df25cd8db req-593b677e-2cee-4d9f-a3be-3dd62a27e4fd service nova] Acquiring lock "9078e730-73ae-4581-901c-418ab48b20ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-88d25806-1f78-41b3-8a3a-c21df25cd8db req-593b677e-2cee-4d9f-a3be-3dd62a27e4fd service nova] Lock "9078e730-73ae-4581-901c-418ab48b20ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-88d25806-1f78-41b3-8a3a-c21df25cd8db req-593b677e-2cee-4d9f-a3be-3dd62a27e4fd service nova] Lock "9078e730-73ae-4581-901c-418ab48b20ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG nova.compute.manager [req-88d25806-1f78-41b3-8a3a-c21df25cd8db req-593b677e-2cee-4d9f-a3be-3dd62a27e4fd service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] No waiting events found dispatching network-vif-unplugged-4398feea-5235-4138-a257-4c557d89ae8f {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG nova.compute.manager [req-88d25806-1f78-41b3-8a3a-c21df25cd8db req-593b677e-2cee-4d9f-a3be-3dd62a27e4fd service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Received event network-vif-unplugged-4398feea-5235-4138-a257-4c557d89ae8f for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 19:59:19 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 19:59:19 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a658ff-aaa6-4ed1-ab15-f85f4a1166a2]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG os_brick.utils [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Updating existing volume attachment record: 8218b1c4-24f5-4ccd-a26b-b2d564085bc4 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:19 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Instance destroyed successfully.
Aug 01 19:59:19 user nova-compute[72504]: DEBUG nova.objects.instance [None req-b72ec071-8691-4a5f-af39-c32524b530da tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lazy-loading 'resources' on Instance uuid 9078e730-73ae-4581-901c-418ab48b20ff {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-b72ec071-8691-4a5f-af39-c32524b530da tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:56:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-572656543',display_name='tempest-AttachVolumeNegativeTest-server-572656543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-572656543',id=19,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+olELGZvZIbN0OYRQuQIBgcyHlJqyuM1COdASqQ4TQxNqRSVgaNGVUBWrcCsBKRHRKhvNPxHwZq+0xCHe9ffukcsUTDvB3bxakk8Ep9y/EZWxsp84oiv2ovz/BpQ9azw==',key_name='tempest-keypair-1722664367',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:56:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15cc01820f324654b0959d5fb2adefc3',ramdisk_id='',reservation_id='r-wjpjqptb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2109955223',owner_user_name='tempest-AttachVolumeNegativeTest-2109955223-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:56:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='451baacc96384f35bd8bbb87626ac52d',uuid=9078e730-73ae-4581-901c-418ab48b20ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4398feea-5235-4138-a257-4c557d89ae8f", "address": "fa:16:3e:98:07:e4", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4398feea-52", "ovs_interfaceid": "4398feea-5235-4138-a257-4c557d89ae8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-b72ec071-8691-4a5f-af39-c32524b530da tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Converting VIF {"id": "4398feea-5235-4138-a257-4c557d89ae8f", "address": "fa:16:3e:98:07:e4", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4398feea-52", "ovs_interfaceid": "4398feea-5235-4138-a257-4c557d89ae8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-b72ec071-8691-4a5f-af39-c32524b530da tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:07:e4,bridge_name='br-int',has_traffic_filtering=True,id=4398feea-5235-4138-a257-4c557d89ae8f,network=Network(67292f1d-2643-4cfa-aaf6-0a698d87bfd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4398feea-52') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG os_vif [None req-b72ec071-8691-4a5f-af39-c32524b530da tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:07:e4,bridge_name='br-int',has_traffic_filtering=True,id=4398feea-5235-4138-a257-4c557d89ae8f,network=Network(67292f1d-2643-4cfa-aaf6-0a698d87bfd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4398feea-52') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4398feea-52, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:19 user nova-compute[72504]: INFO os_vif [None req-b72ec071-8691-4a5f-af39-c32524b530da tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:07:e4,bridge_name='br-int',has_traffic_filtering=True,id=4398feea-5235-4138-a257-4c557d89ae8f,network=Network(67292f1d-2643-4cfa-aaf6-0a698d87bfd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4398feea-52')
Aug 01 19:59:19 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-b72ec071-8691-4a5f-af39-c32524b530da tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Deleting instance files /opt/stack/data/nova/instances/9078e730-73ae-4581-901c-418ab48b20ff_del
Aug 01 19:59:19 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-b72ec071-8691-4a5f-af39-c32524b530da tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Deletion of /opt/stack/data/nova/instances/9078e730-73ae-4581-901c-418ab48b20ff_del complete
Aug 01 19:59:19 user nova-compute[72504]: INFO nova.compute.manager [None req-b72ec071-8691-4a5f-af39-c32524b530da tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 01 19:59:19 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-b72ec071-8691-4a5f-af39-c32524b530da tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 19:59:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:59:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 19:59:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG nova.compute.manager [req-7f55eb2f-3ff3-4941-b318-6631f663a479 req-a00f32ab-e7d3-4226-9edb-3b8cb99a6195 service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Received event network-vif-plugged-4398feea-5235-4138-a257-4c557d89ae8f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7f55eb2f-3ff3-4941-b318-6631f663a479 req-a00f32ab-e7d3-4226-9edb-3b8cb99a6195 service nova] Acquiring lock "9078e730-73ae-4581-901c-418ab48b20ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7f55eb2f-3ff3-4941-b318-6631f663a479 req-a00f32ab-e7d3-4226-9edb-3b8cb99a6195 service nova] Lock "9078e730-73ae-4581-901c-418ab48b20ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7f55eb2f-3ff3-4941-b318-6631f663a479 req-a00f32ab-e7d3-4226-9edb-3b8cb99a6195 service nova] Lock "9078e730-73ae-4581-901c-418ab48b20ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG nova.compute.manager [req-7f55eb2f-3ff3-4941-b318-6631f663a479 req-a00f32ab-e7d3-4226-9edb-3b8cb99a6195 service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] No waiting events found dispatching network-vif-plugged-4398feea-5235-4138-a257-4c557d89ae8f {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:59:21 user nova-compute[72504]: WARNING nova.compute.manager [req-7f55eb2f-3ff3-4941-b318-6631f663a479 req-a00f32ab-e7d3-4226-9edb-3b8cb99a6195 service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Received unexpected event network-vif-plugged-4398feea-5235-4138-a257-4c557d89ae8f for instance with vm_state active and task_state deleting.
Aug 01 19:59:21 user nova-compute[72504]: DEBUG nova.compute.manager [req-7f55eb2f-3ff3-4941-b318-6631f663a479 req-a00f32ab-e7d3-4226-9edb-3b8cb99a6195 service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Received event network-vif-plugged-4398feea-5235-4138-a257-4c557d89ae8f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7f55eb2f-3ff3-4941-b318-6631f663a479 req-a00f32ab-e7d3-4226-9edb-3b8cb99a6195 service nova] Acquiring lock "9078e730-73ae-4581-901c-418ab48b20ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7f55eb2f-3ff3-4941-b318-6631f663a479 req-a00f32ab-e7d3-4226-9edb-3b8cb99a6195 service nova] Lock "9078e730-73ae-4581-901c-418ab48b20ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7f55eb2f-3ff3-4941-b318-6631f663a479 req-a00f32ab-e7d3-4226-9edb-3b8cb99a6195 service nova] Lock "9078e730-73ae-4581-901c-418ab48b20ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG nova.compute.manager [req-7f55eb2f-3ff3-4941-b318-6631f663a479 req-a00f32ab-e7d3-4226-9edb-3b8cb99a6195 service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] No waiting events found dispatching network-vif-plugged-4398feea-5235-4138-a257-4c557d89ae8f {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:59:21 user nova-compute[72504]: WARNING nova.compute.manager [req-7f55eb2f-3ff3-4941-b318-6631f663a479 req-a00f32ab-e7d3-4226-9edb-3b8cb99a6195 service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Received unexpected event network-vif-plugged-4398feea-5235-4138-a257-4c557d89ae8f for instance with vm_state active and task_state deleting.
Aug 01 19:59:21 user nova-compute[72504]: DEBUG nova.compute.manager [req-7f55eb2f-3ff3-4941-b318-6631f663a479 req-a00f32ab-e7d3-4226-9edb-3b8cb99a6195 service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Received event network-vif-plugged-4398feea-5235-4138-a257-4c557d89ae8f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7f55eb2f-3ff3-4941-b318-6631f663a479 req-a00f32ab-e7d3-4226-9edb-3b8cb99a6195 service nova] Acquiring lock "9078e730-73ae-4581-901c-418ab48b20ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7f55eb2f-3ff3-4941-b318-6631f663a479 req-a00f32ab-e7d3-4226-9edb-3b8cb99a6195 service nova] Lock "9078e730-73ae-4581-901c-418ab48b20ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7f55eb2f-3ff3-4941-b318-6631f663a479 req-a00f32ab-e7d3-4226-9edb-3b8cb99a6195 service nova] Lock "9078e730-73ae-4581-901c-418ab48b20ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG nova.compute.manager [req-7f55eb2f-3ff3-4941-b318-6631f663a479 req-a00f32ab-e7d3-4226-9edb-3b8cb99a6195 service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] No waiting events found dispatching network-vif-plugged-4398feea-5235-4138-a257-4c557d89ae8f {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:59:21 user nova-compute[72504]: WARNING nova.compute.manager [req-7f55eb2f-3ff3-4941-b318-6631f663a479 req-a00f32ab-e7d3-4226-9edb-3b8cb99a6195 service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Received unexpected event network-vif-plugged-4398feea-5235-4138-a257-4c557d89ae8f for instance with vm_state active and task_state deleting.
Aug 01 19:59:21 user nova-compute[72504]: DEBUG nova.compute.manager [req-7f55eb2f-3ff3-4941-b318-6631f663a479 req-a00f32ab-e7d3-4226-9edb-3b8cb99a6195 service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Received event network-vif-unplugged-4398feea-5235-4138-a257-4c557d89ae8f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7f55eb2f-3ff3-4941-b318-6631f663a479 req-a00f32ab-e7d3-4226-9edb-3b8cb99a6195 service nova] Acquiring lock "9078e730-73ae-4581-901c-418ab48b20ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7f55eb2f-3ff3-4941-b318-6631f663a479 req-a00f32ab-e7d3-4226-9edb-3b8cb99a6195 service nova] Lock "9078e730-73ae-4581-901c-418ab48b20ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7f55eb2f-3ff3-4941-b318-6631f663a479 req-a00f32ab-e7d3-4226-9edb-3b8cb99a6195 service nova] Lock "9078e730-73ae-4581-901c-418ab48b20ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG nova.compute.manager [req-7f55eb2f-3ff3-4941-b318-6631f663a479 req-a00f32ab-e7d3-4226-9edb-3b8cb99a6195 service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] No waiting events found dispatching network-vif-unplugged-4398feea-5235-4138-a257-4c557d89ae8f {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG nova.compute.manager [req-7f55eb2f-3ff3-4941-b318-6631f663a479 req-a00f32ab-e7d3-4226-9edb-3b8cb99a6195 service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Received event network-vif-unplugged-4398feea-5235-4138-a257-4c557d89ae8f for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:59:21 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Took 1.79 seconds to deallocate network for instance.
Aug 01 19:59:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b72ec071-8691-4a5f-af39-c32524b530da tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b72ec071-8691-4a5f-af39-c32524b530da tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:22 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-b72ec071-8691-4a5f-af39-c32524b530da tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:59:22 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-b72ec071-8691-4a5f-af39-c32524b530da tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:59:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b72ec071-8691-4a5f-af39-c32524b530da tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.529s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:22 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-b72ec071-8691-4a5f-af39-c32524b530da tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Deleted allocations for instance 9078e730-73ae-4581-901c-418ab48b20ff
Aug 01 19:59:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b72ec071-8691-4a5f-af39-c32524b530da tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "9078e730-73ae-4581-901c-418ab48b20ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.684s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG nova.compute.manager [req-57050219-54f2-4924-af79-ff05d3a098c5 req-66ad2623-9bdd-4fe4-b719-27bcdc7f4517 service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Received event network-vif-plugged-4398feea-5235-4138-a257-4c557d89ae8f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-57050219-54f2-4924-af79-ff05d3a098c5 req-66ad2623-9bdd-4fe4-b719-27bcdc7f4517 service nova] Acquiring lock "9078e730-73ae-4581-901c-418ab48b20ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-57050219-54f2-4924-af79-ff05d3a098c5 req-66ad2623-9bdd-4fe4-b719-27bcdc7f4517 service nova] Lock "9078e730-73ae-4581-901c-418ab48b20ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-57050219-54f2-4924-af79-ff05d3a098c5 req-66ad2623-9bdd-4fe4-b719-27bcdc7f4517 service nova] Lock "9078e730-73ae-4581-901c-418ab48b20ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG nova.compute.manager [req-57050219-54f2-4924-af79-ff05d3a098c5 req-66ad2623-9bdd-4fe4-b719-27bcdc7f4517 service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] No waiting events found dispatching network-vif-plugged-4398feea-5235-4138-a257-4c557d89ae8f {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:59:23 user nova-compute[72504]: WARNING nova.compute.manager [req-57050219-54f2-4924-af79-ff05d3a098c5 req-66ad2623-9bdd-4fe4-b719-27bcdc7f4517 service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Received unexpected event network-vif-plugged-4398feea-5235-4138-a257-4c557d89ae8f for instance with vm_state deleted and task_state None.
Aug 01 19:59:23 user nova-compute[72504]: DEBUG nova.compute.manager [req-57050219-54f2-4924-af79-ff05d3a098c5 req-66ad2623-9bdd-4fe4-b719-27bcdc7f4517 service nova] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Received event network-vif-deleted-4398feea-5235-4138-a257-4c557d89ae8f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKgABUlR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:59:23 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:59:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:59:23 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:59:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:59:23 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:23 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:59:23 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:59:23 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=7526MB free_disk=25.293804168701172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2837e009-858c-4ce8-83b3-6f300ac6669f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:59:23 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd58b4a-8374-4a15-beb5-5245a2c8e041]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269] added
Aug 01 19:59:23 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.053s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45592dd-0fc1-4dda-9a55-4ed1c2a90bfa]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 7391a8ce-7ce5-47ec-97f6-6159645688ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 128c2981-363c-4ae9-b46d-15b5e5d9cac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 88f95d20-e391-4100-93b2-da29bfcf9704 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance dad07310-5f62-48f9-a17f-6e960dcf5060 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance de2b2e01-4be0-4709-aacd-f6a7cc2897e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 54812de2-bfe3-46f1-a327-8081fbb80bec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d459494-a395-4a6b-88b8-cf4a954f35ec]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKgABUlR {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKgABUlR" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff8d0dd-166f-45cc-97ed-ee221b000693]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NKgABUlR'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[286fc6a8-3999-4742-a71c-2ccb27e9ac88]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2769f4e8-602d-4ce8-af59-45db020e4148]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:59:23 user nova-compute[72504]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 19:59:23 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:59:23 user nova-compute[72504]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 19:59:23 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78d2eec-5187-4d9c-99e9-78fd8d19bba6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269, portal: 172.16.0.220,3260]
Aug 01 19:59:23 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269, portal: 172.16.0.220,3260] successful.
Aug 01 19:59:23 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[654ffedc-30c7-46b1-bd4b-2bf81bdf1f09]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a375cf31-ae14-4a37-a951-cf283583382c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:59:23 user nova-compute[72504]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 19:59:23 user nova-compute[72504]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269 (non-flash)
Aug 01 19:59:23 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:59:23 user nova-compute[72504]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 19:59:23 user nova-compute[72504]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269 (non-flash)
Aug 01 19:59:23 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1263a2-d93a-46d2-8608-2935aaf4f8dd]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: None {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 19:59:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.434s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:24 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:59:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKgABUlR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:59:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:59:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '23633373665613036', 'path': '/dev/sdc'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:59:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633373665613036', 'path': '/dev/sdc'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:59:24 user nova-compute[72504]: DEBUG nova.objects.instance [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lazy-loading 'flavor' on Instance uuid de2b2e01-4be0-4709-aacd-f6a7cc2897e0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:59:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 19:59:24 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:59:24 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 19:59:24 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:59:24 user nova-compute[72504]:   <serial>6a6af80f-1bec-4389-9b6e-57fdc68ee269</serial>
Aug 01 19:59:24 user nova-compute[72504]: </disk>
Aug 01 19:59:24 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 19:59:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:59:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] No BDM found with device name hda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:59:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] No VIF found with MAC fa:16:3e:bf:32:31, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:59:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-923deee2-b4b3-4564-b1db-bc825b8a1a19 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.471s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:25 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:59:25 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:59:25 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:59:25 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:59:25 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 19:59:26 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 19:59:26 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 19:59:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-128c2981-363c-4ae9-b46d-15b5e5d9cac6" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:59:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-128c2981-363c-4ae9-b46d-15b5e5d9cac6" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:59:26 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Acquiring lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:27 user nova-compute[72504]: INFO nova.compute.manager [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Detaching volume 6a6af80f-1bec-4389-9b6e-57fdc68ee269
Aug 01 19:59:27 user nova-compute[72504]: INFO nova.virt.block_device [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Attempting to driver detach volume 6a6af80f-1bec-4389-9b6e-57fdc68ee269 from mountpoint /dev/vdb
Aug 01 19:59:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Attempting to detach device vdb from instance de2b2e01-4be0-4709-aacd-f6a7cc2897e0 from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:59:27 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:59:27 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 19:59:27 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:59:27 user nova-compute[72504]:   <serial>6a6af80f-1bec-4389-9b6e-57fdc68ee269</serial>
Aug 01 19:59:27 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 19:59:27 user nova-compute[72504]: </disk>
Aug 01 19:59:27 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:59:27 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Successfully detached device vdb from instance de2b2e01-4be0-4709-aacd-f6a7cc2897e0 from the persistent domain config.
Aug 01 19:59:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de2b2e01-4be0-4709-aacd-f6a7cc2897e0 from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 19:59:27 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:59:27 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 19:59:27 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 19:59:27 user nova-compute[72504]:   <serial>6a6af80f-1bec-4389-9b6e-57fdc68ee269</serial>
Aug 01 19:59:27 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 19:59:27 user nova-compute[72504]: </disk>
Aug 01 19:59:27 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Updating instance_info_cache with network_info: [{"id": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "address": "fa:16:3e:c0:3a:dc", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88a4a208-71", "ovs_interfaceid": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-128c2981-363c-4ae9-b46d-15b5e5d9cac6" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:59:27 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Creating image(s)
Aug 01 19:59:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "/opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "/opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "/opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690919967.7709148, de2b2e01-4be0-4709-aacd-f6a7cc2897e0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de2b2e01-4be0-4709-aacd-f6a7cc2897e0 {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 19:59:27 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Successfully detached device vdb from instance de2b2e01-4be0-4709-aacd-f6a7cc2897e0 from the live domain config.
Aug 01 19:59:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKgABUlR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:59:27 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 19:59:27 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7077d1f-2aba-4d98-a366-94da06d8f736]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8eff4d0-6fd2-4b91-83a5-6e09f64a766e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:59:27 user nova-compute[72504]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 19:59:27 user nova-compute[72504]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269 (non-flash)
Aug 01 19:59:27 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:59:27 user nova-compute[72504]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 19:59:27 user nova-compute[72504]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269 (non-flash)
Aug 01 19:59:27 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3f45945e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269'): ({'sdc'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Removing single pathed devices sdc {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae937e37-f6ba-4a1e-b679-b6ca6dc19656]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.151s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b464603a-0a21-4d4a-bb4c-62e6ac20ad1d]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Flushing IO for device /dev/sdc {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[54409980-a982-4293-8713-1ba42a552ecd]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 19:59:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7a9086-11f5-47c1-bcbe-27a21c085f57]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[beba5dd0-c4d1-45c6-a673-955eaeae5114]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.132s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk 1073741824" returned: 0 in 0.057s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca176713-e8cf-490c-ae08-eb01ae126954]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269, portal: 172.16.0.220,3260]
Aug 01 19:59:28 user nova-compute[72504]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269, portal: 172.16.0.220,3260] successful.
Aug 01 19:59:28 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6af80f-1bec-4389-9b6e-57fdc68ee269 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[064308d5-0cf4-4f38-9061-d8e0211a1646]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] <== disconnect_volume: return (371ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.147s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Checking if we can resize image /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Cannot resize image /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Ensure instance console log exists: /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Start _get_guest_xml network_info=[{"id": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "address": "fa:16:3e:c3:aa:1c", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a4ace30-3c", "ovs_interfaceid": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OufDlhFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '88f95d20-e391-4100-93b2-da29bfcf9704', 'attached_at': '', 'detached_at': '', 'volume_id': 'c3b5577d-9370-489d-b16f-1a88059a3d51', 'serial': 'c3b5577d-9370-489d-b16f-1a88059a3d51'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': '8218b1c4-24f5-4ccd-a26b-b2d564085bc4', 'volume_type': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:59:28 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 19:59:28 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 19:59:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lazy-loading 'vcpu_model' on Instance uuid 88f95d20-e391-4100-93b2-da29bfcf9704 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OufDlhFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 19:59:28 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:59:28 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 19:59:28 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260" returned: 21 in 0.066s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae65cb9-8e13-4c68-bd47-fb4939ac92b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 19:59:28 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63c44aa-24a3-476b-8480-724686a6ddb5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51] added
Aug 01 19:59:28 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[725af0c2-9ce0-435c-a9a6-11a9ac92fad8]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[534c7b71-f7cc-4873-9afd-4b0d67e08094]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OufDlhFc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OufDlhFc" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0739b3-d3c7-4899-9f52-555670df5b66]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OufDlhFc'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0dd99a0-ecf8-453d-9655-1bda2dd9c416]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f1d64f-ee2d-46e0-b127-8648279bc3c1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:59:28 user nova-compute[72504]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 19:59:28 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:59:28 user nova-compute[72504]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 19:59:28 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690919953.8017578, 88f95d20-e391-4100-93b2-da29bfcf9704 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:59:28 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] VM Stopped (Lifecycle Event)
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65579bb-baaa-4f66-aaf3-682a06ab573f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51, portal: 172.16.0.220,3260]
Aug 01 19:59:28 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51, portal: 172.16.0.220,3260] successful.
Aug 01 19:59:28 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG nova.compute.manager [None req-2767d1a8-b77e-49c3-ab16-6274051583a9 None None] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ffb67b-2db6-4df4-8c58-611fd26825e9]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[839c3ee6-1594-4bef-883b-3ac004ff4fd0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:59:28 user nova-compute[72504]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 19:59:28 user nova-compute[72504]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 (non-flash)
Aug 01 19:59:28 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 19:59:28 user nova-compute[72504]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 19:59:28 user nova-compute[72504]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 (non-flash)
Aug 01 19:59:28 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca7d9e1-4867-4b94-abc2-09cf664cb41c]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 19:59:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OufDlhFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.objects.instance [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lazy-loading 'flavor' on Instance uuid de2b2e01-4be0-4709-aacd-f6a7cc2897e0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8f18ee62-04fc-4c80-b04e-cb6fb1d3f187 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.037s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Acquiring lock "interface-de2b2e01-4be0-4709-aacd-f6a7cc2897e0-ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "interface-de2b2e01-4be0-4709-aacd-f6a7cc2897e0-ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.objects.instance [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lazy-loading 'flavor' on Instance uuid de2b2e01-4be0-4709-aacd-f6a7cc2897e0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2820075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2820075',id=23,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFR6MNT81m0077QoKPCZmUoTwZo1tmyWFZilUMLyic+9WyjHpZo/ciaWRQRs7DELWXer49Euo3w0BX2N62edjBrzmKu9DWAic/6QsdF1qlTj504N9KRmTcmwPyzz0oz/gg==',key_name='tempest-keypair-857323455',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:57:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='961ea5d0c92447a9853b93335137b5bc',ramdisk_id='',reservation_id='r-pstr5dkl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-740827412',owner_user_name='tempest-TaggedAttachmentsTest-740827412-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:57:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54daf483b7e4ab7b177fe06a02c207e',uuid=de2b2e01-4be0-4709-aacd-f6a7cc2897e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f", "address": "fa:16:3e:c8:03:52", "network": {"id": "9fb4689b-a486-442a-a948-9fa0f27db6f9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1824983070", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1bc755-e6", "ovs_interfaceid": "ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Converting VIF {"id": "ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f", "address": "fa:16:3e:c8:03:52", "network": {"id": "9fb4689b-a486-442a-a948-9fa0f27db6f9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1824983070", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1bc755-e6", "ovs_interfaceid": "ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:03:52,bridge_name='br-int',has_traffic_filtering=True,id=ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f,network=Network(9fb4689b-a486-442a-a948-9fa0f27db6f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae1bc755-e6') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c8:03:52"/><model type="virtio"/><mtu size="1442"/><target dev="tapae1bc755-e6"/></interface> {{(pid=72504) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c8:03:52"/><model type="virtio"/><mtu size="1442"/><target dev="tapae1bc755-e6"/></interface> {{(pid=72504) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Attempting to detach device tapae1bc755-e6 from instance de2b2e01-4be0-4709-aacd-f6a7cc2897e0 from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] detach device xml: <interface type="ethernet">
Aug 01 19:59:29 user nova-compute[72504]:   <mac address="fa:16:3e:c8:03:52"/>
Aug 01 19:59:29 user nova-compute[72504]:   <model type="virtio"/>
Aug 01 19:59:29 user nova-compute[72504]:   <mtu size="1442"/>
Aug 01 19:59:29 user nova-compute[72504]:   <target dev="tapae1bc755-e6"/>
Aug 01 19:59:29 user nova-compute[72504]: </interface>
Aug 01 19:59:29 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c8:03:52"/><model type="virtio"/><mtu size="1442"/><target dev="tapae1bc755-e6"/></interface> {{(pid=72504) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c8:03:52"/><model type="virtio"/><mtu size="1442"/><target dev="tapae1bc755-e6"/></interface>not found in domain: <domain type='kvm' id='29'>
Aug 01 19:59:29 user nova-compute[72504]:   <name>instance-00000017</name>
Aug 01 19:59:29 user nova-compute[72504]:   <uuid>de2b2e01-4be0-4709-aacd-f6a7cc2897e0</uuid>
Aug 01 19:59:29 user nova-compute[72504]:   <metadata>
Aug 01 19:59:29 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:59:29 user nova-compute[72504]:   <nova:package version="0.0.0"/>
Aug 01 19:59:29 user nova-compute[72504]:   <nova:name>tempest-device-tagging-server-2820075</nova:name>
Aug 01 19:59:29 user nova-compute[72504]:   <nova:creationTime>2023-08-01 19:59:13</nova:creationTime>
Aug 01 19:59:29 user nova-compute[72504]:   <nova:flavor name="m1.tiny">
Aug 01 19:59:29 user nova-compute[72504]:     <nova:memory>512</nova:memory>
Aug 01 19:59:29 user nova-compute[72504]:     <nova:disk>1</nova:disk>
Aug 01 19:59:29 user nova-compute[72504]:     <nova:swap>0</nova:swap>
Aug 01 19:59:29 user nova-compute[72504]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:59:29 user nova-compute[72504]:     <nova:vcpus>1</nova:vcpus>
Aug 01 19:59:29 user nova-compute[72504]:   </nova:flavor>
Aug 01 19:59:29 user nova-compute[72504]:   <nova:owner>
Aug 01 19:59:29 user nova-compute[72504]:     <nova:user uuid="c54daf483b7e4ab7b177fe06a02c207e">tempest-TaggedAttachmentsTest-740827412-project-member</nova:user>
Aug 01 19:59:29 user nova-compute[72504]:     <nova:project uuid="961ea5d0c92447a9853b93335137b5bc">tempest-TaggedAttachmentsTest-740827412</nova:project>
Aug 01 19:59:29 user nova-compute[72504]:   </nova:owner>
Aug 01 19:59:29 user nova-compute[72504]:   <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:59:29 user nova-compute[72504]:   <nova:ports>
Aug 01 19:59:29 user nova-compute[72504]:     <nova:port uuid="d46af6d6-430b-4d54-a553-937e9bf21d16">
Aug 01 19:59:29 user nova-compute[72504]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 19:59:29 user nova-compute[72504]:     </nova:port>
Aug 01 19:59:29 user nova-compute[72504]:     <nova:port uuid="ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f">
Aug 01 19:59:29 user nova-compute[72504]:       <nova:ip type="fixed" address="10.10.10.78" ipVersion="4"/>
Aug 01 19:59:29 user nova-compute[72504]:     </nova:port>
Aug 01 19:59:29 user nova-compute[72504]:   </nova:ports>
Aug 01 19:59:29 user nova-compute[72504]: </nova:instance>
Aug 01 19:59:29 user nova-compute[72504]:   </metadata>
Aug 01 19:59:29 user nova-compute[72504]:   <memory unit='KiB'>524288</memory>
Aug 01 19:59:29 user nova-compute[72504]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 01 19:59:29 user nova-compute[72504]:   <vcpu placement='static'>1</vcpu>
Aug 01 19:59:29 user nova-compute[72504]:   <resource>
Aug 01 19:59:29 user nova-compute[72504]:     <partition>/machine</partition>
Aug 01 19:59:29 user nova-compute[72504]:   </resource>
Aug 01 19:59:29 user nova-compute[72504]:   <sysinfo type='smbios'>
Aug 01 19:59:29 user nova-compute[72504]:     <system>
Aug 01 19:59:29 user nova-compute[72504]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 01 19:59:29 user nova-compute[72504]:       <entry name='product'>OpenStack Nova</entry>
Aug 01 19:59:29 user nova-compute[72504]:       <entry name='version'>0.0.0</entry>
Aug 01 19:59:29 user nova-compute[72504]:       <entry name='serial'>de2b2e01-4be0-4709-aacd-f6a7cc2897e0</entry>
Aug 01 19:59:29 user nova-compute[72504]:       <entry name='uuid'>de2b2e01-4be0-4709-aacd-f6a7cc2897e0</entry>
Aug 01 19:59:29 user nova-compute[72504]:       <entry name='family'>Virtual Machine</entry>
Aug 01 19:59:29 user nova-compute[72504]:     </system>
Aug 01 19:59:29 user nova-compute[72504]:   </sysinfo>
Aug 01 19:59:29 user nova-compute[72504]:   <os>
Aug 01 19:59:29 user nova-compute[72504]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 01 19:59:29 user nova-compute[72504]:     <boot dev='hd'/>
Aug 01 19:59:29 user nova-compute[72504]:     <smbios mode='sysinfo'/>
Aug 01 19:59:29 user nova-compute[72504]:   </os>
Aug 01 19:59:29 user nova-compute[72504]:   <features>
Aug 01 19:59:29 user nova-compute[72504]:     <acpi/>
Aug 01 19:59:29 user nova-compute[72504]:     <apic/>
Aug 01 19:59:29 user nova-compute[72504]:     <vmcoreinfo state='on'/>
Aug 01 19:59:29 user nova-compute[72504]:   </features>
Aug 01 19:59:29 user nova-compute[72504]:   <cpu mode='custom' match='exact' check='full'>
Aug 01 19:59:29 user nova-compute[72504]:     <model fallback='forbid'>Nehalem</model>
Aug 01 19:59:29 user nova-compute[72504]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 01 19:59:29 user nova-compute[72504]:     <feature policy='require' name='vme'/>
Aug 01 19:59:29 user nova-compute[72504]:     <feature policy='require' name='x2apic'/>
Aug 01 19:59:29 user nova-compute[72504]:     <feature policy='require' name='hypervisor'/>
Aug 01 19:59:29 user nova-compute[72504]:   </cpu>
Aug 01 19:59:29 user nova-compute[72504]:   <clock offset='utc'>
Aug 01 19:59:29 user nova-compute[72504]:     <timer name='pit' tickpolicy='delay'/>
Aug 01 19:59:29 user nova-compute[72504]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 01 19:59:29 user nova-compute[72504]:     <timer name='hpet' present='no'/>
Aug 01 19:59:29 user nova-compute[72504]:   </clock>
Aug 01 19:59:29 user nova-compute[72504]:   <on_poweroff>destroy</on_poweroff>
Aug 01 19:59:29 user nova-compute[72504]:   <on_reboot>restart</on_reboot>
Aug 01 19:59:29 user nova-compute[72504]:   <on_crash>destroy</on_crash>
Aug 01 19:59:29 user nova-compute[72504]:   <devices>
Aug 01 19:59:29 user nova-compute[72504]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 19:59:29 user nova-compute[72504]:     <disk type='file' device='disk'>
Aug 01 19:59:29 user nova-compute[72504]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 01 19:59:29 user nova-compute[72504]:       <source file='/opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk' index='2'/>
Aug 01 19:59:29 user nova-compute[72504]:       <backingStore type='file' index='3'>
Aug 01 19:59:29 user nova-compute[72504]:         <format type='raw'/>
Aug 01 19:59:29 user nova-compute[72504]:         <source file='/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5'/>
Aug 01 19:59:29 user nova-compute[72504]:         <backingStore/>
Aug 01 19:59:29 user nova-compute[72504]:       </backingStore>
Aug 01 19:59:29 user nova-compute[72504]:       <target dev='vda' bus='virtio'/>
Aug 01 19:59:29 user nova-compute[72504]:       <alias name='virtio-disk0'/>
Aug 01 19:59:29 user nova-compute[72504]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 01 19:59:29 user nova-compute[72504]:     </disk>
Aug 01 19:59:29 user nova-compute[72504]:     <disk type='file' device='cdrom'>
Aug 01 19:59:29 user nova-compute[72504]:       <driver name='qemu' type='raw' cache='none'/>
Aug 01 19:59:29 user nova-compute[72504]:       <source file='/opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk.config' index='1'/>
Aug 01 19:59:29 user nova-compute[72504]:       <backingStore/>
Aug 01 19:59:29 user nova-compute[72504]:       <target dev='hda' bus='ide'/>
Aug 01 19:59:29 user nova-compute[72504]:       <readonly/>
Aug 01 19:59:29 user nova-compute[72504]:       <alias name='ide0-0-0'/>
Aug 01 19:59:29 user nova-compute[72504]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 01 19:59:29 user nova-compute[72504]:     </disk>
Aug 01 19:59:29 user nova-compute[72504]:     <controller type='usb' index='0' model='none'>
Aug 01 19:59:29 user nova-compute[72504]:       <alias name='usb'/>
Aug 01 19:59:29 user nova-compute[72504]:     </controller>
Aug 01 19:59:29 user nova-compute[72504]:     <controller type='pci' index='0' model='pci-root'>
Aug 01 19:59:29 user nova-compute[72504]:       <alias name='pci.0'/>
Aug 01 19:59:29 user nova-compute[72504]:     </controller>
Aug 01 19:59:29 user nova-compute[72504]:     <controller type='ide' index='0'>
Aug 01 19:59:29 user nova-compute[72504]:       <alias name='ide'/>
Aug 01 19:59:29 user nova-compute[72504]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 01 19:59:29 user nova-compute[72504]:     </controller>
Aug 01 19:59:29 user nova-compute[72504]:     <interface type='ethernet'>
Aug 01 19:59:29 user nova-compute[72504]:       <mac address='fa:16:3e:bf:32:31'/>
Aug 01 19:59:29 user nova-compute[72504]:       <target dev='tapd46af6d6-43'/>
Aug 01 19:59:29 user nova-compute[72504]:       <model type='virtio'/>
Aug 01 19:59:29 user nova-compute[72504]:       <mtu size='1442'/>
Aug 01 19:59:29 user nova-compute[72504]:       <alias name='net0'/>
Aug 01 19:59:29 user nova-compute[72504]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 01 19:59:29 user nova-compute[72504]:     </interface>
Aug 01 19:59:29 user nova-compute[72504]:     <interface type='ethernet'>
Aug 01 19:59:29 user nova-compute[72504]:       <mac address='fa:16:3e:c8:03:52'/>
Aug 01 19:59:29 user nova-compute[72504]:       <target dev='tapae1bc755-e6'/>
Aug 01 19:59:29 user nova-compute[72504]:       <model type='virtio'/>
Aug 01 19:59:29 user nova-compute[72504]:       <mtu size='1442'/>
Aug 01 19:59:29 user nova-compute[72504]:       <alias name='net1'/>
Aug 01 19:59:29 user nova-compute[72504]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 01 19:59:29 user nova-compute[72504]:     </interface>
Aug 01 19:59:29 user nova-compute[72504]:     <serial type='pty'>
Aug 01 19:59:29 user nova-compute[72504]:       <source path='/dev/pts/4'/>
Aug 01 19:59:29 user nova-compute[72504]:       <log file='/opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/console.log' append='off'/>
Aug 01 19:59:29 user nova-compute[72504]:       <target type='isa-serial' port='0'>
Aug 01 19:59:29 user nova-compute[72504]:         <model name='isa-serial'/>
Aug 01 19:59:29 user nova-compute[72504]:       </target>
Aug 01 19:59:29 user nova-compute[72504]:       <alias name='serial0'/>
Aug 01 19:59:29 user nova-compute[72504]:     </serial>
Aug 01 19:59:29 user nova-compute[72504]:     <console type='pty' tty='/dev/pts/4'>
Aug 01 19:59:29 user nova-compute[72504]:       <source path='/dev/pts/4'/>
Aug 01 19:59:29 user nova-compute[72504]:       <log file='/opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/console.log' append='off'/>
Aug 01 19:59:29 user nova-compute[72504]:       <target type='serial' port='0'/>
Aug 01 19:59:29 user nova-compute[72504]:       <alias name='serial0'/>
Aug 01 19:59:29 user nova-compute[72504]:     </console>
Aug 01 19:59:29 user nova-compute[72504]:     <input type='mouse' bus='ps2'>
Aug 01 19:59:29 user nova-compute[72504]:       <alias name='input0'/>
Aug 01 19:59:29 user nova-compute[72504]:     </input>
Aug 01 19:59:29 user nova-compute[72504]:     <input type='keyboard' bus='ps2'>
Aug 01 19:59:29 user nova-compute[72504]:       <alias name='input1'/>
Aug 01 19:59:29 user nova-compute[72504]:     </input>
Aug 01 19:59:29 user nova-compute[72504]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Aug 01 19:59:29 user nova-compute[72504]:       <listen type='address' address='0.0.0.0'/>
Aug 01 19:59:29 user nova-compute[72504]:     </graphics>
Aug 01 19:59:29 user nova-compute[72504]:     <audio id='1' type='none'/>
Aug 01 19:59:29 user nova-compute[72504]:     <video>
Aug 01 19:59:29 user nova-compute[72504]:       <model type='virtio' heads='1' primary='yes'/>
Aug 01 19:59:29 user nova-compute[72504]:       <alias name='video0'/>
Aug 01 19:59:29 user nova-compute[72504]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 01 19:59:29 user nova-compute[72504]:     </video>
Aug 01 19:59:29 user nova-compute[72504]:     <memballoon model='virtio'>
Aug 01 19:59:29 user nova-compute[72504]:       <stats period='10'/>
Aug 01 19:59:29 user nova-compute[72504]:       <alias name='balloon0'/>
Aug 01 19:59:29 user nova-compute[72504]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 01 19:59:29 user nova-compute[72504]:     </memballoon>
Aug 01 19:59:29 user nova-compute[72504]:     <rng model='virtio'>
Aug 01 19:59:29 user nova-compute[72504]:       <backend model='random'>/dev/urandom</backend>
Aug 01 19:59:29 user nova-compute[72504]:       <alias name='rng0'/>
Aug 01 19:59:29 user nova-compute[72504]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 01 19:59:29 user nova-compute[72504]:     </rng>
Aug 01 19:59:29 user nova-compute[72504]:   </devices>
Aug 01 19:59:29 user nova-compute[72504]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 01 19:59:29 user nova-compute[72504]:     <label>libvirt-de2b2e01-4be0-4709-aacd-f6a7cc2897e0</label>
Aug 01 19:59:29 user nova-compute[72504]:     <imagelabel>libvirt-de2b2e01-4be0-4709-aacd-f6a7cc2897e0</imagelabel>
Aug 01 19:59:29 user nova-compute[72504]:   </seclabel>
Aug 01 19:59:29 user nova-compute[72504]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 01 19:59:29 user nova-compute[72504]:     <label>+64055:+108</label>
Aug 01 19:59:29 user nova-compute[72504]:     <imagelabel>+64055:+108</imagelabel>
Aug 01 19:59:29 user nova-compute[72504]:   </seclabel>
Aug 01 19:59:29 user nova-compute[72504]: </domain>
Aug 01 19:59:29 user nova-compute[72504]:  {{(pid=72504) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 01 19:59:29 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Successfully detached device tapae1bc755-e6 from instance de2b2e01-4be0-4709-aacd-f6a7cc2897e0 from the persistent domain config.
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] (1/8): Attempting to detach device tapae1bc755-e6 with device alias net1 from instance de2b2e01-4be0-4709-aacd-f6a7cc2897e0 from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] detach device xml: <interface type="ethernet">
Aug 01 19:59:29 user nova-compute[72504]:   <mac address="fa:16:3e:c8:03:52"/>
Aug 01 19:59:29 user nova-compute[72504]:   <model type="virtio"/>
Aug 01 19:59:29 user nova-compute[72504]:   <mtu size="1442"/>
Aug 01 19:59:29 user nova-compute[72504]:   <target dev="tapae1bc755-e6"/>
Aug 01 19:59:29 user nova-compute[72504]: </interface>
Aug 01 19:59:29 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690919969.7582996, de2b2e01-4be0-4709-aacd-f6a7cc2897e0 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Start waiting for the detach event from libvirt for device tapae1bc755-e6 with device alias net1 for instance de2b2e01-4be0-4709-aacd-f6a7cc2897e0 {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c8:03:52"/><model type="virtio"/><mtu size="1442"/><target dev="tapae1bc755-e6"/></interface> {{(pid=72504) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c8:03:52"/><model type="virtio"/><mtu size="1442"/><target dev="tapae1bc755-e6"/></interface>not found in domain: <domain type='kvm' id='29'>
Aug 01 19:59:29 user nova-compute[72504]:   <name>instance-00000017</name>
Aug 01 19:59:29 user nova-compute[72504]:   <uuid>de2b2e01-4be0-4709-aacd-f6a7cc2897e0</uuid>
Aug 01 19:59:29 user nova-compute[72504]:   <metadata>
Aug 01 19:59:29 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:59:29 user nova-compute[72504]:   <nova:package version="0.0.0"/>
Aug 01 19:59:29 user nova-compute[72504]:   <nova:name>tempest-device-tagging-server-2820075</nova:name>
Aug 01 19:59:29 user nova-compute[72504]:   <nova:creationTime>2023-08-01 19:59:13</nova:creationTime>
Aug 01 19:59:29 user nova-compute[72504]:   <nova:flavor name="m1.tiny">
Aug 01 19:59:29 user nova-compute[72504]:     <nova:memory>512</nova:memory>
Aug 01 19:59:29 user nova-compute[72504]:     <nova:disk>1</nova:disk>
Aug 01 19:59:29 user nova-compute[72504]:     <nova:swap>0</nova:swap>
Aug 01 19:59:29 user nova-compute[72504]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:59:29 user nova-compute[72504]:     <nova:vcpus>1</nova:vcpus>
Aug 01 19:59:29 user nova-compute[72504]:   </nova:flavor>
Aug 01 19:59:29 user nova-compute[72504]:   <nova:owner>
Aug 01 19:59:29 user nova-compute[72504]:     <nova:user uuid="c54daf483b7e4ab7b177fe06a02c207e">tempest-TaggedAttachmentsTest-740827412-project-member</nova:user>
Aug 01 19:59:29 user nova-compute[72504]:     <nova:project uuid="961ea5d0c92447a9853b93335137b5bc">tempest-TaggedAttachmentsTest-740827412</nova:project>
Aug 01 19:59:29 user nova-compute[72504]:   </nova:owner>
Aug 01 19:59:29 user nova-compute[72504]:   <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:59:29 user nova-compute[72504]:   <nova:ports>
Aug 01 19:59:29 user nova-compute[72504]:     <nova:port uuid="d46af6d6-430b-4d54-a553-937e9bf21d16">
Aug 01 19:59:29 user nova-compute[72504]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 19:59:29 user nova-compute[72504]:     </nova:port>
Aug 01 19:59:29 user nova-compute[72504]:     <nova:port uuid="ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f">
Aug 01 19:59:29 user nova-compute[72504]:       <nova:ip type="fixed" address="10.10.10.78" ipVersion="4"/>
Aug 01 19:59:29 user nova-compute[72504]:     </nova:port>
Aug 01 19:59:29 user nova-compute[72504]:   </nova:ports>
Aug 01 19:59:29 user nova-compute[72504]: </nova:instance>
Aug 01 19:59:29 user nova-compute[72504]:   </metadata>
Aug 01 19:59:29 user nova-compute[72504]:   <memory unit='KiB'>524288</memory>
Aug 01 19:59:29 user nova-compute[72504]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 01 19:59:29 user nova-compute[72504]:   <vcpu placement='static'>1</vcpu>
Aug 01 19:59:29 user nova-compute[72504]:   <resource>
Aug 01 19:59:29 user nova-compute[72504]:     <partition>/machine</partition>
Aug 01 19:59:29 user nova-compute[72504]:   </resource>
Aug 01 19:59:29 user nova-compute[72504]:   <sysinfo type='smbios'>
Aug 01 19:59:29 user nova-compute[72504]:     <system>
Aug 01 19:59:29 user nova-compute[72504]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 01 19:59:29 user nova-compute[72504]:       <entry name='product'>OpenStack Nova</entry>
Aug 01 19:59:29 user nova-compute[72504]:       <entry name='version'>0.0.0</entry>
Aug 01 19:59:29 user nova-compute[72504]:       <entry name='serial'>de2b2e01-4be0-4709-aacd-f6a7cc2897e0</entry>
Aug 01 19:59:29 user nova-compute[72504]:       <entry name='uuid'>de2b2e01-4be0-4709-aacd-f6a7cc2897e0</entry>
Aug 01 19:59:29 user nova-compute[72504]:       <entry name='family'>Virtual Machine</entry>
Aug 01 19:59:29 user nova-compute[72504]:     </system>
Aug 01 19:59:29 user nova-compute[72504]:   </sysinfo>
Aug 01 19:59:29 user nova-compute[72504]:   <os>
Aug 01 19:59:29 user nova-compute[72504]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 01 19:59:29 user nova-compute[72504]:     <boot dev='hd'/>
Aug 01 19:59:29 user nova-compute[72504]:     <smbios mode='sysinfo'/>
Aug 01 19:59:29 user nova-compute[72504]:   </os>
Aug 01 19:59:29 user nova-compute[72504]:   <features>
Aug 01 19:59:29 user nova-compute[72504]:     <acpi/>
Aug 01 19:59:29 user nova-compute[72504]:     <apic/>
Aug 01 19:59:29 user nova-compute[72504]:     <vmcoreinfo state='on'/>
Aug 01 19:59:29 user nova-compute[72504]:   </features>
Aug 01 19:59:29 user nova-compute[72504]:   <cpu mode='custom' match='exact' check='full'>
Aug 01 19:59:29 user nova-compute[72504]:     <model fallback='forbid'>Nehalem</model>
Aug 01 19:59:29 user nova-compute[72504]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 01 19:59:29 user nova-compute[72504]:     <feature policy='require' name='vme'/>
Aug 01 19:59:29 user nova-compute[72504]:     <feature policy='require' name='x2apic'/>
Aug 01 19:59:29 user nova-compute[72504]:     <feature policy='require' name='hypervisor'/>
Aug 01 19:59:29 user nova-compute[72504]:   </cpu>
Aug 01 19:59:29 user nova-compute[72504]:   <clock offset='utc'>
Aug 01 19:59:29 user nova-compute[72504]:     <timer name='pit' tickpolicy='delay'/>
Aug 01 19:59:29 user nova-compute[72504]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 01 19:59:29 user nova-compute[72504]:     <timer name='hpet' present='no'/>
Aug 01 19:59:29 user nova-compute[72504]:   </clock>
Aug 01 19:59:29 user nova-compute[72504]:   <on_poweroff>destroy</on_poweroff>
Aug 01 19:59:29 user nova-compute[72504]:   <on_reboot>restart</on_reboot>
Aug 01 19:59:29 user nova-compute[72504]:   <on_crash>destroy</on_crash>
Aug 01 19:59:29 user nova-compute[72504]:   <devices>
Aug 01 19:59:29 user nova-compute[72504]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 19:59:29 user nova-compute[72504]:     <disk type='file' device='disk'>
Aug 01 19:59:29 user nova-compute[72504]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 01 19:59:29 user nova-compute[72504]:       <source file='/opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk' index='2'/>
Aug 01 19:59:29 user nova-compute[72504]:       <backingStore type='file' index='3'>
Aug 01 19:59:29 user nova-compute[72504]:         <format type='raw'/>
Aug 01 19:59:29 user nova-compute[72504]:         <source file='/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5'/>
Aug 01 19:59:29 user nova-compute[72504]:         <backingStore/>
Aug 01 19:59:29 user nova-compute[72504]:       </backingStore>
Aug 01 19:59:29 user nova-compute[72504]:       <target dev='vda' bus='virtio'/>
Aug 01 19:59:29 user nova-compute[72504]:       <alias name='virtio-disk0'/>
Aug 01 19:59:29 user nova-compute[72504]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 01 19:59:29 user nova-compute[72504]:     </disk>
Aug 01 19:59:29 user nova-compute[72504]:     <disk type='file' device='cdrom'>
Aug 01 19:59:29 user nova-compute[72504]:       <driver name='qemu' type='raw' cache='none'/>
Aug 01 19:59:29 user nova-compute[72504]:       <source file='/opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk.config' index='1'/>
Aug 01 19:59:29 user nova-compute[72504]:       <backingStore/>
Aug 01 19:59:29 user nova-compute[72504]:       <target dev='hda' bus='ide'/>
Aug 01 19:59:29 user nova-compute[72504]:       <readonly/>
Aug 01 19:59:29 user nova-compute[72504]:       <alias name='ide0-0-0'/>
Aug 01 19:59:29 user nova-compute[72504]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 01 19:59:29 user nova-compute[72504]:     </disk>
Aug 01 19:59:29 user nova-compute[72504]:     <controller type='usb' index='0' model='none'>
Aug 01 19:59:29 user nova-compute[72504]:       <alias name='usb'/>
Aug 01 19:59:29 user nova-compute[72504]:     </controller>
Aug 01 19:59:29 user nova-compute[72504]:     <controller type='pci' index='0' model='pci-root'>
Aug 01 19:59:29 user nova-compute[72504]:       <alias name='pci.0'/>
Aug 01 19:59:29 user nova-compute[72504]:     </controller>
Aug 01 19:59:29 user nova-compute[72504]:     <controller type='ide' index='0'>
Aug 01 19:59:29 user nova-compute[72504]:       <alias name='ide'/>
Aug 01 19:59:29 user nova-compute[72504]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 01 19:59:29 user nova-compute[72504]:     </controller>
Aug 01 19:59:29 user nova-compute[72504]:     <interface type='ethernet'>
Aug 01 19:59:29 user nova-compute[72504]:       <mac address='fa:16:3e:bf:32:31'/>
Aug 01 19:59:29 user nova-compute[72504]:       <target dev='tapd46af6d6-43'/>
Aug 01 19:59:29 user nova-compute[72504]:       <model type='virtio'/>
Aug 01 19:59:29 user nova-compute[72504]:       <mtu size='1442'/>
Aug 01 19:59:29 user nova-compute[72504]:       <alias name='net0'/>
Aug 01 19:59:29 user nova-compute[72504]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 01 19:59:29 user nova-compute[72504]:     </interface>
Aug 01 19:59:29 user nova-compute[72504]:     <serial type='pty'>
Aug 01 19:59:29 user nova-compute[72504]:       <source path='/dev/pts/4'/>
Aug 01 19:59:29 user nova-compute[72504]:       <log file='/opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/console.log' append='off'/>
Aug 01 19:59:29 user nova-compute[72504]:       <target type='isa-serial' port='0'>
Aug 01 19:59:29 user nova-compute[72504]:         <model name='isa-serial'/>
Aug 01 19:59:29 user nova-compute[72504]:       </target>
Aug 01 19:59:29 user nova-compute[72504]:       <alias name='serial0'/>
Aug 01 19:59:29 user nova-compute[72504]:     </serial>
Aug 01 19:59:29 user nova-compute[72504]:     <console type='pty' tty='/dev/pts/4'>
Aug 01 19:59:29 user nova-compute[72504]:       <source path='/dev/pts/4'/>
Aug 01 19:59:29 user nova-compute[72504]:       <log file='/opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/console.log' append='off'/>
Aug 01 19:59:29 user nova-compute[72504]:       <target type='serial' port='0'/>
Aug 01 19:59:29 user nova-compute[72504]:       <alias name='serial0'/>
Aug 01 19:59:29 user nova-compute[72504]:     </console>
Aug 01 19:59:29 user nova-compute[72504]:     <input type='mouse' bus='ps2'>
Aug 01 19:59:29 user nova-compute[72504]:       <alias name='input0'/>
Aug 01 19:59:29 user nova-compute[72504]:     </input>
Aug 01 19:59:29 user nova-compute[72504]:     <input type='keyboard' bus='ps2'>
Aug 01 19:59:29 user nova-compute[72504]:       <alias name='input1'/>
Aug 01 19:59:29 user nova-compute[72504]:     </input>
Aug 01 19:59:29 user nova-compute[72504]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Aug 01 19:59:29 user nova-compute[72504]:       <listen type='address' address='0.0.0.0'/>
Aug 01 19:59:29 user nova-compute[72504]:     </graphics>
Aug 01 19:59:29 user nova-compute[72504]:     <audio id='1' type='none'/>
Aug 01 19:59:29 user nova-compute[72504]:     <video>
Aug 01 19:59:29 user nova-compute[72504]:       <model type='virtio' heads='1' primary='yes'/>
Aug 01 19:59:29 user nova-compute[72504]:       <alias name='video0'/>
Aug 01 19:59:29 user nova-compute[72504]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 01 19:59:29 user nova-compute[72504]:     </video>
Aug 01 19:59:29 user nova-compute[72504]:     <memballoon model='virtio'>
Aug 01 19:59:29 user nova-compute[72504]:       <stats period='10'/>
Aug 01 19:59:29 user nova-compute[72504]:       <alias name='balloon0'/>
Aug 01 19:59:29 user nova-compute[72504]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 01 19:59:29 user nova-compute[72504]:     </memballoon>
Aug 01 19:59:29 user nova-compute[72504]:     <rng model='virtio'>
Aug 01 19:59:29 user nova-compute[72504]:       <backend model='random'>/dev/urandom</backend>
Aug 01 19:59:29 user nova-compute[72504]:       <alias name='rng0'/>
Aug 01 19:59:29 user nova-compute[72504]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 01 19:59:29 user nova-compute[72504]:     </rng>
Aug 01 19:59:29 user nova-compute[72504]:   </devices>
Aug 01 19:59:29 user nova-compute[72504]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 01 19:59:29 user nova-compute[72504]:     <label>libvirt-de2b2e01-4be0-4709-aacd-f6a7cc2897e0</label>
Aug 01 19:59:29 user nova-compute[72504]:     <imagelabel>libvirt-de2b2e01-4be0-4709-aacd-f6a7cc2897e0</imagelabel>
Aug 01 19:59:29 user nova-compute[72504]:   </seclabel>
Aug 01 19:59:29 user nova-compute[72504]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 01 19:59:29 user nova-compute[72504]:     <label>+64055:+108</label>
Aug 01 19:59:29 user nova-compute[72504]:     <imagelabel>+64055:+108</imagelabel>
Aug 01 19:59:29 user nova-compute[72504]:   </seclabel>
Aug 01 19:59:29 user nova-compute[72504]: </domain>
Aug 01 19:59:29 user nova-compute[72504]:  {{(pid=72504) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 01 19:59:29 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Successfully detached device tapae1bc755-e6 from instance de2b2e01-4be0-4709-aacd-f6a7cc2897e0 from the live domain config.
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2820075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2820075',id=23,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFR6MNT81m0077QoKPCZmUoTwZo1tmyWFZilUMLyic+9WyjHpZo/ciaWRQRs7DELWXer49Euo3w0BX2N62edjBrzmKu9DWAic/6QsdF1qlTj504N9KRmTcmwPyzz0oz/gg==',key_name='tempest-keypair-857323455',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:57:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='961ea5d0c92447a9853b93335137b5bc',ramdisk_id='',reservation_id='r-pstr5dkl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-740827412',owner_user_name='tempest-TaggedAttachmentsTest-740827412-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:57:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54daf483b7e4ab7b177fe06a02c207e',uuid=de2b2e01-4be0-4709-aacd-f6a7cc2897e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f", "address": "fa:16:3e:c8:03:52", "network": {"id": "9fb4689b-a486-442a-a948-9fa0f27db6f9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1824983070", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1bc755-e6", "ovs_interfaceid": "ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Converting VIF {"id": "ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f", "address": "fa:16:3e:c8:03:52", "network": {"id": "9fb4689b-a486-442a-a948-9fa0f27db6f9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1824983070", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1bc755-e6", "ovs_interfaceid": "ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:03:52,bridge_name='br-int',has_traffic_filtering=True,id=ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f,network=Network(9fb4689b-a486-442a-a948-9fa0f27db6f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae1bc755-e6') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG os_vif [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:03:52,bridge_name='br-int',has_traffic_filtering=True,id=ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f,network=Network(9fb4689b-a486-442a-a948-9fa0f27db6f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae1bc755-e6') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae1bc755-e6, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:29 user nova-compute[72504]: INFO os_vif [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:03:52,bridge_name='br-int',has_traffic_filtering=True,id=ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f,network=Network(9fb4689b-a486-442a-a948-9fa0f27db6f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae1bc755-e6')
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:59:29 user nova-compute[72504]:   <nova:package version="0.0.0"/>
Aug 01 19:59:29 user nova-compute[72504]:   <nova:name>tempest-device-tagging-server-2820075</nova:name>
Aug 01 19:59:29 user nova-compute[72504]:   <nova:creationTime>2023-08-01 19:59:29</nova:creationTime>
Aug 01 19:59:29 user nova-compute[72504]:   <nova:flavor name="m1.tiny">
Aug 01 19:59:29 user nova-compute[72504]:     <nova:memory>512</nova:memory>
Aug 01 19:59:29 user nova-compute[72504]:     <nova:disk>1</nova:disk>
Aug 01 19:59:29 user nova-compute[72504]:     <nova:swap>0</nova:swap>
Aug 01 19:59:29 user nova-compute[72504]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:59:29 user nova-compute[72504]:     <nova:vcpus>1</nova:vcpus>
Aug 01 19:59:29 user nova-compute[72504]:   </nova:flavor>
Aug 01 19:59:29 user nova-compute[72504]:   <nova:owner>
Aug 01 19:59:29 user nova-compute[72504]:     <nova:user uuid="c54daf483b7e4ab7b177fe06a02c207e">tempest-TaggedAttachmentsTest-740827412-project-member</nova:user>
Aug 01 19:59:29 user nova-compute[72504]:     <nova:project uuid="961ea5d0c92447a9853b93335137b5bc">tempest-TaggedAttachmentsTest-740827412</nova:project>
Aug 01 19:59:29 user nova-compute[72504]:   </nova:owner>
Aug 01 19:59:29 user nova-compute[72504]:   <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:59:29 user nova-compute[72504]:   <nova:ports>
Aug 01 19:59:29 user nova-compute[72504]:     <nova:port uuid="d46af6d6-430b-4d54-a553-937e9bf21d16">
Aug 01 19:59:29 user nova-compute[72504]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 19:59:29 user nova-compute[72504]:     </nova:port>
Aug 01 19:59:29 user nova-compute[72504]:   </nova:ports>
Aug 01 19:59:29 user nova-compute[72504]: </nova:instance>
Aug 01 19:59:29 user nova-compute[72504]:  {{(pid=72504) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23566323335373431', 'path': '/dev/sdc'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566323335373431', 'path': '/dev/sdc'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T19:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1800688900',display_name='tempest-ServerActionsTestOtherA-server-1216550078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1800688900',id=18,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLbPu5MF6DPaLmysryryb5dEvmDVe/ZpzyX1JNIgtOIXBuGnF7k0B3yFjfDeyUfOXvFKWH1T1tnnmguBKUJb6gDrcdFY/x4LtLMGVeolXUhKxLNh5O13uubFnujvAs7Sg==',key_name='tempest-keypair-2041585985',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:55:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='816239d15d3341cdaa785fc36c8e7cdb',ramdisk_id='',reservation_id='r-5qhy089r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1009670506',owner_user_name='tempest-ServerActionsTestOtherA-1009670506-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:59:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d76765d1d24342f99ce0d65f416d382b',uuid=88f95d20-e391-4100-93b2-da29bfcf9704,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "address": "fa:16:3e:c3:aa:1c", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a4ace30-3c", "ovs_interfaceid": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Converting VIF {"id": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "address": "fa:16:3e:c3:aa:1c", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a4ace30-3c", "ovs_interfaceid": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:aa:1c,bridge_name='br-int',has_traffic_filtering=True,id=3a4ace30-3ca6-4cc9-8125-599cc4097662,network=Network(92749f96-d369-4df5-85ce-252c277e7ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a4ace30-3c') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:59:29 user nova-compute[72504]:   <uuid>88f95d20-e391-4100-93b2-da29bfcf9704</uuid>
Aug 01 19:59:29 user nova-compute[72504]:   <name>instance-00000012</name>
Aug 01 19:59:29 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:59:29 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:59:29 user nova-compute[72504]:   <metadata>
Aug 01 19:59:29 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:59:29 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:59:29 user nova-compute[72504]:       <nova:name>tempest-ServerActionsTestOtherA-server-1216550078</nova:name>
Aug 01 19:59:29 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:59:28</nova:creationTime>
Aug 01 19:59:29 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:59:29 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:59:29 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:59:29 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:59:29 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:59:29 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:59:29 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:59:29 user nova-compute[72504]:       <nova:owner>
Aug 01 19:59:29 user nova-compute[72504]:         <nova:user uuid="d76765d1d24342f99ce0d65f416d382b">tempest-ServerActionsTestOtherA-1009670506-project-member</nova:user>
Aug 01 19:59:29 user nova-compute[72504]:         <nova:project uuid="816239d15d3341cdaa785fc36c8e7cdb">tempest-ServerActionsTestOtherA-1009670506</nova:project>
Aug 01 19:59:29 user nova-compute[72504]:       </nova:owner>
Aug 01 19:59:29 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:59:29 user nova-compute[72504]:       <nova:ports>
Aug 01 19:59:29 user nova-compute[72504]:         <nova:port uuid="3a4ace30-3ca6-4cc9-8125-599cc4097662">
Aug 01 19:59:29 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 19:59:29 user nova-compute[72504]:         </nova:port>
Aug 01 19:59:29 user nova-compute[72504]:       </nova:ports>
Aug 01 19:59:29 user nova-compute[72504]:     </nova:instance>
Aug 01 19:59:29 user nova-compute[72504]:   </metadata>
Aug 01 19:59:29 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:59:29 user nova-compute[72504]:     <system>
Aug 01 19:59:29 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:59:29 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:59:29 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:59:29 user nova-compute[72504]:       <entry name="serial">88f95d20-e391-4100-93b2-da29bfcf9704</entry>
Aug 01 19:59:29 user nova-compute[72504]:       <entry name="uuid">88f95d20-e391-4100-93b2-da29bfcf9704</entry>
Aug 01 19:59:29 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:59:29 user nova-compute[72504]:     </system>
Aug 01 19:59:29 user nova-compute[72504]:   </sysinfo>
Aug 01 19:59:29 user nova-compute[72504]:   <os>
Aug 01 19:59:29 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:59:29 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:59:29 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:59:29 user nova-compute[72504]:   </os>
Aug 01 19:59:29 user nova-compute[72504]:   <features>
Aug 01 19:59:29 user nova-compute[72504]:     <acpi/>
Aug 01 19:59:29 user nova-compute[72504]:     <apic/>
Aug 01 19:59:29 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:59:29 user nova-compute[72504]:   </features>
Aug 01 19:59:29 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:59:29 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:59:29 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:59:29 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:59:29 user nova-compute[72504]:   </clock>
Aug 01 19:59:29 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:59:29 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:59:29 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:59:29 user nova-compute[72504]:   </cpu>
Aug 01 19:59:29 user nova-compute[72504]:   <devices>
Aug 01 19:59:29 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:59:29 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:59:29 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk"/>
Aug 01 19:59:29 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:59:29 user nova-compute[72504]:     </disk>
Aug 01 19:59:29 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 19:59:29 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 19:59:29 user nova-compute[72504]:       <source dev="/dev/sdc"/>
Aug 01 19:59:29 user nova-compute[72504]:       <target dev="vdb" bus="virtio"/>
Aug 01 19:59:29 user nova-compute[72504]:       <serial>c3b5577d-9370-489d-b16f-1a88059a3d51</serial>
Aug 01 19:59:29 user nova-compute[72504]:     </disk>
Aug 01 19:59:29 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:59:29 user nova-compute[72504]:       <mac address="fa:16:3e:c3:aa:1c"/>
Aug 01 19:59:29 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:59:29 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:59:29 user nova-compute[72504]:       <target dev="tap3a4ace30-3c"/>
Aug 01 19:59:29 user nova-compute[72504]:     </interface>
Aug 01 19:59:29 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:59:29 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/console.log" append="off"/>
Aug 01 19:59:29 user nova-compute[72504]:     </serial>
Aug 01 19:59:29 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:59:29 user nova-compute[72504]:     <video>
Aug 01 19:59:29 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:59:29 user nova-compute[72504]:     </video>
Aug 01 19:59:29 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:59:29 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:59:29 user nova-compute[72504]:     </rng>
Aug 01 19:59:29 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:59:29 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:59:29 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:59:29 user nova-compute[72504]:     </memballoon>
Aug 01 19:59:29 user nova-compute[72504]:   </devices>
Aug 01 19:59:29 user nova-compute[72504]: </domain>
Aug 01 19:59:29 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T19:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1800688900',display_name='tempest-ServerActionsTestOtherA-server-1216550078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1800688900',id=18,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLbPu5MF6DPaLmysryryb5dEvmDVe/ZpzyX1JNIgtOIXBuGnF7k0B3yFjfDeyUfOXvFKWH1T1tnnmguBKUJb6gDrcdFY/x4LtLMGVeolXUhKxLNh5O13uubFnujvAs7Sg==',key_name='tempest-keypair-2041585985',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:55:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='816239d15d3341cdaa785fc36c8e7cdb',ramdisk_id='',reservation_id='r-5qhy089r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1009670506',owner_user_name='tempest-ServerActionsTestOtherA-1009670506-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:59:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d76765d1d24342f99ce0d65f416d382b',uuid=88f95d20-e391-4100-93b2-da29bfcf9704,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "address": "fa:16:3e:c3:aa:1c", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a4ace30-3c", "ovs_interfaceid": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Converting VIF {"id": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "address": "fa:16:3e:c3:aa:1c", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a4ace30-3c", "ovs_interfaceid": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:aa:1c,bridge_name='br-int',has_traffic_filtering=True,id=3a4ace30-3ca6-4cc9-8125-599cc4097662,network=Network(92749f96-d369-4df5-85ce-252c277e7ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a4ace30-3c') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG os_vif [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:aa:1c,bridge_name='br-int',has_traffic_filtering=True,id=3a4ace30-3ca6-4cc9-8125-599cc4097662,network=Network(92749f96-d369-4df5-85ce-252c277e7ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a4ace30-3c') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a4ace30-3c, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a4ace30-3c, col_values=(('external_ids', {'iface-id': '3a4ace30-3ca6-4cc9-8125-599cc4097662', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:aa:1c', 'vm-uuid': '88f95d20-e391-4100-93b2-da29bfcf9704'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.compute.manager [req-a77a9eb4-e9ea-4d09-aaac-06798f7dea18 req-f0174e09-d89a-4e3a-8a1b-106b7dbb2acc service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Received event network-vif-unplugged-ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a77a9eb4-e9ea-4d09-aaac-06798f7dea18 req-f0174e09-d89a-4e3a-8a1b-106b7dbb2acc service nova] Acquiring lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a77a9eb4-e9ea-4d09-aaac-06798f7dea18 req-f0174e09-d89a-4e3a-8a1b-106b7dbb2acc service nova] Lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a77a9eb4-e9ea-4d09-aaac-06798f7dea18 req-f0174e09-d89a-4e3a-8a1b-106b7dbb2acc service nova] Lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:29 user nova-compute[72504]: DEBUG nova.compute.manager [req-a77a9eb4-e9ea-4d09-aaac-06798f7dea18 req-f0174e09-d89a-4e3a-8a1b-106b7dbb2acc service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] No waiting events found dispatching network-vif-unplugged-ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:59:29 user nova-compute[72504]: WARNING nova.compute.manager [req-a77a9eb4-e9ea-4d09-aaac-06798f7dea18 req-f0174e09-d89a-4e3a-8a1b-106b7dbb2acc service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Received unexpected event network-vif-unplugged-ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f for instance with vm_state active and task_state None.
Aug 01 19:59:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:29 user nova-compute[72504]: INFO os_vif [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:aa:1c,bridge_name='br-int',has_traffic_filtering=True,id=3a4ace30-3ca6-4cc9-8125-599cc4097662,network=Network(92749f96-d369-4df5-85ce-252c277e7ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a4ace30-3c')
Aug 01 19:59:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:59:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:59:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] No VIF found with MAC fa:16:3e:c3:aa:1c, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:59:30 user nova-compute[72504]: DEBUG nova.compute.manager [req-56daacf2-19c6-42cd-8a31-f25a00fe6919 req-d5b820b4-c017-4a82-b40f-905a31bce7a0 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Received event network-vif-deleted-ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:59:30 user nova-compute[72504]: INFO nova.compute.manager [req-56daacf2-19c6-42cd-8a31-f25a00fe6919 req-d5b820b4-c017-4a82-b40f-905a31bce7a0 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Neutron deleted interface ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f; detaching it from the instance and deleting it from the info cache
Aug 01 19:59:30 user nova-compute[72504]: DEBUG nova.network.neutron [req-56daacf2-19c6-42cd-8a31-f25a00fe6919 req-d5b820b4-c017-4a82-b40f-905a31bce7a0 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Updating instance_info_cache with network_info: [{"id": "d46af6d6-430b-4d54-a553-937e9bf21d16", "address": "fa:16:3e:bf:32:31", "network": {"id": "8fe56054-7531-450f-9ddd-4c519a2e4577", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-45399222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd46af6d6-43", "ovs_interfaceid": "d46af6d6-430b-4d54-a553-937e9bf21d16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:59:30 user nova-compute[72504]: DEBUG nova.objects.instance [req-56daacf2-19c6-42cd-8a31-f25a00fe6919 req-d5b820b4-c017-4a82-b40f-905a31bce7a0 service nova] Lazy-loading 'system_metadata' on Instance uuid de2b2e01-4be0-4709-aacd-f6a7cc2897e0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:59:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Acquiring lock "refresh_cache-de2b2e01-4be0-4709-aacd-f6a7cc2897e0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:59:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Acquired lock "refresh_cache-de2b2e01-4be0-4709-aacd-f6a7cc2897e0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:59:30 user nova-compute[72504]: DEBUG nova.network.neutron [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:59:30 user nova-compute[72504]: DEBUG nova.objects.instance [req-56daacf2-19c6-42cd-8a31-f25a00fe6919 req-d5b820b4-c017-4a82-b40f-905a31bce7a0 service nova] Lazy-loading 'flavor' on Instance uuid de2b2e01-4be0-4709-aacd-f6a7cc2897e0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:59:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [req-56daacf2-19c6-42cd-8a31-f25a00fe6919 req-d5b820b4-c017-4a82-b40f-905a31bce7a0 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2820075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2820075',id=23,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFR6MNT81m0077QoKPCZmUoTwZo1tmyWFZilUMLyic+9WyjHpZo/ciaWRQRs7DELWXer49Euo3w0BX2N62edjBrzmKu9DWAic/6QsdF1qlTj504N9KRmTcmwPyzz0oz/gg==',key_name='tempest-keypair-857323455',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:57:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='961ea5d0c92447a9853b93335137b5bc',ramdisk_id='',reservation_id='r-pstr5dkl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-740827412',owner_user_name='tempest-TaggedAttachmentsTest-740827412-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:57:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54daf483b7e4ab7b177fe06a02c207e',uuid=de2b2e01-4be0-4709-aacd-f6a7cc2897e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f", "address": "fa:16:3e:c8:03:52", "network": {"id": "9fb4689b-a486-442a-a948-9fa0f27db6f9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1824983070", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1bc755-e6", "ovs_interfaceid": "ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:59:30 user nova-compute[72504]: DEBUG nova.network.os_vif_util [req-56daacf2-19c6-42cd-8a31-f25a00fe6919 req-d5b820b4-c017-4a82-b40f-905a31bce7a0 service nova] Converting VIF {"id": "ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f", "address": "fa:16:3e:c8:03:52", "network": {"id": "9fb4689b-a486-442a-a948-9fa0f27db6f9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1824983070", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1bc755-e6", "ovs_interfaceid": "ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:59:30 user nova-compute[72504]: DEBUG nova.network.os_vif_util [req-56daacf2-19c6-42cd-8a31-f25a00fe6919 req-d5b820b4-c017-4a82-b40f-905a31bce7a0 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:03:52,bridge_name='br-int',has_traffic_filtering=True,id=ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f,network=Network(9fb4689b-a486-442a-a948-9fa0f27db6f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae1bc755-e6') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:59:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [req-56daacf2-19c6-42cd-8a31-f25a00fe6919 req-d5b820b4-c017-4a82-b40f-905a31bce7a0 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c8:03:52"/><model type="virtio"/><mtu size="1442"/><target dev="tapae1bc755-e6"/></interface> {{(pid=72504) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 19:59:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [req-56daacf2-19c6-42cd-8a31-f25a00fe6919 req-d5b820b4-c017-4a82-b40f-905a31bce7a0 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c8:03:52"/><model type="virtio"/><mtu size="1442"/><target dev="tapae1bc755-e6"/></interface>not found in domain: <domain type='kvm' id='29'>
Aug 01 19:59:30 user nova-compute[72504]:   <name>instance-00000017</name>
Aug 01 19:59:30 user nova-compute[72504]:   <uuid>de2b2e01-4be0-4709-aacd-f6a7cc2897e0</uuid>
Aug 01 19:59:30 user nova-compute[72504]:   <metadata>
Aug 01 19:59:30 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:59:30 user nova-compute[72504]:   <nova:package version="0.0.0"/>
Aug 01 19:59:30 user nova-compute[72504]:   <nova:name>tempest-device-tagging-server-2820075</nova:name>
Aug 01 19:59:30 user nova-compute[72504]:   <nova:creationTime>2023-08-01 19:59:29</nova:creationTime>
Aug 01 19:59:30 user nova-compute[72504]:   <nova:flavor name="m1.tiny">
Aug 01 19:59:30 user nova-compute[72504]:     <nova:memory>512</nova:memory>
Aug 01 19:59:30 user nova-compute[72504]:     <nova:disk>1</nova:disk>
Aug 01 19:59:30 user nova-compute[72504]:     <nova:swap>0</nova:swap>
Aug 01 19:59:30 user nova-compute[72504]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:59:30 user nova-compute[72504]:     <nova:vcpus>1</nova:vcpus>
Aug 01 19:59:30 user nova-compute[72504]:   </nova:flavor>
Aug 01 19:59:30 user nova-compute[72504]:   <nova:owner>
Aug 01 19:59:30 user nova-compute[72504]:     <nova:user uuid="c54daf483b7e4ab7b177fe06a02c207e">tempest-TaggedAttachmentsTest-740827412-project-member</nova:user>
Aug 01 19:59:30 user nova-compute[72504]:     <nova:project uuid="961ea5d0c92447a9853b93335137b5bc">tempest-TaggedAttachmentsTest-740827412</nova:project>
Aug 01 19:59:30 user nova-compute[72504]:   </nova:owner>
Aug 01 19:59:30 user nova-compute[72504]:   <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:59:30 user nova-compute[72504]:   <nova:ports>
Aug 01 19:59:30 user nova-compute[72504]:     <nova:port uuid="d46af6d6-430b-4d54-a553-937e9bf21d16">
Aug 01 19:59:30 user nova-compute[72504]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 19:59:30 user nova-compute[72504]:     </nova:port>
Aug 01 19:59:30 user nova-compute[72504]:   </nova:ports>
Aug 01 19:59:30 user nova-compute[72504]: </nova:instance>
Aug 01 19:59:30 user nova-compute[72504]:   </metadata>
Aug 01 19:59:30 user nova-compute[72504]:   <memory unit='KiB'>524288</memory>
Aug 01 19:59:30 user nova-compute[72504]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 01 19:59:30 user nova-compute[72504]:   <vcpu placement='static'>1</vcpu>
Aug 01 19:59:30 user nova-compute[72504]:   <resource>
Aug 01 19:59:30 user nova-compute[72504]:     <partition>/machine</partition>
Aug 01 19:59:30 user nova-compute[72504]:   </resource>
Aug 01 19:59:30 user nova-compute[72504]:   <sysinfo type='smbios'>
Aug 01 19:59:30 user nova-compute[72504]:     <system>
Aug 01 19:59:30 user nova-compute[72504]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 01 19:59:30 user nova-compute[72504]:       <entry name='product'>OpenStack Nova</entry>
Aug 01 19:59:30 user nova-compute[72504]:       <entry name='version'>0.0.0</entry>
Aug 01 19:59:30 user nova-compute[72504]:       <entry name='serial'>de2b2e01-4be0-4709-aacd-f6a7cc2897e0</entry>
Aug 01 19:59:30 user nova-compute[72504]:       <entry name='uuid'>de2b2e01-4be0-4709-aacd-f6a7cc2897e0</entry>
Aug 01 19:59:30 user nova-compute[72504]:       <entry name='family'>Virtual Machine</entry>
Aug 01 19:59:30 user nova-compute[72504]:     </system>
Aug 01 19:59:30 user nova-compute[72504]:   </sysinfo>
Aug 01 19:59:30 user nova-compute[72504]:   <os>
Aug 01 19:59:30 user nova-compute[72504]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 01 19:59:30 user nova-compute[72504]:     <boot dev='hd'/>
Aug 01 19:59:30 user nova-compute[72504]:     <smbios mode='sysinfo'/>
Aug 01 19:59:30 user nova-compute[72504]:   </os>
Aug 01 19:59:30 user nova-compute[72504]:   <features>
Aug 01 19:59:30 user nova-compute[72504]:     <acpi/>
Aug 01 19:59:30 user nova-compute[72504]:     <apic/>
Aug 01 19:59:30 user nova-compute[72504]:     <vmcoreinfo state='on'/>
Aug 01 19:59:30 user nova-compute[72504]:   </features>
Aug 01 19:59:30 user nova-compute[72504]:   <cpu mode='custom' match='exact' check='full'>
Aug 01 19:59:30 user nova-compute[72504]:     <model fallback='forbid'>Nehalem</model>
Aug 01 19:59:30 user nova-compute[72504]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 01 19:59:30 user nova-compute[72504]:     <feature policy='require' name='vme'/>
Aug 01 19:59:30 user nova-compute[72504]:     <feature policy='require' name='x2apic'/>
Aug 01 19:59:30 user nova-compute[72504]:     <feature policy='require' name='hypervisor'/>
Aug 01 19:59:30 user nova-compute[72504]:   </cpu>
Aug 01 19:59:30 user nova-compute[72504]:   <clock offset='utc'>
Aug 01 19:59:30 user nova-compute[72504]:     <timer name='pit' tickpolicy='delay'/>
Aug 01 19:59:30 user nova-compute[72504]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 01 19:59:30 user nova-compute[72504]:     <timer name='hpet' present='no'/>
Aug 01 19:59:30 user nova-compute[72504]:   </clock>
Aug 01 19:59:30 user nova-compute[72504]:   <on_poweroff>destroy</on_poweroff>
Aug 01 19:59:30 user nova-compute[72504]:   <on_reboot>restart</on_reboot>
Aug 01 19:59:30 user nova-compute[72504]:   <on_crash>destroy</on_crash>
Aug 01 19:59:30 user nova-compute[72504]:   <devices>
Aug 01 19:59:30 user nova-compute[72504]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 19:59:30 user nova-compute[72504]:     <disk type='file' device='disk'>
Aug 01 19:59:30 user nova-compute[72504]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 01 19:59:30 user nova-compute[72504]:       <source file='/opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk' index='2'/>
Aug 01 19:59:30 user nova-compute[72504]:       <backingStore type='file' index='3'>
Aug 01 19:59:30 user nova-compute[72504]:         <format type='raw'/>
Aug 01 19:59:30 user nova-compute[72504]:         <source file='/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5'/>
Aug 01 19:59:30 user nova-compute[72504]:         <backingStore/>
Aug 01 19:59:30 user nova-compute[72504]:       </backingStore>
Aug 01 19:59:30 user nova-compute[72504]:       <target dev='vda' bus='virtio'/>
Aug 01 19:59:30 user nova-compute[72504]:       <alias name='virtio-disk0'/>
Aug 01 19:59:30 user nova-compute[72504]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 01 19:59:30 user nova-compute[72504]:     </disk>
Aug 01 19:59:30 user nova-compute[72504]:     <disk type='file' device='cdrom'>
Aug 01 19:59:30 user nova-compute[72504]:       <driver name='qemu' type='raw' cache='none'/>
Aug 01 19:59:30 user nova-compute[72504]:       <source file='/opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk.config' index='1'/>
Aug 01 19:59:30 user nova-compute[72504]:       <backingStore/>
Aug 01 19:59:30 user nova-compute[72504]:       <target dev='hda' bus='ide'/>
Aug 01 19:59:30 user nova-compute[72504]:       <readonly/>
Aug 01 19:59:30 user nova-compute[72504]:       <alias name='ide0-0-0'/>
Aug 01 19:59:30 user nova-compute[72504]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 01 19:59:30 user nova-compute[72504]:     </disk>
Aug 01 19:59:30 user nova-compute[72504]:     <controller type='usb' index='0' model='none'>
Aug 01 19:59:30 user nova-compute[72504]:       <alias name='usb'/>
Aug 01 19:59:30 user nova-compute[72504]:     </controller>
Aug 01 19:59:30 user nova-compute[72504]:     <controller type='pci' index='0' model='pci-root'>
Aug 01 19:59:30 user nova-compute[72504]:       <alias name='pci.0'/>
Aug 01 19:59:30 user nova-compute[72504]:     </controller>
Aug 01 19:59:30 user nova-compute[72504]:     <controller type='ide' index='0'>
Aug 01 19:59:30 user nova-compute[72504]:       <alias name='ide'/>
Aug 01 19:59:30 user nova-compute[72504]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 01 19:59:30 user nova-compute[72504]:     </controller>
Aug 01 19:59:30 user nova-compute[72504]:     <interface type='ethernet'>
Aug 01 19:59:30 user nova-compute[72504]:       <mac address='fa:16:3e:bf:32:31'/>
Aug 01 19:59:30 user nova-compute[72504]:       <target dev='tapd46af6d6-43'/>
Aug 01 19:59:30 user nova-compute[72504]:       <model type='virtio'/>
Aug 01 19:59:30 user nova-compute[72504]:       <mtu size='1442'/>
Aug 01 19:59:30 user nova-compute[72504]:       <alias name='net0'/>
Aug 01 19:59:30 user nova-compute[72504]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 01 19:59:30 user nova-compute[72504]:     </interface>
Aug 01 19:59:30 user nova-compute[72504]:     <serial type='pty'>
Aug 01 19:59:30 user nova-compute[72504]:       <source path='/dev/pts/4'/>
Aug 01 19:59:30 user nova-compute[72504]:       <log file='/opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/console.log' append='off'/>
Aug 01 19:59:30 user nova-compute[72504]:       <target type='isa-serial' port='0'>
Aug 01 19:59:30 user nova-compute[72504]:         <model name='isa-serial'/>
Aug 01 19:59:30 user nova-compute[72504]:       </target>
Aug 01 19:59:30 user nova-compute[72504]:       <alias name='serial0'/>
Aug 01 19:59:30 user nova-compute[72504]:     </serial>
Aug 01 19:59:30 user nova-compute[72504]:     <console type='pty' tty='/dev/pts/4'>
Aug 01 19:59:30 user nova-compute[72504]:       <source path='/dev/pts/4'/>
Aug 01 19:59:30 user nova-compute[72504]:       <log file='/opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/console.log' append='off'/>
Aug 01 19:59:30 user nova-compute[72504]:       <target type='serial' port='0'/>
Aug 01 19:59:30 user nova-compute[72504]:       <alias name='serial0'/>
Aug 01 19:59:30 user nova-compute[72504]:     </console>
Aug 01 19:59:30 user nova-compute[72504]:     <input type='mouse' bus='ps2'>
Aug 01 19:59:30 user nova-compute[72504]:       <alias name='input0'/>
Aug 01 19:59:30 user nova-compute[72504]:     </input>
Aug 01 19:59:30 user nova-compute[72504]:     <input type='keyboard' bus='ps2'>
Aug 01 19:59:30 user nova-compute[72504]:       <alias name='input1'/>
Aug 01 19:59:30 user nova-compute[72504]:     </input>
Aug 01 19:59:30 user nova-compute[72504]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Aug 01 19:59:30 user nova-compute[72504]:       <listen type='address' address='0.0.0.0'/>
Aug 01 19:59:30 user nova-compute[72504]:     </graphics>
Aug 01 19:59:30 user nova-compute[72504]:     <audio id='1' type='none'/>
Aug 01 19:59:30 user nova-compute[72504]:     <video>
Aug 01 19:59:30 user nova-compute[72504]:       <model type='virtio' heads='1' primary='yes'/>
Aug 01 19:59:30 user nova-compute[72504]:       <alias name='video0'/>
Aug 01 19:59:30 user nova-compute[72504]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 01 19:59:30 user nova-compute[72504]:     </video>
Aug 01 19:59:30 user nova-compute[72504]:     <memballoon model='virtio'>
Aug 01 19:59:30 user nova-compute[72504]:       <stats period='10'/>
Aug 01 19:59:30 user nova-compute[72504]:       <alias name='balloon0'/>
Aug 01 19:59:30 user nova-compute[72504]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 01 19:59:30 user nova-compute[72504]:     </memballoon>
Aug 01 19:59:30 user nova-compute[72504]:     <rng model='virtio'>
Aug 01 19:59:30 user nova-compute[72504]:       <backend model='random'>/dev/urandom</backend>
Aug 01 19:59:30 user nova-compute[72504]:       <alias name='rng0'/>
Aug 01 19:59:30 user nova-compute[72504]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 01 19:59:30 user nova-compute[72504]:     </rng>
Aug 01 19:59:30 user nova-compute[72504]:   </devices>
Aug 01 19:59:30 user nova-compute[72504]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 01 19:59:30 user nova-compute[72504]:     <label>libvirt-de2b2e01-4be0-4709-aacd-f6a7cc2897e0</label>
Aug 01 19:59:30 user nova-compute[72504]:     <imagelabel>libvirt-de2b2e01-4be0-4709-aacd-f6a7cc2897e0</imagelabel>
Aug 01 19:59:30 user nova-compute[72504]:   </seclabel>
Aug 01 19:59:30 user nova-compute[72504]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 01 19:59:30 user nova-compute[72504]:     <label>+64055:+108</label>
Aug 01 19:59:30 user nova-compute[72504]:     <imagelabel>+64055:+108</imagelabel>
Aug 01 19:59:30 user nova-compute[72504]:   </seclabel>
Aug 01 19:59:30 user nova-compute[72504]: </domain>
Aug 01 19:59:30 user nova-compute[72504]:  {{(pid=72504) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 01 19:59:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [req-56daacf2-19c6-42cd-8a31-f25a00fe6919 req-d5b820b4-c017-4a82-b40f-905a31bce7a0 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c8:03:52"/><model type="virtio"/><mtu size="1442"/><target dev="tapae1bc755-e6"/></interface> {{(pid=72504) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 19:59:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [req-56daacf2-19c6-42cd-8a31-f25a00fe6919 req-d5b820b4-c017-4a82-b40f-905a31bce7a0 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c8:03:52"/><model type="virtio"/><mtu size="1442"/><target dev="tapae1bc755-e6"/></interface>not found in domain: <domain type='kvm' id='29'>
Aug 01 19:59:30 user nova-compute[72504]:   <name>instance-00000017</name>
Aug 01 19:59:30 user nova-compute[72504]:   <uuid>de2b2e01-4be0-4709-aacd-f6a7cc2897e0</uuid>
Aug 01 19:59:30 user nova-compute[72504]:   <metadata>
Aug 01 19:59:30 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:59:30 user nova-compute[72504]:   <nova:package version="0.0.0"/>
Aug 01 19:59:30 user nova-compute[72504]:   <nova:name>tempest-device-tagging-server-2820075</nova:name>
Aug 01 19:59:30 user nova-compute[72504]:   <nova:creationTime>2023-08-01 19:59:29</nova:creationTime>
Aug 01 19:59:30 user nova-compute[72504]:   <nova:flavor name="m1.tiny">
Aug 01 19:59:30 user nova-compute[72504]:     <nova:memory>512</nova:memory>
Aug 01 19:59:30 user nova-compute[72504]:     <nova:disk>1</nova:disk>
Aug 01 19:59:30 user nova-compute[72504]:     <nova:swap>0</nova:swap>
Aug 01 19:59:30 user nova-compute[72504]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:59:30 user nova-compute[72504]:     <nova:vcpus>1</nova:vcpus>
Aug 01 19:59:30 user nova-compute[72504]:   </nova:flavor>
Aug 01 19:59:30 user nova-compute[72504]:   <nova:owner>
Aug 01 19:59:30 user nova-compute[72504]:     <nova:user uuid="c54daf483b7e4ab7b177fe06a02c207e">tempest-TaggedAttachmentsTest-740827412-project-member</nova:user>
Aug 01 19:59:30 user nova-compute[72504]:     <nova:project uuid="961ea5d0c92447a9853b93335137b5bc">tempest-TaggedAttachmentsTest-740827412</nova:project>
Aug 01 19:59:30 user nova-compute[72504]:   </nova:owner>
Aug 01 19:59:30 user nova-compute[72504]:   <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:59:30 user nova-compute[72504]:   <nova:ports>
Aug 01 19:59:30 user nova-compute[72504]:     <nova:port uuid="d46af6d6-430b-4d54-a553-937e9bf21d16">
Aug 01 19:59:30 user nova-compute[72504]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 19:59:30 user nova-compute[72504]:     </nova:port>
Aug 01 19:59:30 user nova-compute[72504]:   </nova:ports>
Aug 01 19:59:30 user nova-compute[72504]: </nova:instance>
Aug 01 19:59:30 user nova-compute[72504]:   </metadata>
Aug 01 19:59:30 user nova-compute[72504]:   <memory unit='KiB'>524288</memory>
Aug 01 19:59:30 user nova-compute[72504]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 01 19:59:30 user nova-compute[72504]:   <vcpu placement='static'>1</vcpu>
Aug 01 19:59:30 user nova-compute[72504]:   <resource>
Aug 01 19:59:30 user nova-compute[72504]:     <partition>/machine</partition>
Aug 01 19:59:30 user nova-compute[72504]:   </resource>
Aug 01 19:59:30 user nova-compute[72504]:   <sysinfo type='smbios'>
Aug 01 19:59:30 user nova-compute[72504]:     <system>
Aug 01 19:59:30 user nova-compute[72504]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 01 19:59:30 user nova-compute[72504]:       <entry name='product'>OpenStack Nova</entry>
Aug 01 19:59:30 user nova-compute[72504]:       <entry name='version'>0.0.0</entry>
Aug 01 19:59:30 user nova-compute[72504]:       <entry name='serial'>de2b2e01-4be0-4709-aacd-f6a7cc2897e0</entry>
Aug 01 19:59:30 user nova-compute[72504]:       <entry name='uuid'>de2b2e01-4be0-4709-aacd-f6a7cc2897e0</entry>
Aug 01 19:59:30 user nova-compute[72504]:       <entry name='family'>Virtual Machine</entry>
Aug 01 19:59:30 user nova-compute[72504]:     </system>
Aug 01 19:59:30 user nova-compute[72504]:   </sysinfo>
Aug 01 19:59:30 user nova-compute[72504]:   <os>
Aug 01 19:59:30 user nova-compute[72504]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 01 19:59:30 user nova-compute[72504]:     <boot dev='hd'/>
Aug 01 19:59:30 user nova-compute[72504]:     <smbios mode='sysinfo'/>
Aug 01 19:59:30 user nova-compute[72504]:   </os>
Aug 01 19:59:30 user nova-compute[72504]:   <features>
Aug 01 19:59:30 user nova-compute[72504]:     <acpi/>
Aug 01 19:59:30 user nova-compute[72504]:     <apic/>
Aug 01 19:59:30 user nova-compute[72504]:     <vmcoreinfo state='on'/>
Aug 01 19:59:30 user nova-compute[72504]:   </features>
Aug 01 19:59:30 user nova-compute[72504]:   <cpu mode='custom' match='exact' check='full'>
Aug 01 19:59:30 user nova-compute[72504]:     <model fallback='forbid'>Nehalem</model>
Aug 01 19:59:30 user nova-compute[72504]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 01 19:59:30 user nova-compute[72504]:     <feature policy='require' name='vme'/>
Aug 01 19:59:30 user nova-compute[72504]:     <feature policy='require' name='x2apic'/>
Aug 01 19:59:30 user nova-compute[72504]:     <feature policy='require' name='hypervisor'/>
Aug 01 19:59:30 user nova-compute[72504]:   </cpu>
Aug 01 19:59:30 user nova-compute[72504]:   <clock offset='utc'>
Aug 01 19:59:30 user nova-compute[72504]:     <timer name='pit' tickpolicy='delay'/>
Aug 01 19:59:30 user nova-compute[72504]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 01 19:59:30 user nova-compute[72504]:     <timer name='hpet' present='no'/>
Aug 01 19:59:30 user nova-compute[72504]:   </clock>
Aug 01 19:59:30 user nova-compute[72504]:   <on_poweroff>destroy</on_poweroff>
Aug 01 19:59:30 user nova-compute[72504]:   <on_reboot>restart</on_reboot>
Aug 01 19:59:30 user nova-compute[72504]:   <on_crash>destroy</on_crash>
Aug 01 19:59:30 user nova-compute[72504]:   <devices>
Aug 01 19:59:30 user nova-compute[72504]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 19:59:30 user nova-compute[72504]:     <disk type='file' device='disk'>
Aug 01 19:59:30 user nova-compute[72504]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 01 19:59:30 user nova-compute[72504]:       <source file='/opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk' index='2'/>
Aug 01 19:59:30 user nova-compute[72504]:       <backingStore type='file' index='3'>
Aug 01 19:59:30 user nova-compute[72504]:         <format type='raw'/>
Aug 01 19:59:30 user nova-compute[72504]:         <source file='/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5'/>
Aug 01 19:59:30 user nova-compute[72504]:         <backingStore/>
Aug 01 19:59:30 user nova-compute[72504]:       </backingStore>
Aug 01 19:59:30 user nova-compute[72504]:       <target dev='vda' bus='virtio'/>
Aug 01 19:59:30 user nova-compute[72504]:       <alias name='virtio-disk0'/>
Aug 01 19:59:30 user nova-compute[72504]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 01 19:59:30 user nova-compute[72504]:     </disk>
Aug 01 19:59:30 user nova-compute[72504]:     <disk type='file' device='cdrom'>
Aug 01 19:59:30 user nova-compute[72504]:       <driver name='qemu' type='raw' cache='none'/>
Aug 01 19:59:30 user nova-compute[72504]:       <source file='/opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/disk.config' index='1'/>
Aug 01 19:59:30 user nova-compute[72504]:       <backingStore/>
Aug 01 19:59:30 user nova-compute[72504]:       <target dev='hda' bus='ide'/>
Aug 01 19:59:30 user nova-compute[72504]:       <readonly/>
Aug 01 19:59:30 user nova-compute[72504]:       <alias name='ide0-0-0'/>
Aug 01 19:59:30 user nova-compute[72504]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 01 19:59:30 user nova-compute[72504]:     </disk>
Aug 01 19:59:30 user nova-compute[72504]:     <controller type='usb' index='0' model='none'>
Aug 01 19:59:30 user nova-compute[72504]:       <alias name='usb'/>
Aug 01 19:59:30 user nova-compute[72504]:     </controller>
Aug 01 19:59:30 user nova-compute[72504]:     <controller type='pci' index='0' model='pci-root'>
Aug 01 19:59:30 user nova-compute[72504]:       <alias name='pci.0'/>
Aug 01 19:59:30 user nova-compute[72504]:     </controller>
Aug 01 19:59:30 user nova-compute[72504]:     <controller type='ide' index='0'>
Aug 01 19:59:30 user nova-compute[72504]:       <alias name='ide'/>
Aug 01 19:59:30 user nova-compute[72504]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 01 19:59:30 user nova-compute[72504]:     </controller>
Aug 01 19:59:30 user nova-compute[72504]:     <interface type='ethernet'>
Aug 01 19:59:30 user nova-compute[72504]:       <mac address='fa:16:3e:bf:32:31'/>
Aug 01 19:59:30 user nova-compute[72504]:       <target dev='tapd46af6d6-43'/>
Aug 01 19:59:30 user nova-compute[72504]:       <model type='virtio'/>
Aug 01 19:59:30 user nova-compute[72504]:       <mtu size='1442'/>
Aug 01 19:59:30 user nova-compute[72504]:       <alias name='net0'/>
Aug 01 19:59:30 user nova-compute[72504]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 01 19:59:30 user nova-compute[72504]:     </interface>
Aug 01 19:59:30 user nova-compute[72504]:     <serial type='pty'>
Aug 01 19:59:30 user nova-compute[72504]:       <source path='/dev/pts/4'/>
Aug 01 19:59:30 user nova-compute[72504]:       <log file='/opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/console.log' append='off'/>
Aug 01 19:59:30 user nova-compute[72504]:       <target type='isa-serial' port='0'>
Aug 01 19:59:30 user nova-compute[72504]:         <model name='isa-serial'/>
Aug 01 19:59:30 user nova-compute[72504]:       </target>
Aug 01 19:59:30 user nova-compute[72504]:       <alias name='serial0'/>
Aug 01 19:59:30 user nova-compute[72504]:     </serial>
Aug 01 19:59:30 user nova-compute[72504]:     <console type='pty' tty='/dev/pts/4'>
Aug 01 19:59:30 user nova-compute[72504]:       <source path='/dev/pts/4'/>
Aug 01 19:59:30 user nova-compute[72504]:       <log file='/opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0/console.log' append='off'/>
Aug 01 19:59:30 user nova-compute[72504]:       <target type='serial' port='0'/>
Aug 01 19:59:30 user nova-compute[72504]:       <alias name='serial0'/>
Aug 01 19:59:30 user nova-compute[72504]:     </console>
Aug 01 19:59:30 user nova-compute[72504]:     <input type='mouse' bus='ps2'>
Aug 01 19:59:30 user nova-compute[72504]:       <alias name='input0'/>
Aug 01 19:59:30 user nova-compute[72504]:     </input>
Aug 01 19:59:30 user nova-compute[72504]:     <input type='keyboard' bus='ps2'>
Aug 01 19:59:30 user nova-compute[72504]:       <alias name='input1'/>
Aug 01 19:59:30 user nova-compute[72504]:     </input>
Aug 01 19:59:30 user nova-compute[72504]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Aug 01 19:59:30 user nova-compute[72504]:       <listen type='address' address='0.0.0.0'/>
Aug 01 19:59:30 user nova-compute[72504]:     </graphics>
Aug 01 19:59:30 user nova-compute[72504]:     <audio id='1' type='none'/>
Aug 01 19:59:30 user nova-compute[72504]:     <video>
Aug 01 19:59:30 user nova-compute[72504]:       <model type='virtio' heads='1' primary='yes'/>
Aug 01 19:59:30 user nova-compute[72504]:       <alias name='video0'/>
Aug 01 19:59:30 user nova-compute[72504]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 01 19:59:30 user nova-compute[72504]:     </video>
Aug 01 19:59:30 user nova-compute[72504]:     <memballoon model='virtio'>
Aug 01 19:59:30 user nova-compute[72504]:       <stats period='10'/>
Aug 01 19:59:30 user nova-compute[72504]:       <alias name='balloon0'/>
Aug 01 19:59:30 user nova-compute[72504]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 01 19:59:30 user nova-compute[72504]:     </memballoon>
Aug 01 19:59:30 user nova-compute[72504]:     <rng model='virtio'>
Aug 01 19:59:30 user nova-compute[72504]:       <backend model='random'>/dev/urandom</backend>
Aug 01 19:59:30 user nova-compute[72504]:       <alias name='rng0'/>
Aug 01 19:59:30 user nova-compute[72504]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 01 19:59:30 user nova-compute[72504]:     </rng>
Aug 01 19:59:30 user nova-compute[72504]:   </devices>
Aug 01 19:59:30 user nova-compute[72504]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 01 19:59:30 user nova-compute[72504]:     <label>libvirt-de2b2e01-4be0-4709-aacd-f6a7cc2897e0</label>
Aug 01 19:59:30 user nova-compute[72504]:     <imagelabel>libvirt-de2b2e01-4be0-4709-aacd-f6a7cc2897e0</imagelabel>
Aug 01 19:59:30 user nova-compute[72504]:   </seclabel>
Aug 01 19:59:30 user nova-compute[72504]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 01 19:59:30 user nova-compute[72504]:     <label>+64055:+108</label>
Aug 01 19:59:30 user nova-compute[72504]:     <imagelabel>+64055:+108</imagelabel>
Aug 01 19:59:30 user nova-compute[72504]:   </seclabel>
Aug 01 19:59:30 user nova-compute[72504]: </domain>
Aug 01 19:59:30 user nova-compute[72504]:  {{(pid=72504) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 01 19:59:30 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [req-56daacf2-19c6-42cd-8a31-f25a00fe6919 req-d5b820b4-c017-4a82-b40f-905a31bce7a0 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Detaching interface fa:16:3e:c8:03:52 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapae1bc755-e6' not found.
Aug 01 19:59:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [req-56daacf2-19c6-42cd-8a31-f25a00fe6919 req-d5b820b4-c017-4a82-b40f-905a31bce7a0 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2820075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2820075',id=23,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFR6MNT81m0077QoKPCZmUoTwZo1tmyWFZilUMLyic+9WyjHpZo/ciaWRQRs7DELWXer49Euo3w0BX2N62edjBrzmKu9DWAic/6QsdF1qlTj504N9KRmTcmwPyzz0oz/gg==',key_name='tempest-keypair-857323455',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:57:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='961ea5d0c92447a9853b93335137b5bc',ramdisk_id='',reservation_id='r-pstr5dkl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-740827412',owner_user_name='tempest-TaggedAttachmentsTest-740827412-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:57:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54daf483b7e4ab7b177fe06a02c207e',uuid=de2b2e01-4be0-4709-aacd-f6a7cc2897e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f", "address": "fa:16:3e:c8:03:52", "network": {"id": "9fb4689b-a486-442a-a948-9fa0f27db6f9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1824983070", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1bc755-e6", "ovs_interfaceid": "ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 19:59:30 user nova-compute[72504]: DEBUG nova.network.os_vif_util [req-56daacf2-19c6-42cd-8a31-f25a00fe6919 req-d5b820b4-c017-4a82-b40f-905a31bce7a0 service nova] Converting VIF {"id": "ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f", "address": "fa:16:3e:c8:03:52", "network": {"id": "9fb4689b-a486-442a-a948-9fa0f27db6f9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1824983070", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae1bc755-e6", "ovs_interfaceid": "ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:59:30 user nova-compute[72504]: DEBUG nova.network.os_vif_util [req-56daacf2-19c6-42cd-8a31-f25a00fe6919 req-d5b820b4-c017-4a82-b40f-905a31bce7a0 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:03:52,bridge_name='br-int',has_traffic_filtering=True,id=ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f,network=Network(9fb4689b-a486-442a-a948-9fa0f27db6f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae1bc755-e6') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:59:30 user nova-compute[72504]: DEBUG os_vif [req-56daacf2-19c6-42cd-8a31-f25a00fe6919 req-d5b820b4-c017-4a82-b40f-905a31bce7a0 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:03:52,bridge_name='br-int',has_traffic_filtering=True,id=ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f,network=Network(9fb4689b-a486-442a-a948-9fa0f27db6f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae1bc755-e6') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 19:59:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae1bc755-e6, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:59:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:59:30 user nova-compute[72504]: INFO os_vif [req-56daacf2-19c6-42cd-8a31-f25a00fe6919 req-d5b820b4-c017-4a82-b40f-905a31bce7a0 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:03:52,bridge_name='br-int',has_traffic_filtering=True,id=ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f,network=Network(9fb4689b-a486-442a-a948-9fa0f27db6f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae1bc755-e6')
Aug 01 19:59:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [req-56daacf2-19c6-42cd-8a31-f25a00fe6919 req-d5b820b4-c017-4a82-b40f-905a31bce7a0 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:59:30 user nova-compute[72504]:   <nova:package version="0.0.0"/>
Aug 01 19:59:30 user nova-compute[72504]:   <nova:name>tempest-device-tagging-server-2820075</nova:name>
Aug 01 19:59:30 user nova-compute[72504]:   <nova:creationTime>2023-08-01 19:59:30</nova:creationTime>
Aug 01 19:59:30 user nova-compute[72504]:   <nova:flavor name="m1.tiny">
Aug 01 19:59:30 user nova-compute[72504]:     <nova:memory>512</nova:memory>
Aug 01 19:59:30 user nova-compute[72504]:     <nova:disk>1</nova:disk>
Aug 01 19:59:30 user nova-compute[72504]:     <nova:swap>0</nova:swap>
Aug 01 19:59:30 user nova-compute[72504]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:59:30 user nova-compute[72504]:     <nova:vcpus>1</nova:vcpus>
Aug 01 19:59:30 user nova-compute[72504]:   </nova:flavor>
Aug 01 19:59:30 user nova-compute[72504]:   <nova:owner>
Aug 01 19:59:30 user nova-compute[72504]:     <nova:user uuid="c54daf483b7e4ab7b177fe06a02c207e">tempest-TaggedAttachmentsTest-740827412-project-member</nova:user>
Aug 01 19:59:30 user nova-compute[72504]:     <nova:project uuid="961ea5d0c92447a9853b93335137b5bc">tempest-TaggedAttachmentsTest-740827412</nova:project>
Aug 01 19:59:30 user nova-compute[72504]:   </nova:owner>
Aug 01 19:59:30 user nova-compute[72504]:   <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:59:30 user nova-compute[72504]:   <nova:ports>
Aug 01 19:59:30 user nova-compute[72504]:     <nova:port uuid="d46af6d6-430b-4d54-a553-937e9bf21d16">
Aug 01 19:59:30 user nova-compute[72504]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 19:59:30 user nova-compute[72504]:     </nova:port>
Aug 01 19:59:30 user nova-compute[72504]:   </nova:ports>
Aug 01 19:59:30 user nova-compute[72504]: </nova:instance>
Aug 01 19:59:30 user nova-compute[72504]:  {{(pid=72504) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 01 19:59:30 user nova-compute[72504]: DEBUG nova.network.neutron [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Updating instance_info_cache with network_info: [{"id": "d46af6d6-430b-4d54-a553-937e9bf21d16", "address": "fa:16:3e:bf:32:31", "network": {"id": "8fe56054-7531-450f-9ddd-4c519a2e4577", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-45399222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd46af6d6-43", "ovs_interfaceid": "d46af6d6-430b-4d54-a553-937e9bf21d16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:59:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Releasing lock "refresh_cache-de2b2e01-4be0-4709-aacd-f6a7cc2897e0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:59:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8a4d8cb9-7707-41e9-982d-c5dc031d0c8b tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "interface-de2b2e01-4be0-4709-aacd-f6a7cc2897e0-ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.465s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:31 user nova-compute[72504]: DEBUG nova.compute.manager [req-c5854142-19eb-468d-8803-6e3f4c191176 req-e9a2bc93-c7a5-49be-868d-fbb0f042cd6f service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Received event network-vif-plugged-3a4ace30-3ca6-4cc9-8125-599cc4097662 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:59:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c5854142-19eb-468d-8803-6e3f4c191176 req-e9a2bc93-c7a5-49be-868d-fbb0f042cd6f service nova] Acquiring lock "88f95d20-e391-4100-93b2-da29bfcf9704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c5854142-19eb-468d-8803-6e3f4c191176 req-e9a2bc93-c7a5-49be-868d-fbb0f042cd6f service nova] Lock "88f95d20-e391-4100-93b2-da29bfcf9704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c5854142-19eb-468d-8803-6e3f4c191176 req-e9a2bc93-c7a5-49be-868d-fbb0f042cd6f service nova] Lock "88f95d20-e391-4100-93b2-da29bfcf9704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:31 user nova-compute[72504]: DEBUG nova.compute.manager [req-c5854142-19eb-468d-8803-6e3f4c191176 req-e9a2bc93-c7a5-49be-868d-fbb0f042cd6f service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] No waiting events found dispatching network-vif-plugged-3a4ace30-3ca6-4cc9-8125-599cc4097662 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:59:31 user nova-compute[72504]: WARNING nova.compute.manager [req-c5854142-19eb-468d-8803-6e3f4c191176 req-e9a2bc93-c7a5-49be-868d-fbb0f042cd6f service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Received unexpected event network-vif-plugged-3a4ace30-3ca6-4cc9-8125-599cc4097662 for instance with vm_state active and task_state rebuild_spawning.
Aug 01 19:59:32 user nova-compute[72504]: DEBUG nova.compute.manager [req-d8a86488-260d-45fa-9926-f7bd972c98d7 req-9a5a2174-b1a3-4f1d-8f56-effdfafd7067 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Received event network-vif-plugged-ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:59:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d8a86488-260d-45fa-9926-f7bd972c98d7 req-9a5a2174-b1a3-4f1d-8f56-effdfafd7067 service nova] Acquiring lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d8a86488-260d-45fa-9926-f7bd972c98d7 req-9a5a2174-b1a3-4f1d-8f56-effdfafd7067 service nova] Lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d8a86488-260d-45fa-9926-f7bd972c98d7 req-9a5a2174-b1a3-4f1d-8f56-effdfafd7067 service nova] Lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:32 user nova-compute[72504]: DEBUG nova.compute.manager [req-d8a86488-260d-45fa-9926-f7bd972c98d7 req-9a5a2174-b1a3-4f1d-8f56-effdfafd7067 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] No waiting events found dispatching network-vif-plugged-ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:59:32 user nova-compute[72504]: WARNING nova.compute.manager [req-d8a86488-260d-45fa-9926-f7bd972c98d7 req-9a5a2174-b1a3-4f1d-8f56-effdfafd7067 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Received unexpected event network-vif-plugged-ae1bc755-e603-41fa-8f9d-67a0c6ca7e2f for instance with vm_state active and task_state None.
Aug 01 19:59:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:33 user nova-compute[72504]: DEBUG nova.compute.manager [req-52f9e3ce-90ed-44b8-a1c5-5e2b7d70f333 req-5b13a6e3-9da5-499a-8a05-4b56e05b49b3 service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Received event network-vif-plugged-3a4ace30-3ca6-4cc9-8125-599cc4097662 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:59:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-52f9e3ce-90ed-44b8-a1c5-5e2b7d70f333 req-5b13a6e3-9da5-499a-8a05-4b56e05b49b3 service nova] Acquiring lock "88f95d20-e391-4100-93b2-da29bfcf9704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-52f9e3ce-90ed-44b8-a1c5-5e2b7d70f333 req-5b13a6e3-9da5-499a-8a05-4b56e05b49b3 service nova] Lock "88f95d20-e391-4100-93b2-da29bfcf9704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-52f9e3ce-90ed-44b8-a1c5-5e2b7d70f333 req-5b13a6e3-9da5-499a-8a05-4b56e05b49b3 service nova] Lock "88f95d20-e391-4100-93b2-da29bfcf9704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:33 user nova-compute[72504]: DEBUG nova.compute.manager [req-52f9e3ce-90ed-44b8-a1c5-5e2b7d70f333 req-5b13a6e3-9da5-499a-8a05-4b56e05b49b3 service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] No waiting events found dispatching network-vif-plugged-3a4ace30-3ca6-4cc9-8125-599cc4097662 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:59:33 user nova-compute[72504]: WARNING nova.compute.manager [req-52f9e3ce-90ed-44b8-a1c5-5e2b7d70f333 req-5b13a6e3-9da5-499a-8a05-4b56e05b49b3 service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Received unexpected event network-vif-plugged-3a4ace30-3ca6-4cc9-8125-599cc4097662 for instance with vm_state active and task_state rebuild_spawning.
Aug 01 19:59:33 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919973.867704, 88f95d20-e391-4100-93b2-da29bfcf9704 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:59:33 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] VM Resumed (Lifecycle Event)
Aug 01 19:59:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 19:59:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 19:59:33 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Instance spawned successfully.
Aug 01 19:59:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 19:59:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:59:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:59:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:59:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:59:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:59:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:59:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:59:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 19:59:33 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 19:59:33 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690919973.8687084, 88f95d20-e391-4100-93b2-da29bfcf9704 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:59:33 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] VM Started (Lifecycle Event)
Aug 01 19:59:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:59:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 19:59:34 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 19:59:34 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:59:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:34 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72504) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 19:59:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e822969e-b640-4838-953b-ff457fd80744 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.116s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:34 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690919959.5032456, 9078e730-73ae-4581-901c-418ab48b20ff => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 19:59:34 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] VM Stopped (Lifecycle Event)
Aug 01 19:59:34 user nova-compute[72504]: DEBUG nova.compute.manager [None req-0f307eda-6cc0-4a5c-85af-a4a17148b879 None None] [instance: 9078e730-73ae-4581-901c-418ab48b20ff] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:59:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:52 user nova-compute[72504]: DEBUG nova.compute.manager [None req-b4218d8c-ab4b-474c-b8a9-76823a180b6a tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 19:59:52 user nova-compute[72504]: INFO nova.compute.manager [None req-b4218d8c-ab4b-474c-b8a9-76823a180b6a tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] instance snapshotting
Aug 01 19:59:52 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-b4218d8c-ab4b-474c-b8a9-76823a180b6a tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Beginning live snapshot process
Aug 01 19:59:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-b4218d8c-ab4b-474c-b8a9-76823a180b6a tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json -f qcow2 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-b4218d8c-ab4b-474c-b8a9-76823a180b6a tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json -f qcow2" returned: 0 in 0.159s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-b4218d8c-ab4b-474c-b8a9-76823a180b6a tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json -f qcow2 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-b4218d8c-ab4b-474c-b8a9-76823a180b6a tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json -f qcow2" returned: 0 in 0.149s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-b4218d8c-ab4b-474c-b8a9-76823a180b6a tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-b4218d8c-ab4b-474c-b8a9-76823a180b6a tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.143s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-b4218d8c-ab4b-474c-b8a9-76823a180b6a tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbzhnr3nn/964c64ffed544c599beaec6d3354efde.delta 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-b4218d8c-ab4b-474c-b8a9-76823a180b6a tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbzhnr3nn/964c64ffed544c599beaec6d3354efde.delta 1073741824" returned: 0 in 0.055s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:53 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-b4218d8c-ab4b-474c-b8a9-76823a180b6a tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 19:59:54 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-b4218d8c-ab4b-474c-b8a9-76823a180b6a tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72504) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 19:59:54 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-b4218d8c-ab4b-474c-b8a9-76823a180b6a tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72504) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 19:59:54 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-b4218d8c-ab4b-474c-b8a9-76823a180b6a tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 19:59:54 user nova-compute[72504]: DEBUG nova.privsep.utils [None req-b4218d8c-ab4b-474c-b8a9-76823a180b6a tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72504) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 19:59:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-b4218d8c-ab4b-474c-b8a9-76823a180b6a tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbzhnr3nn/964c64ffed544c599beaec6d3354efde.delta /opt/stack/data/nova/instances/snapshots/tmpbzhnr3nn/964c64ffed544c599beaec6d3354efde {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:54 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 19:59:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:54 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 19:59:54 user nova-compute[72504]: INFO nova.compute.claims [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Claim successful on node user
Aug 01 19:59:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-b4218d8c-ab4b-474c-b8a9-76823a180b6a tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbzhnr3nn/964c64ffed544c599beaec6d3354efde.delta /opt/stack/data/nova/instances/snapshots/tmpbzhnr3nn/964c64ffed544c599beaec6d3354efde" returned: 0 in 0.357s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:55 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-b4218d8c-ab4b-474c-b8a9-76823a180b6a tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Snapshot extracted, beginning image upload
Aug 01 19:59:55 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 19:59:55 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 19:59:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:55 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 19:59:55 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 19:59:55 user nova-compute[72504]: DEBUG nova.network.neutron [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 19:59:55 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 19:59:55 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 19:59:55 user nova-compute[72504]: DEBUG nova.policy [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fde834d9da4a4ee99d5238b6d63cc8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e853806cb434f6ba589f1c92227fdc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 19:59:55 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 19:59:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 19:59:55 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Creating image(s)
Aug 01 19:59:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "/opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "/opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "/opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.145s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.145s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk 1073741824" returned: 0 in 0.050s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.152s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:56 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Checking if we can resize image /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 19:59:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 19:59:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 19:59:56 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Cannot resize image /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 19:59:56 user nova-compute[72504]: DEBUG nova.objects.instance [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lazy-loading 'migration_context' on Instance uuid 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:59:56 user nova-compute[72504]: DEBUG nova.network.neutron [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Successfully created port: 8fc6472d-34da-4e77-ba88-4dfdbbb615eb {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 19:59:56 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 19:59:56 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Ensure instance console log exists: /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 19:59:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.network.neutron [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Successfully updated port: 8fc6472d-34da-4e77-ba88-4dfdbbb615eb {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "refresh_cache-87d57e7a-e0d8-4f4d-8ad9-de46259a2161" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquired lock "refresh_cache-87d57e7a-e0d8-4f4d-8ad9-de46259a2161" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.network.neutron [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-4ca946e0-7a51-4353-8c00-f27aca4ddc1c req-c12d9f49-3428-4a7b-9879-47f0aa0a23b5 service nova] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Received event network-changed-8fc6472d-34da-4e77-ba88-4dfdbbb615eb {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-4ca946e0-7a51-4353-8c00-f27aca4ddc1c req-c12d9f49-3428-4a7b-9879-47f0aa0a23b5 service nova] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Refreshing instance network info cache due to event network-changed-8fc6472d-34da-4e77-ba88-4dfdbbb615eb. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4ca946e0-7a51-4353-8c00-f27aca4ddc1c req-c12d9f49-3428-4a7b-9879-47f0aa0a23b5 service nova] Acquiring lock "refresh_cache-87d57e7a-e0d8-4f4d-8ad9-de46259a2161" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.network.neutron [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 19:59:57 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-b4218d8c-ab4b-474c-b8a9-76823a180b6a tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Snapshot image upload complete
Aug 01 19:59:57 user nova-compute[72504]: INFO nova.compute.manager [None req-b4218d8c-ab4b-474c-b8a9-76823a180b6a tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Took 4.90 seconds to snapshot the instance on the hypervisor.
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.network.neutron [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Updating instance_info_cache with network_info: [{"id": "8fc6472d-34da-4e77-ba88-4dfdbbb615eb", "address": "fa:16:3e:45:db:12", "network": {"id": "1f06e326-e832-4d23-8b67-ab7568720b59", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1277548875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e853806cb434f6ba589f1c92227fdc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fc6472d-34", "ovs_interfaceid": "8fc6472d-34da-4e77-ba88-4dfdbbb615eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Releasing lock "refresh_cache-87d57e7a-e0d8-4f4d-8ad9-de46259a2161" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Instance network_info: |[{"id": "8fc6472d-34da-4e77-ba88-4dfdbbb615eb", "address": "fa:16:3e:45:db:12", "network": {"id": "1f06e326-e832-4d23-8b67-ab7568720b59", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1277548875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e853806cb434f6ba589f1c92227fdc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fc6472d-34", "ovs_interfaceid": "8fc6472d-34da-4e77-ba88-4dfdbbb615eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4ca946e0-7a51-4353-8c00-f27aca4ddc1c req-c12d9f49-3428-4a7b-9879-47f0aa0a23b5 service nova] Acquired lock "refresh_cache-87d57e7a-e0d8-4f4d-8ad9-de46259a2161" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.network.neutron [req-4ca946e0-7a51-4353-8c00-f27aca4ddc1c req-c12d9f49-3428-4a7b-9879-47f0aa0a23b5 service nova] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Refreshing network info cache for port 8fc6472d-34da-4e77-ba88-4dfdbbb615eb {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Start _get_guest_xml network_info=[{"id": "8fc6472d-34da-4e77-ba88-4dfdbbb615eb", "address": "fa:16:3e:45:db:12", "network": {"id": "1f06e326-e832-4d23-8b67-ab7568720b59", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1277548875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e853806cb434f6ba589f1c92227fdc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fc6472d-34", "ovs_interfaceid": "8fc6472d-34da-4e77-ba88-4dfdbbb615eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 19:59:57 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:59:57 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:59:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1895266006',display_name='tempest-SnapshotDataIntegrityTests-server-1895266006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1895266006',id=25,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHySzzh9R1gNmrFqQoD/6/gOMe1VTQ/KzeLm9cN9WsHLGFKfHlmNQiqy+ENcRW8PuGf1YYSasO4j6t7iu86thBLAv05OSw3O9UJo2d2mDNbqLHbbQagYw9O1usKCtUbqmA==',key_name='tempest-keypair-65374877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e853806cb434f6ba589f1c92227fdc7',ramdisk_id='',reservation_id='r-cd9vl3pk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1989743910',owner_user_name='tempest-SnapshotDataIntegrityTests-1989743910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:59:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fde834d9da4a4ee99d5238b6d63cc8fc',uuid=87d57e7a-e0d8-4f4d-8ad9-de46259a2161,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fc6472d-34da-4e77-ba88-4dfdbbb615eb", "address": "fa:16:3e:45:db:12", "network": {"id": "1f06e326-e832-4d23-8b67-ab7568720b59", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1277548875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e853806cb434f6ba589f1c92227fdc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fc6472d-34", "ovs_interfaceid": "8fc6472d-34da-4e77-ba88-4dfdbbb615eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Converting VIF {"id": "8fc6472d-34da-4e77-ba88-4dfdbbb615eb", "address": "fa:16:3e:45:db:12", "network": {"id": "1f06e326-e832-4d23-8b67-ab7568720b59", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1277548875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e853806cb434f6ba589f1c92227fdc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fc6472d-34", "ovs_interfaceid": "8fc6472d-34da-4e77-ba88-4dfdbbb615eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:db:12,bridge_name='br-int',has_traffic_filtering=True,id=8fc6472d-34da-4e77-ba88-4dfdbbb615eb,network=Network(1f06e326-e832-4d23-8b67-ab7568720b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fc6472d-34') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.objects.instance [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lazy-loading 'pci_devices' on Instance uuid 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] End _get_guest_xml xml=<domain type="kvm">
Aug 01 19:59:57 user nova-compute[72504]:   <uuid>87d57e7a-e0d8-4f4d-8ad9-de46259a2161</uuid>
Aug 01 19:59:57 user nova-compute[72504]:   <name>instance-00000019</name>
Aug 01 19:59:57 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 19:59:57 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 19:59:57 user nova-compute[72504]:   <metadata>
Aug 01 19:59:57 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 19:59:57 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 19:59:57 user nova-compute[72504]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1895266006</nova:name>
Aug 01 19:59:57 user nova-compute[72504]:       <nova:creationTime>2023-08-01 19:59:57</nova:creationTime>
Aug 01 19:59:57 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 19:59:57 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 19:59:57 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 19:59:57 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 19:59:57 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 19:59:57 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 19:59:57 user nova-compute[72504]:       </nova:flavor>
Aug 01 19:59:57 user nova-compute[72504]:       <nova:owner>
Aug 01 19:59:57 user nova-compute[72504]:         <nova:user uuid="fde834d9da4a4ee99d5238b6d63cc8fc">tempest-SnapshotDataIntegrityTests-1989743910-project-member</nova:user>
Aug 01 19:59:57 user nova-compute[72504]:         <nova:project uuid="4e853806cb434f6ba589f1c92227fdc7">tempest-SnapshotDataIntegrityTests-1989743910</nova:project>
Aug 01 19:59:57 user nova-compute[72504]:       </nova:owner>
Aug 01 19:59:57 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 19:59:57 user nova-compute[72504]:       <nova:ports>
Aug 01 19:59:57 user nova-compute[72504]:         <nova:port uuid="8fc6472d-34da-4e77-ba88-4dfdbbb615eb">
Aug 01 19:59:57 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 19:59:57 user nova-compute[72504]:         </nova:port>
Aug 01 19:59:57 user nova-compute[72504]:       </nova:ports>
Aug 01 19:59:57 user nova-compute[72504]:     </nova:instance>
Aug 01 19:59:57 user nova-compute[72504]:   </metadata>
Aug 01 19:59:57 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 19:59:57 user nova-compute[72504]:     <system>
Aug 01 19:59:57 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 19:59:57 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 19:59:57 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 19:59:57 user nova-compute[72504]:       <entry name="serial">87d57e7a-e0d8-4f4d-8ad9-de46259a2161</entry>
Aug 01 19:59:57 user nova-compute[72504]:       <entry name="uuid">87d57e7a-e0d8-4f4d-8ad9-de46259a2161</entry>
Aug 01 19:59:57 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 19:59:57 user nova-compute[72504]:     </system>
Aug 01 19:59:57 user nova-compute[72504]:   </sysinfo>
Aug 01 19:59:57 user nova-compute[72504]:   <os>
Aug 01 19:59:57 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 19:59:57 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 19:59:57 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 19:59:57 user nova-compute[72504]:   </os>
Aug 01 19:59:57 user nova-compute[72504]:   <features>
Aug 01 19:59:57 user nova-compute[72504]:     <acpi/>
Aug 01 19:59:57 user nova-compute[72504]:     <apic/>
Aug 01 19:59:57 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 19:59:57 user nova-compute[72504]:   </features>
Aug 01 19:59:57 user nova-compute[72504]:   <clock offset="utc">
Aug 01 19:59:57 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 19:59:57 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 19:59:57 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 19:59:57 user nova-compute[72504]:   </clock>
Aug 01 19:59:57 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 19:59:57 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 19:59:57 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 19:59:57 user nova-compute[72504]:   </cpu>
Aug 01 19:59:57 user nova-compute[72504]:   <devices>
Aug 01 19:59:57 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 19:59:57 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 19:59:57 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk"/>
Aug 01 19:59:57 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 19:59:57 user nova-compute[72504]:     </disk>
Aug 01 19:59:57 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 19:59:57 user nova-compute[72504]:       <mac address="fa:16:3e:45:db:12"/>
Aug 01 19:59:57 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:59:57 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 19:59:57 user nova-compute[72504]:       <target dev="tap8fc6472d-34"/>
Aug 01 19:59:57 user nova-compute[72504]:     </interface>
Aug 01 19:59:57 user nova-compute[72504]:     <serial type="pty">
Aug 01 19:59:57 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/console.log" append="off"/>
Aug 01 19:59:57 user nova-compute[72504]:     </serial>
Aug 01 19:59:57 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 19:59:57 user nova-compute[72504]:     <video>
Aug 01 19:59:57 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 19:59:57 user nova-compute[72504]:     </video>
Aug 01 19:59:57 user nova-compute[72504]:     <rng model="virtio">
Aug 01 19:59:57 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 19:59:57 user nova-compute[72504]:     </rng>
Aug 01 19:59:57 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 19:59:57 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 19:59:57 user nova-compute[72504]:       <stats period="10"/>
Aug 01 19:59:57 user nova-compute[72504]:     </memballoon>
Aug 01 19:59:57 user nova-compute[72504]:   </devices>
Aug 01 19:59:57 user nova-compute[72504]: </domain>
Aug 01 19:59:57 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:59:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1895266006',display_name='tempest-SnapshotDataIntegrityTests-server-1895266006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1895266006',id=25,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHySzzh9R1gNmrFqQoD/6/gOMe1VTQ/KzeLm9cN9WsHLGFKfHlmNQiqy+ENcRW8PuGf1YYSasO4j6t7iu86thBLAv05OSw3O9UJo2d2mDNbqLHbbQagYw9O1usKCtUbqmA==',key_name='tempest-keypair-65374877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e853806cb434f6ba589f1c92227fdc7',ramdisk_id='',reservation_id='r-cd9vl3pk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1989743910',owner_user_name='tempest-SnapshotDataIntegrityTests-1989743910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T19:59:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fde834d9da4a4ee99d5238b6d63cc8fc',uuid=87d57e7a-e0d8-4f4d-8ad9-de46259a2161,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fc6472d-34da-4e77-ba88-4dfdbbb615eb", "address": "fa:16:3e:45:db:12", "network": {"id": "1f06e326-e832-4d23-8b67-ab7568720b59", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1277548875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e853806cb434f6ba589f1c92227fdc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fc6472d-34", "ovs_interfaceid": "8fc6472d-34da-4e77-ba88-4dfdbbb615eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Converting VIF {"id": "8fc6472d-34da-4e77-ba88-4dfdbbb615eb", "address": "fa:16:3e:45:db:12", "network": {"id": "1f06e326-e832-4d23-8b67-ab7568720b59", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1277548875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e853806cb434f6ba589f1c92227fdc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fc6472d-34", "ovs_interfaceid": "8fc6472d-34da-4e77-ba88-4dfdbbb615eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:db:12,bridge_name='br-int',has_traffic_filtering=True,id=8fc6472d-34da-4e77-ba88-4dfdbbb615eb,network=Network(1f06e326-e832-4d23-8b67-ab7568720b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fc6472d-34') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG os_vif [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:db:12,bridge_name='br-int',has_traffic_filtering=True,id=8fc6472d-34da-4e77-ba88-4dfdbbb615eb,network=Network(1f06e326-e832-4d23-8b67-ab7568720b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fc6472d-34') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fc6472d-34, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8fc6472d-34, col_values=(('external_ids', {'iface-id': '8fc6472d-34da-4e77-ba88-4dfdbbb615eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:db:12', 'vm-uuid': '87d57e7a-e0d8-4f4d-8ad9-de46259a2161'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:57 user nova-compute[72504]: INFO os_vif [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:db:12,bridge_name='br-int',has_traffic_filtering=True,id=8fc6472d-34da-4e77-ba88-4dfdbbb615eb,network=Network(1f06e326-e832-4d23-8b67-ab7568720b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fc6472d-34')
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] No VIF found with MAC fa:16:3e:45:db:12, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 19:59:57 user nova-compute[72504]: INFO nova.compute.manager [None req-741ff595-96d6-40c4-855f-24be576fdfd6 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Unrescuing
Aug 01 19:59:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-741ff595-96d6-40c4-855f-24be576fdfd6 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "refresh_cache-1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-741ff595-96d6-40c4-855f-24be576fdfd6 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquired lock "refresh_cache-1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG nova.network.neutron [None req-741ff595-96d6-40c4-855f-24be576fdfd6 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 19:59:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:58 user nova-compute[72504]: DEBUG nova.network.neutron [req-4ca946e0-7a51-4353-8c00-f27aca4ddc1c req-c12d9f49-3428-4a7b-9879-47f0aa0a23b5 service nova] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Updated VIF entry in instance network info cache for port 8fc6472d-34da-4e77-ba88-4dfdbbb615eb. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 19:59:58 user nova-compute[72504]: DEBUG nova.network.neutron [req-4ca946e0-7a51-4353-8c00-f27aca4ddc1c req-c12d9f49-3428-4a7b-9879-47f0aa0a23b5 service nova] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Updating instance_info_cache with network_info: [{"id": "8fc6472d-34da-4e77-ba88-4dfdbbb615eb", "address": "fa:16:3e:45:db:12", "network": {"id": "1f06e326-e832-4d23-8b67-ab7568720b59", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1277548875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e853806cb434f6ba589f1c92227fdc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fc6472d-34", "ovs_interfaceid": "8fc6472d-34da-4e77-ba88-4dfdbbb615eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:59:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4ca946e0-7a51-4353-8c00-f27aca4ddc1c req-c12d9f49-3428-4a7b-9879-47f0aa0a23b5 service nova] Releasing lock "refresh_cache-87d57e7a-e0d8-4f4d-8ad9-de46259a2161" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:59:58 user nova-compute[72504]: DEBUG nova.network.neutron [None req-741ff595-96d6-40c4-855f-24be576fdfd6 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Updating instance_info_cache with network_info: [{"id": "f0cefd5c-7285-4f5e-b771-61f61039f900", "address": "fa:16:3e:9a:5b:08", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cefd5c-72", "ovs_interfaceid": "f0cefd5c-7285-4f5e-b771-61f61039f900", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 19:59:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-741ff595-96d6-40c4-855f-24be576fdfd6 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Releasing lock "refresh_cache-1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 19:59:58 user nova-compute[72504]: DEBUG nova.objects.instance [None req-741ff595-96d6-40c4-855f-24be576fdfd6 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'flavor' on Instance uuid 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 19:59:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:59 user nova-compute[72504]: DEBUG nova.compute.manager [req-f574ff38-64cf-4e2f-9fdc-98f0bb3bf42f req-4e3c0daa-0d44-4ddb-bff4-26f7775f517d service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received event network-vif-unplugged-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:59:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f574ff38-64cf-4e2f-9fdc-98f0bb3bf42f req-4e3c0daa-0d44-4ddb-bff4-26f7775f517d service nova] Acquiring lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f574ff38-64cf-4e2f-9fdc-98f0bb3bf42f req-4e3c0daa-0d44-4ddb-bff4-26f7775f517d service nova] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f574ff38-64cf-4e2f-9fdc-98f0bb3bf42f req-4e3c0daa-0d44-4ddb-bff4-26f7775f517d service nova] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:59 user nova-compute[72504]: DEBUG nova.compute.manager [req-f574ff38-64cf-4e2f-9fdc-98f0bb3bf42f req-4e3c0daa-0d44-4ddb-bff4-26f7775f517d service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] No waiting events found dispatching network-vif-unplugged-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:59:59 user nova-compute[72504]: WARNING nova.compute.manager [req-f574ff38-64cf-4e2f-9fdc-98f0bb3bf42f req-4e3c0daa-0d44-4ddb-bff4-26f7775f517d service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received unexpected event network-vif-unplugged-f0cefd5c-7285-4f5e-b771-61f61039f900 for instance with vm_state rescued and task_state unrescuing.
Aug 01 19:59:59 user nova-compute[72504]: DEBUG nova.compute.manager [req-f574ff38-64cf-4e2f-9fdc-98f0bb3bf42f req-4e3c0daa-0d44-4ddb-bff4-26f7775f517d service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received event network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:59:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f574ff38-64cf-4e2f-9fdc-98f0bb3bf42f req-4e3c0daa-0d44-4ddb-bff4-26f7775f517d service nova] Acquiring lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f574ff38-64cf-4e2f-9fdc-98f0bb3bf42f req-4e3c0daa-0d44-4ddb-bff4-26f7775f517d service nova] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f574ff38-64cf-4e2f-9fdc-98f0bb3bf42f req-4e3c0daa-0d44-4ddb-bff4-26f7775f517d service nova] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:59 user nova-compute[72504]: DEBUG nova.compute.manager [req-f574ff38-64cf-4e2f-9fdc-98f0bb3bf42f req-4e3c0daa-0d44-4ddb-bff4-26f7775f517d service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] No waiting events found dispatching network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:59:59 user nova-compute[72504]: WARNING nova.compute.manager [req-f574ff38-64cf-4e2f-9fdc-98f0bb3bf42f req-4e3c0daa-0d44-4ddb-bff4-26f7775f517d service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received unexpected event network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 for instance with vm_state rescued and task_state unrescuing.
Aug 01 19:59:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:59 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Instance destroyed successfully.
Aug 01 19:59:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 19:59:59 user nova-compute[72504]: DEBUG nova.compute.manager [req-75ee2a13-54e0-437b-ac37-f8869cac684d req-4437514c-8607-4cf9-ad06-e4f6d551990c service nova] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Received event network-vif-plugged-8fc6472d-34da-4e77-ba88-4dfdbbb615eb {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 19:59:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-75ee2a13-54e0-437b-ac37-f8869cac684d req-4437514c-8607-4cf9-ad06-e4f6d551990c service nova] Acquiring lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 19:59:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-75ee2a13-54e0-437b-ac37-f8869cac684d req-4437514c-8607-4cf9-ad06-e4f6d551990c service nova] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 19:59:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-75ee2a13-54e0-437b-ac37-f8869cac684d req-4437514c-8607-4cf9-ad06-e4f6d551990c service nova] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 19:59:59 user nova-compute[72504]: DEBUG nova.compute.manager [req-75ee2a13-54e0-437b-ac37-f8869cac684d req-4437514c-8607-4cf9-ad06-e4f6d551990c service nova] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] No waiting events found dispatching network-vif-plugged-8fc6472d-34da-4e77-ba88-4dfdbbb615eb {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 19:59:59 user nova-compute[72504]: WARNING nova.compute.manager [req-75ee2a13-54e0-437b-ac37-f8869cac684d req-4437514c-8607-4cf9-ad06-e4f6d551990c service nova] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Received unexpected event network-vif-plugged-8fc6472d-34da-4e77-ba88-4dfdbbb615eb for instance with vm_state building and task_state spawning.
Aug 01 19:59:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:01 user nova-compute[72504]: DEBUG nova.compute.manager [req-426e790e-872d-49e1-8810-32c89680a1b0 req-5453fbd5-0fc7-46c4-882c-f25ce68aab5d service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received event network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:00:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-426e790e-872d-49e1-8810-32c89680a1b0 req-5453fbd5-0fc7-46c4-882c-f25ce68aab5d service nova] Acquiring lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-426e790e-872d-49e1-8810-32c89680a1b0 req-5453fbd5-0fc7-46c4-882c-f25ce68aab5d service nova] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-426e790e-872d-49e1-8810-32c89680a1b0 req-5453fbd5-0fc7-46c4-882c-f25ce68aab5d service nova] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:01 user nova-compute[72504]: DEBUG nova.compute.manager [req-426e790e-872d-49e1-8810-32c89680a1b0 req-5453fbd5-0fc7-46c4-882c-f25ce68aab5d service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] No waiting events found dispatching network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:00:01 user nova-compute[72504]: WARNING nova.compute.manager [req-426e790e-872d-49e1-8810-32c89680a1b0 req-5453fbd5-0fc7-46c4-882c-f25ce68aab5d service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received unexpected event network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 for instance with vm_state rescued and task_state unrescuing.
Aug 01 20:00:01 user nova-compute[72504]: DEBUG nova.compute.manager [req-a785fc02-dc8d-44c4-820e-af638a636207 req-a5b437e5-8ca4-468d-92f1-405ecce49cff service nova] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Received event network-vif-plugged-8fc6472d-34da-4e77-ba88-4dfdbbb615eb {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:00:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a785fc02-dc8d-44c4-820e-af638a636207 req-a5b437e5-8ca4-468d-92f1-405ecce49cff service nova] Acquiring lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a785fc02-dc8d-44c4-820e-af638a636207 req-a5b437e5-8ca4-468d-92f1-405ecce49cff service nova] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a785fc02-dc8d-44c4-820e-af638a636207 req-a5b437e5-8ca4-468d-92f1-405ecce49cff service nova] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:01 user nova-compute[72504]: DEBUG nova.compute.manager [req-a785fc02-dc8d-44c4-820e-af638a636207 req-a5b437e5-8ca4-468d-92f1-405ecce49cff service nova] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] No waiting events found dispatching network-vif-plugged-8fc6472d-34da-4e77-ba88-4dfdbbb615eb {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:00:01 user nova-compute[72504]: WARNING nova.compute.manager [req-a785fc02-dc8d-44c4-820e-af638a636207 req-a5b437e5-8ca4-468d-92f1-405ecce49cff service nova] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Received unexpected event network-vif-plugged-8fc6472d-34da-4e77-ba88-4dfdbbb615eb for instance with vm_state building and task_state spawning.
Aug 01 20:00:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:02 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920002.9455285, 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:00:02 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] VM Resumed (Lifecycle Event)
Aug 01 20:00:02 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:00:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:00:02 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Instance spawned successfully.
Aug 01 20:00:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 20:00:02 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:00:02 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:00:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:00:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:00:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:00:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:00:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:00:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:00:03 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:00:03 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920002.9471304, 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:00:03 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] VM Started (Lifecycle Event)
Aug 01 20:00:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:00:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:00:03 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:00:03 user nova-compute[72504]: INFO nova.compute.manager [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Took 7.37 seconds to spawn the instance on the hypervisor.
Aug 01 20:00:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:00:03 user nova-compute[72504]: INFO nova.compute.manager [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Took 8.23 seconds to build instance.
Aug 01 20:00:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1a968831-3179-48fd-b6fb-99633afd0654 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.418s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-685f3901-4e65-4276-b178-46ecce9b855b req-626a1b10-0381-423e-b587-470b61427a4c service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received event network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:00:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-685f3901-4e65-4276-b178-46ecce9b855b req-626a1b10-0381-423e-b587-470b61427a4c service nova] Acquiring lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-685f3901-4e65-4276-b178-46ecce9b855b req-626a1b10-0381-423e-b587-470b61427a4c service nova] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-685f3901-4e65-4276-b178-46ecce9b855b req-626a1b10-0381-423e-b587-470b61427a4c service nova] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-685f3901-4e65-4276-b178-46ecce9b855b req-626a1b10-0381-423e-b587-470b61427a4c service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] No waiting events found dispatching network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:00:03 user nova-compute[72504]: WARNING nova.compute.manager [req-685f3901-4e65-4276-b178-46ecce9b855b req-626a1b10-0381-423e-b587-470b61427a4c service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received unexpected event network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 for instance with vm_state rescued and task_state unrescuing.
Aug 01 20:00:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Removed pending event for 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 due to event {{(pid=72504) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 20:00:03 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920003.5693958, 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:00:03 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] VM Resumed (Lifecycle Event)
Aug 01 20:00:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-741ff595-96d6-40c4-855f-24be576fdfd6 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:00:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:00:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:00:03 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 20:00:03 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920003.5701034, 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:00:03 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] VM Started (Lifecycle Event)
Aug 01 20:00:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:00:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:00:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Acquiring lock "dad07310-5f62-48f9-a17f-6e960dcf5060" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "dad07310-5f62-48f9-a17f-6e960dcf5060" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Acquiring lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:07 user nova-compute[72504]: INFO nova.compute.manager [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Terminating instance
Aug 01 20:00:07 user nova-compute[72504]: DEBUG nova.compute.manager [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:00:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:07 user nova-compute[72504]: DEBUG nova.compute.manager [req-cb1da210-41f3-4a9a-a813-468ff3e7b9a8 req-fdd1b035-e381-4b91-bac2-f53053a4b074 service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Received event network-vif-unplugged-6f553f59-1aca-4d1a-af20-0228b74af2f8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:00:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cb1da210-41f3-4a9a-a813-468ff3e7b9a8 req-fdd1b035-e381-4b91-bac2-f53053a4b074 service nova] Acquiring lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cb1da210-41f3-4a9a-a813-468ff3e7b9a8 req-fdd1b035-e381-4b91-bac2-f53053a4b074 service nova] Lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cb1da210-41f3-4a9a-a813-468ff3e7b9a8 req-fdd1b035-e381-4b91-bac2-f53053a4b074 service nova] Lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:07 user nova-compute[72504]: DEBUG nova.compute.manager [req-cb1da210-41f3-4a9a-a813-468ff3e7b9a8 req-fdd1b035-e381-4b91-bac2-f53053a4b074 service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] No waiting events found dispatching network-vif-unplugged-6f553f59-1aca-4d1a-af20-0228b74af2f8 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:00:07 user nova-compute[72504]: DEBUG nova.compute.manager [req-cb1da210-41f3-4a9a-a813-468ff3e7b9a8 req-fdd1b035-e381-4b91-bac2-f53053a4b074 service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Received event network-vif-unplugged-6f553f59-1aca-4d1a-af20-0228b74af2f8 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:00:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:08 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Instance destroyed successfully.
Aug 01 20:00:08 user nova-compute[72504]: DEBUG nova.objects.instance [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lazy-loading 'resources' on Instance uuid dad07310-5f62-48f9-a17f-6e960dcf5060 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T19:56:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1651287780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2125575619',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNFzrQ0g9QApzL7h1e01mQviWJQOB+SVoER7DPTzwMDbyzkhT5MJnGE/g2zrEUSsO0fJfQUhubC+mYoonyHOW7N9HSstbnfIyRNkNXhsxk8LTIryb8PGpHTGai5hrxzhA==',key_name='tempest-keypair-451141470',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:58:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9540d878e5ea4bfda3d342e5a78035f5',ramdisk_id='',reservation_id='r-dfez9e0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2015428092',owner_user_name='tempest-ServerActionsV293TestJSON-2015428092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:58:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97ef13eef2a345909187312f5a62e0f6',uuid=dad07310-5f62-48f9-a17f-6e960dcf5060,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "address": "fa:16:3e:a0:c5:9b", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f553f59-1a", "ovs_interfaceid": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Converting VIF {"id": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "address": "fa:16:3e:a0:c5:9b", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f553f59-1a", "ovs_interfaceid": "6f553f59-1aca-4d1a-af20-0228b74af2f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:c5:9b,bridge_name='br-int',has_traffic_filtering=True,id=6f553f59-1aca-4d1a-af20-0228b74af2f8,network=Network(d4da5ad8-9045-4076-9f31-ea9faaf8e6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f553f59-1a') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG os_vif [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:c5:9b,bridge_name='br-int',has_traffic_filtering=True,id=6f553f59-1aca-4d1a-af20-0228b74af2f8,network=Network(d4da5ad8-9045-4076-9f31-ea9faaf8e6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f553f59-1a') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f553f59-1a, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:00:08 user nova-compute[72504]: INFO os_vif [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:c5:9b,bridge_name='br-int',has_traffic_filtering=True,id=6f553f59-1aca-4d1a-af20-0228b74af2f8,network=Network(d4da5ad8-9045-4076-9f31-ea9faaf8e6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f553f59-1a')
Aug 01 20:00:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOqgLyDT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:00:08 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:00:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cba01f8-77ce-4b33-8d72-0d4ca58dc2bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8d73ce-c383-49ba-a9a2-1086c03cb5ee]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:00:08 user nova-compute[72504]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 20:00:08 user nova-compute[72504]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 (non-flash)
Aug 01 20:00:08 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:00:08 user nova-compute[72504]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 (non-flash)
Aug 01 20:00:08 user nova-compute[72504]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 (non-flash)
Aug 01 20:00:08 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3f45a4310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51'): ({'sdd'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Removing single pathed devices sdd {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[27413188-c0d0-4b07-976a-aabe001c474f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad8d72c-0bf3-4d47-a9c9-1bc46c3c5bf8]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Flushing IO for device /dev/sdd {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7696f5-08d8-43c9-9f37-0e9fe44894f9]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d479e6f7-9831-4907-be65-a810ecdffd10]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] SCSI volumes sdd have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO87ca6acc-05dca75d327dad25', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_87ca6acc', '/dev/disk/by-id/scsi-23035646361373564') {{(pid=83379) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[26409378-7fec-4cb9-ad8d-a4bb5c7bdcd0]: (4, None) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c91a26-bf14-464a-a4e4-17079837bf91]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[49522ccd-6261-40c2-bbe1-1abcb3e0cca9]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51, portal: 172.16.0.220,3260]
Aug 01 20:00:08 user nova-compute[72504]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51, portal: 172.16.0.220,3260] successful.
Aug 01 20:00:08 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313801ef-59d1-4715-8154-c9f8e67c5c51 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c0d886-8d19-477f-95c5-6786f9caf587]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] <== disconnect_volume: return (339ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:00:08 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Deleting instance files /opt/stack/data/nova/instances/dad07310-5f62-48f9-a17f-6e960dcf5060_del
Aug 01 20:00:08 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Deletion of /opt/stack/data/nova/instances/dad07310-5f62-48f9-a17f-6e960dcf5060_del complete
Aug 01 20:00:08 user nova-compute[72504]: INFO nova.compute.manager [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 01 20:00:08 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:00:08 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:00:09 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:00:09 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Took 1.01 seconds to deallocate network for instance.
Aug 01 20:00:09 user nova-compute[72504]: DEBUG nova.compute.manager [req-a203a8d3-6a09-4413-a455-dff9f073c4c3 req-33df67f3-a44e-4436-a5d1-9e1e4cebad89 service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Received event network-vif-deleted-6f553f59-1aca-4d1a-af20-0228b74af2f8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:00:09 user nova-compute[72504]: DEBUG nova.compute.manager [req-777206c8-c8ab-4c35-b0a9-da2ace72d587 req-02fb8982-cdb1-49d1-acad-e23050ec6cbf service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Received event network-vif-plugged-6f553f59-1aca-4d1a-af20-0228b74af2f8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:00:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-777206c8-c8ab-4c35-b0a9-da2ace72d587 req-02fb8982-cdb1-49d1-acad-e23050ec6cbf service nova] Acquiring lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-777206c8-c8ab-4c35-b0a9-da2ace72d587 req-02fb8982-cdb1-49d1-acad-e23050ec6cbf service nova] Lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-777206c8-c8ab-4c35-b0a9-da2ace72d587 req-02fb8982-cdb1-49d1-acad-e23050ec6cbf service nova] Lock "dad07310-5f62-48f9-a17f-6e960dcf5060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:09 user nova-compute[72504]: DEBUG nova.compute.manager [req-777206c8-c8ab-4c35-b0a9-da2ace72d587 req-02fb8982-cdb1-49d1-acad-e23050ec6cbf service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] No waiting events found dispatching network-vif-plugged-6f553f59-1aca-4d1a-af20-0228b74af2f8 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:00:09 user nova-compute[72504]: WARNING nova.compute.manager [req-777206c8-c8ab-4c35-b0a9-da2ace72d587 req-02fb8982-cdb1-49d1-acad-e23050ec6cbf service nova] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Received unexpected event network-vif-plugged-6f553f59-1aca-4d1a-af20-0228b74af2f8 for instance with vm_state active and task_state deleting.
Aug 01 20:00:10 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:10 user nova-compute[72504]: INFO nova.compute.manager [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Took 0.81 seconds to detach 1 volumes for instance.
Aug 01 20:00:10 user nova-compute[72504]: DEBUG nova.compute.manager [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Deleting volume: 313801ef-59d1-4715-8154-c9f8e67c5c51 {{(pid=72504) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 20:00:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:10 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:00:10 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:00:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:11 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Deleted allocations for instance dad07310-5f62-48f9-a17f-6e960dcf5060
Aug 01 20:00:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-05073b36-e90a-4369-834f-cefcdd23220f tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "dad07310-5f62-48f9-a17f-6e960dcf5060" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.719s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "554ecd73-e393-4db1-9a8c-6749991dd44c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "554ecd73-e393-4db1-9a8c-6749991dd44c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:13 user nova-compute[72504]: DEBUG nova.compute.manager [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 20:00:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:13 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:00:13 user nova-compute[72504]: INFO nova.compute.claims [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Claim successful on node user
Aug 01 20:00:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:13 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:00:13 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:00:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:13 user nova-compute[72504]: DEBUG nova.compute.manager [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 20:00:13 user nova-compute[72504]: DEBUG nova.compute.manager [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 20:00:13 user nova-compute[72504]: DEBUG nova.network.neutron [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 20:00:13 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 20:00:13 user nova-compute[72504]: DEBUG nova.compute.manager [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 20:00:13 user nova-compute[72504]: DEBUG nova.policy [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '451baacc96384f35bd8bbb87626ac52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cc01820f324654b0959d5fb2adefc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 20:00:13 user nova-compute[72504]: DEBUG nova.compute.manager [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 20:00:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:00:13 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Creating image(s)
Aug 01 20:00:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "/opt/stack/data/nova/instances/554ecd73-e393-4db1-9a8c-6749991dd44c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "/opt/stack/data/nova/instances/554ecd73-e393-4db1-9a8c-6749991dd44c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "/opt/stack/data/nova/instances/554ecd73-e393-4db1-9a8c-6749991dd44c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.156s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.159s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/554ecd73-e393-4db1-9a8c-6749991dd44c/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/554ecd73-e393-4db1-9a8c-6749991dd44c/disk 1073741824" returned: 0 in 0.053s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.148s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:14 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Checking if we can resize image /opt/stack/data/nova/instances/554ecd73-e393-4db1-9a8c-6749991dd44c/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 20:00:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/554ecd73-e393-4db1-9a8c-6749991dd44c/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/554ecd73-e393-4db1-9a8c-6749991dd44c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:14 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Cannot resize image /opt/stack/data/nova/instances/554ecd73-e393-4db1-9a8c-6749991dd44c/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 20:00:14 user nova-compute[72504]: DEBUG nova.objects.instance [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lazy-loading 'migration_context' on Instance uuid 554ecd73-e393-4db1-9a8c-6749991dd44c {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:00:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 20:00:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Ensure instance console log exists: /opt/stack/data/nova/instances/554ecd73-e393-4db1-9a8c-6749991dd44c/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:00:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:14 user nova-compute[72504]: DEBUG nova.network.neutron [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Successfully created port: 31d5c352-dfc0-4a1a-8ed8-327c933661c9 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 20:00:15 user nova-compute[72504]: DEBUG nova.network.neutron [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Successfully updated port: 31d5c352-dfc0-4a1a-8ed8-327c933661c9 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 20:00:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "refresh_cache-554ecd73-e393-4db1-9a8c-6749991dd44c" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:00:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquired lock "refresh_cache-554ecd73-e393-4db1-9a8c-6749991dd44c" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:00:15 user nova-compute[72504]: DEBUG nova.network.neutron [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:00:15 user nova-compute[72504]: DEBUG nova.compute.manager [req-2abc9a09-9c68-4f80-b5dd-4dc3436a438e req-7745a67c-aa5c-4e7c-b70b-fb4c2118d3b9 service nova] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Received event network-changed-31d5c352-dfc0-4a1a-8ed8-327c933661c9 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:00:15 user nova-compute[72504]: DEBUG nova.compute.manager [req-2abc9a09-9c68-4f80-b5dd-4dc3436a438e req-7745a67c-aa5c-4e7c-b70b-fb4c2118d3b9 service nova] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Refreshing instance network info cache due to event network-changed-31d5c352-dfc0-4a1a-8ed8-327c933661c9. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:00:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2abc9a09-9c68-4f80-b5dd-4dc3436a438e req-7745a67c-aa5c-4e7c-b70b-fb4c2118d3b9 service nova] Acquiring lock "refresh_cache-554ecd73-e393-4db1-9a8c-6749991dd44c" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:00:15 user nova-compute[72504]: DEBUG nova.network.neutron [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.network.neutron [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Updating instance_info_cache with network_info: [{"id": "31d5c352-dfc0-4a1a-8ed8-327c933661c9", "address": "fa:16:3e:32:1c:cc", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d5c352-df", "ovs_interfaceid": "31d5c352-dfc0-4a1a-8ed8-327c933661c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Releasing lock "refresh_cache-554ecd73-e393-4db1-9a8c-6749991dd44c" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.compute.manager [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Instance network_info: |[{"id": "31d5c352-dfc0-4a1a-8ed8-327c933661c9", "address": "fa:16:3e:32:1c:cc", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d5c352-df", "ovs_interfaceid": "31d5c352-dfc0-4a1a-8ed8-327c933661c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2abc9a09-9c68-4f80-b5dd-4dc3436a438e req-7745a67c-aa5c-4e7c-b70b-fb4c2118d3b9 service nova] Acquired lock "refresh_cache-554ecd73-e393-4db1-9a8c-6749991dd44c" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.network.neutron [req-2abc9a09-9c68-4f80-b5dd-4dc3436a438e req-7745a67c-aa5c-4e7c-b70b-fb4c2118d3b9 service nova] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Refreshing network info cache for port 31d5c352-dfc0-4a1a-8ed8-327c933661c9 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Start _get_guest_xml network_info=[{"id": "31d5c352-dfc0-4a1a-8ed8-327c933661c9", "address": "fa:16:3e:32:1c:cc", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d5c352-df", "ovs_interfaceid": "31d5c352-dfc0-4a1a-8ed8-327c933661c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:00:16 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:00:16 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:00:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1570974455',display_name='tempest-AttachVolumeNegativeTest-server-1570974455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1570974455',id=26,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwbL/YqhbMbbdLOpeA9vhSfBI5kIRRhYl0eWbAIVuqUdNPRvjk+81V4bQQG1/1eaO4Kjs8LfkO1spXLoUBlaVtDBcv2rH+ePk3Qz+AE+MWOHG85OrOfAtpYB7mAqHoWjg==',key_name='tempest-keypair-2018424560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15cc01820f324654b0959d5fb2adefc3',ramdisk_id='',reservation_id='r-0iyyp3jw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2109955223',owner_user_name='tempest-AttachVolumeNegativeTest-2109955223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:00:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='451baacc96384f35bd8bbb87626ac52d',uuid=554ecd73-e393-4db1-9a8c-6749991dd44c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31d5c352-dfc0-4a1a-8ed8-327c933661c9", "address": "fa:16:3e:32:1c:cc", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d5c352-df", "ovs_interfaceid": "31d5c352-dfc0-4a1a-8ed8-327c933661c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Converting VIF {"id": "31d5c352-dfc0-4a1a-8ed8-327c933661c9", "address": "fa:16:3e:32:1c:cc", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d5c352-df", "ovs_interfaceid": "31d5c352-dfc0-4a1a-8ed8-327c933661c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:1c:cc,bridge_name='br-int',has_traffic_filtering=True,id=31d5c352-dfc0-4a1a-8ed8-327c933661c9,network=Network(67292f1d-2643-4cfa-aaf6-0a698d87bfd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31d5c352-df') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.objects.instance [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lazy-loading 'pci_devices' on Instance uuid 554ecd73-e393-4db1-9a8c-6749991dd44c {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:00:16 user nova-compute[72504]:   <uuid>554ecd73-e393-4db1-9a8c-6749991dd44c</uuid>
Aug 01 20:00:16 user nova-compute[72504]:   <name>instance-0000001a</name>
Aug 01 20:00:16 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:00:16 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:00:16 user nova-compute[72504]:   <metadata>
Aug 01 20:00:16 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:00:16 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:00:16 user nova-compute[72504]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1570974455</nova:name>
Aug 01 20:00:16 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:00:16</nova:creationTime>
Aug 01 20:00:16 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:00:16 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:00:16 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:00:16 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:00:16 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:00:16 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:00:16 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:00:16 user nova-compute[72504]:       <nova:owner>
Aug 01 20:00:16 user nova-compute[72504]:         <nova:user uuid="451baacc96384f35bd8bbb87626ac52d">tempest-AttachVolumeNegativeTest-2109955223-project-member</nova:user>
Aug 01 20:00:16 user nova-compute[72504]:         <nova:project uuid="15cc01820f324654b0959d5fb2adefc3">tempest-AttachVolumeNegativeTest-2109955223</nova:project>
Aug 01 20:00:16 user nova-compute[72504]:       </nova:owner>
Aug 01 20:00:16 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 20:00:16 user nova-compute[72504]:       <nova:ports>
Aug 01 20:00:16 user nova-compute[72504]:         <nova:port uuid="31d5c352-dfc0-4a1a-8ed8-327c933661c9">
Aug 01 20:00:16 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 20:00:16 user nova-compute[72504]:         </nova:port>
Aug 01 20:00:16 user nova-compute[72504]:       </nova:ports>
Aug 01 20:00:16 user nova-compute[72504]:     </nova:instance>
Aug 01 20:00:16 user nova-compute[72504]:   </metadata>
Aug 01 20:00:16 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:00:16 user nova-compute[72504]:     <system>
Aug 01 20:00:16 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:00:16 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:00:16 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:00:16 user nova-compute[72504]:       <entry name="serial">554ecd73-e393-4db1-9a8c-6749991dd44c</entry>
Aug 01 20:00:16 user nova-compute[72504]:       <entry name="uuid">554ecd73-e393-4db1-9a8c-6749991dd44c</entry>
Aug 01 20:00:16 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:00:16 user nova-compute[72504]:     </system>
Aug 01 20:00:16 user nova-compute[72504]:   </sysinfo>
Aug 01 20:00:16 user nova-compute[72504]:   <os>
Aug 01 20:00:16 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:00:16 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:00:16 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:00:16 user nova-compute[72504]:   </os>
Aug 01 20:00:16 user nova-compute[72504]:   <features>
Aug 01 20:00:16 user nova-compute[72504]:     <acpi/>
Aug 01 20:00:16 user nova-compute[72504]:     <apic/>
Aug 01 20:00:16 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:00:16 user nova-compute[72504]:   </features>
Aug 01 20:00:16 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:00:16 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:00:16 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:00:16 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:00:16 user nova-compute[72504]:   </clock>
Aug 01 20:00:16 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:00:16 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:00:16 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:00:16 user nova-compute[72504]:   </cpu>
Aug 01 20:00:16 user nova-compute[72504]:   <devices>
Aug 01 20:00:16 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 20:00:16 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 20:00:16 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/554ecd73-e393-4db1-9a8c-6749991dd44c/disk"/>
Aug 01 20:00:16 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:00:16 user nova-compute[72504]:     </disk>
Aug 01 20:00:16 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:00:16 user nova-compute[72504]:       <mac address="fa:16:3e:32:1c:cc"/>
Aug 01 20:00:16 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:00:16 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:00:16 user nova-compute[72504]:       <target dev="tap31d5c352-df"/>
Aug 01 20:00:16 user nova-compute[72504]:     </interface>
Aug 01 20:00:16 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:00:16 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/554ecd73-e393-4db1-9a8c-6749991dd44c/console.log" append="off"/>
Aug 01 20:00:16 user nova-compute[72504]:     </serial>
Aug 01 20:00:16 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:00:16 user nova-compute[72504]:     <video>
Aug 01 20:00:16 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:00:16 user nova-compute[72504]:     </video>
Aug 01 20:00:16 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:00:16 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:00:16 user nova-compute[72504]:     </rng>
Aug 01 20:00:16 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:00:16 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:00:16 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:00:16 user nova-compute[72504]:     </memballoon>
Aug 01 20:00:16 user nova-compute[72504]:   </devices>
Aug 01 20:00:16 user nova-compute[72504]: </domain>
Aug 01 20:00:16 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:00:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1570974455',display_name='tempest-AttachVolumeNegativeTest-server-1570974455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1570974455',id=26,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwbL/YqhbMbbdLOpeA9vhSfBI5kIRRhYl0eWbAIVuqUdNPRvjk+81V4bQQG1/1eaO4Kjs8LfkO1spXLoUBlaVtDBcv2rH+ePk3Qz+AE+MWOHG85OrOfAtpYB7mAqHoWjg==',key_name='tempest-keypair-2018424560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15cc01820f324654b0959d5fb2adefc3',ramdisk_id='',reservation_id='r-0iyyp3jw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2109955223',owner_user_name='tempest-AttachVolumeNegativeTest-2109955223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:00:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='451baacc96384f35bd8bbb87626ac52d',uuid=554ecd73-e393-4db1-9a8c-6749991dd44c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31d5c352-dfc0-4a1a-8ed8-327c933661c9", "address": "fa:16:3e:32:1c:cc", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d5c352-df", "ovs_interfaceid": "31d5c352-dfc0-4a1a-8ed8-327c933661c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Converting VIF {"id": "31d5c352-dfc0-4a1a-8ed8-327c933661c9", "address": "fa:16:3e:32:1c:cc", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d5c352-df", "ovs_interfaceid": "31d5c352-dfc0-4a1a-8ed8-327c933661c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:1c:cc,bridge_name='br-int',has_traffic_filtering=True,id=31d5c352-dfc0-4a1a-8ed8-327c933661c9,network=Network(67292f1d-2643-4cfa-aaf6-0a698d87bfd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31d5c352-df') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG os_vif [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:1c:cc,bridge_name='br-int',has_traffic_filtering=True,id=31d5c352-dfc0-4a1a-8ed8-327c933661c9,network=Network(67292f1d-2643-4cfa-aaf6-0a698d87bfd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31d5c352-df') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31d5c352-df, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap31d5c352-df, col_values=(('external_ids', {'iface-id': '31d5c352-dfc0-4a1a-8ed8-327c933661c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:1c:cc', 'vm-uuid': '554ecd73-e393-4db1-9a8c-6749991dd44c'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:16 user nova-compute[72504]: INFO os_vif [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:1c:cc,bridge_name='br-int',has_traffic_filtering=True,id=31d5c352-dfc0-4a1a-8ed8-327c933661c9,network=Network(67292f1d-2643-4cfa-aaf6-0a698d87bfd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31d5c352-df')
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] No VIF found with MAC fa:16:3e:32:1c:cc, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.network.neutron [req-2abc9a09-9c68-4f80-b5dd-4dc3436a438e req-7745a67c-aa5c-4e7c-b70b-fb4c2118d3b9 service nova] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Updated VIF entry in instance network info cache for port 31d5c352-dfc0-4a1a-8ed8-327c933661c9. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG nova.network.neutron [req-2abc9a09-9c68-4f80-b5dd-4dc3436a438e req-7745a67c-aa5c-4e7c-b70b-fb4c2118d3b9 service nova] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Updating instance_info_cache with network_info: [{"id": "31d5c352-dfc0-4a1a-8ed8-327c933661c9", "address": "fa:16:3e:32:1c:cc", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d5c352-df", "ovs_interfaceid": "31d5c352-dfc0-4a1a-8ed8-327c933661c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2abc9a09-9c68-4f80-b5dd-4dc3436a438e req-7745a67c-aa5c-4e7c-b70b-fb4c2118d3b9 service nova] Releasing lock "refresh_cache-554ecd73-e393-4db1-9a8c-6749991dd44c" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:00:16 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:00:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:17 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:00:17 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Cleaning up deleted instances {{(pid=72504) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 20:00:17 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] There are 0 instances to clean {{(pid=72504) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 20:00:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:18 user nova-compute[72504]: DEBUG nova.compute.manager [req-5c258812-abb0-4966-b0a1-4a4cc922d2d3 req-eeb01a10-e90f-4f64-8f59-f31fedb31347 service nova] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Received event network-vif-plugged-31d5c352-dfc0-4a1a-8ed8-327c933661c9 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:00:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5c258812-abb0-4966-b0a1-4a4cc922d2d3 req-eeb01a10-e90f-4f64-8f59-f31fedb31347 service nova] Acquiring lock "554ecd73-e393-4db1-9a8c-6749991dd44c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5c258812-abb0-4966-b0a1-4a4cc922d2d3 req-eeb01a10-e90f-4f64-8f59-f31fedb31347 service nova] Lock "554ecd73-e393-4db1-9a8c-6749991dd44c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5c258812-abb0-4966-b0a1-4a4cc922d2d3 req-eeb01a10-e90f-4f64-8f59-f31fedb31347 service nova] Lock "554ecd73-e393-4db1-9a8c-6749991dd44c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:18 user nova-compute[72504]: DEBUG nova.compute.manager [req-5c258812-abb0-4966-b0a1-4a4cc922d2d3 req-eeb01a10-e90f-4f64-8f59-f31fedb31347 service nova] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] No waiting events found dispatching network-vif-plugged-31d5c352-dfc0-4a1a-8ed8-327c933661c9 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:00:18 user nova-compute[72504]: WARNING nova.compute.manager [req-5c258812-abb0-4966-b0a1-4a4cc922d2d3 req-eeb01a10-e90f-4f64-8f59-f31fedb31347 service nova] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Received unexpected event network-vif-plugged-31d5c352-dfc0-4a1a-8ed8-327c933661c9 for instance with vm_state building and task_state spawning.
Aug 01 20:00:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:18 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:00:18 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920020.0633404, 554ecd73-e393-4db1-9a8c-6749991dd44c => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:00:20 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] VM Resumed (Lifecycle Event)
Aug 01 20:00:20 user nova-compute[72504]: DEBUG nova.compute.manager [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:00:20 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Instance spawned successfully.
Aug 01 20:00:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG nova.compute.manager [req-754032d0-967c-4aa8-9cdf-a45e9d77b6f0 req-32880f4a-554c-435f-bf95-3236163a52c6 service nova] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Received event network-vif-plugged-31d5c352-dfc0-4a1a-8ed8-327c933661c9 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-754032d0-967c-4aa8-9cdf-a45e9d77b6f0 req-32880f4a-554c-435f-bf95-3236163a52c6 service nova] Acquiring lock "554ecd73-e393-4db1-9a8c-6749991dd44c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-754032d0-967c-4aa8-9cdf-a45e9d77b6f0 req-32880f4a-554c-435f-bf95-3236163a52c6 service nova] Lock "554ecd73-e393-4db1-9a8c-6749991dd44c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-754032d0-967c-4aa8-9cdf-a45e9d77b6f0 req-32880f4a-554c-435f-bf95-3236163a52c6 service nova] Lock "554ecd73-e393-4db1-9a8c-6749991dd44c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG nova.compute.manager [req-754032d0-967c-4aa8-9cdf-a45e9d77b6f0 req-32880f4a-554c-435f-bf95-3236163a52c6 service nova] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] No waiting events found dispatching network-vif-plugged-31d5c352-dfc0-4a1a-8ed8-327c933661c9 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:00:20 user nova-compute[72504]: WARNING nova.compute.manager [req-754032d0-967c-4aa8-9cdf-a45e9d77b6f0 req-32880f4a-554c-435f-bf95-3236163a52c6 service nova] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Received unexpected event network-vif-plugged-31d5c352-dfc0-4a1a-8ed8-327c933661c9 for instance with vm_state building and task_state spawning.
Aug 01 20:00:20 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:00:20 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:00:20 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920020.0645015, 554ecd73-e393-4db1-9a8c-6749991dd44c => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:00:20 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] VM Started (Lifecycle Event)
Aug 01 20:00:20 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:00:20 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:00:20 user nova-compute[72504]: INFO nova.compute.manager [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Took 6.31 seconds to spawn the instance on the hypervisor.
Aug 01 20:00:20 user nova-compute[72504]: DEBUG nova.compute.manager [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8c352a19-20f6-40e7-8c53-164daa6a5738 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Acquiring lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8c352a19-20f6-40e7-8c53-164daa6a5738 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8c352a19-20f6-40e7-8c53-164daa6a5738 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Acquiring lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8c352a19-20f6-40e7-8c53-164daa6a5738 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8c352a19-20f6-40e7-8c53-164daa6a5738 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:20 user nova-compute[72504]: INFO nova.compute.manager [None req-8c352a19-20f6-40e7-8c53-164daa6a5738 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Terminating instance
Aug 01 20:00:20 user nova-compute[72504]: DEBUG nova.compute.manager [None req-8c352a19-20f6-40e7-8c53-164daa6a5738 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:00:20 user nova-compute[72504]: INFO nova.compute.manager [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Took 7.08 seconds to build instance.
Aug 01 20:00:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ddda92fb-1a2b-4fac-8ec5-7b20803028b8 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "554ecd73-e393-4db1-9a8c-6749991dd44c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.214s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG nova.compute.manager [req-708c129a-3017-46f5-9388-04897916ba2f req-cdf1f830-e8e7-47f8-8aba-48011065aebf service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Received event network-vif-unplugged-d46af6d6-430b-4d54-a553-937e9bf21d16 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-708c129a-3017-46f5-9388-04897916ba2f req-cdf1f830-e8e7-47f8-8aba-48011065aebf service nova] Acquiring lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-708c129a-3017-46f5-9388-04897916ba2f req-cdf1f830-e8e7-47f8-8aba-48011065aebf service nova] Lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-708c129a-3017-46f5-9388-04897916ba2f req-cdf1f830-e8e7-47f8-8aba-48011065aebf service nova] Lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG nova.compute.manager [req-708c129a-3017-46f5-9388-04897916ba2f req-cdf1f830-e8e7-47f8-8aba-48011065aebf service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] No waiting events found dispatching network-vif-unplugged-d46af6d6-430b-4d54-a553-937e9bf21d16 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:00:20 user nova-compute[72504]: DEBUG nova.compute.manager [req-708c129a-3017-46f5-9388-04897916ba2f req-cdf1f830-e8e7-47f8-8aba-48011065aebf service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Received event network-vif-unplugged-d46af6d6-430b-4d54-a553-937e9bf21d16 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:00:21 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Instance destroyed successfully.
Aug 01 20:00:21 user nova-compute[72504]: DEBUG nova.objects.instance [None req-8c352a19-20f6-40e7-8c53-164daa6a5738 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lazy-loading 'resources' on Instance uuid de2b2e01-4be0-4709-aacd-f6a7cc2897e0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:00:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-8c352a19-20f6-40e7-8c53-164daa6a5738 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T19:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2820075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2820075',id=23,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFR6MNT81m0077QoKPCZmUoTwZo1tmyWFZilUMLyic+9WyjHpZo/ciaWRQRs7DELWXer49Euo3w0BX2N62edjBrzmKu9DWAic/6QsdF1qlTj504N9KRmTcmwPyzz0oz/gg==',key_name='tempest-keypair-857323455',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:57:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='961ea5d0c92447a9853b93335137b5bc',ramdisk_id='',reservation_id='r-pstr5dkl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-740827412',owner_user_name='tempest-TaggedAttachmentsTest-740827412-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:57:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54daf483b7e4ab7b177fe06a02c207e',uuid=de2b2e01-4be0-4709-aacd-f6a7cc2897e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d46af6d6-430b-4d54-a553-937e9bf21d16", "address": "fa:16:3e:bf:32:31", "network": {"id": "8fe56054-7531-450f-9ddd-4c519a2e4577", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-45399222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd46af6d6-43", "ovs_interfaceid": "d46af6d6-430b-4d54-a553-937e9bf21d16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:00:21 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c352a19-20f6-40e7-8c53-164daa6a5738 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Converting VIF {"id": "d46af6d6-430b-4d54-a553-937e9bf21d16", "address": "fa:16:3e:bf:32:31", "network": {"id": "8fe56054-7531-450f-9ddd-4c519a2e4577", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-45399222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "961ea5d0c92447a9853b93335137b5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd46af6d6-43", "ovs_interfaceid": "d46af6d6-430b-4d54-a553-937e9bf21d16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:00:21 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8c352a19-20f6-40e7-8c53-164daa6a5738 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:32:31,bridge_name='br-int',has_traffic_filtering=True,id=d46af6d6-430b-4d54-a553-937e9bf21d16,network=Network(8fe56054-7531-450f-9ddd-4c519a2e4577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd46af6d6-43') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:00:21 user nova-compute[72504]: DEBUG os_vif [None req-8c352a19-20f6-40e7-8c53-164daa6a5738 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:32:31,bridge_name='br-int',has_traffic_filtering=True,id=d46af6d6-430b-4d54-a553-937e9bf21d16,network=Network(8fe56054-7531-450f-9ddd-4c519a2e4577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd46af6d6-43') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:00:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd46af6d6-43, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:00:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:00:21 user nova-compute[72504]: INFO os_vif [None req-8c352a19-20f6-40e7-8c53-164daa6a5738 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:32:31,bridge_name='br-int',has_traffic_filtering=True,id=d46af6d6-430b-4d54-a553-937e9bf21d16,network=Network(8fe56054-7531-450f-9ddd-4c519a2e4577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd46af6d6-43')
Aug 01 20:00:21 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-8c352a19-20f6-40e7-8c53-164daa6a5738 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Deleting instance files /opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0_del
Aug 01 20:00:21 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-8c352a19-20f6-40e7-8c53-164daa6a5738 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Deletion of /opt/stack/data/nova/instances/de2b2e01-4be0-4709-aacd-f6a7cc2897e0_del complete
Aug 01 20:00:21 user nova-compute[72504]: INFO nova.compute.manager [None req-8c352a19-20f6-40e7-8c53-164daa6a5738 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 01 20:00:21 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-8c352a19-20f6-40e7-8c53-164daa6a5738 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:00:21 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:00:21 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:00:21 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:00:21 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:00:21 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:00:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:21 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:00:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:22 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:00:22 user nova-compute[72504]: DEBUG nova.compute.manager [req-97f78b61-e73a-4e0a-a358-93424506943f req-72a994ef-76e9-427a-b849-e182f6723310 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Received event network-vif-deleted-d46af6d6-430b-4d54-a553-937e9bf21d16 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:00:22 user nova-compute[72504]: INFO nova.compute.manager [req-97f78b61-e73a-4e0a-a358-93424506943f req-72a994ef-76e9-427a-b849-e182f6723310 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Neutron deleted interface d46af6d6-430b-4d54-a553-937e9bf21d16; detaching it from the instance and deleting it from the info cache
Aug 01 20:00:22 user nova-compute[72504]: DEBUG nova.network.neutron [req-97f78b61-e73a-4e0a-a358-93424506943f req-72a994ef-76e9-427a-b849-e182f6723310 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:00:22 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Took 1.31 seconds to deallocate network for instance.
Aug 01 20:00:22 user nova-compute[72504]: DEBUG nova.compute.manager [req-97f78b61-e73a-4e0a-a358-93424506943f req-72a994ef-76e9-427a-b849-e182f6723310 service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Detach interface failed, port_id=d46af6d6-430b-4d54-a553-937e9bf21d16, reason: Instance de2b2e01-4be0-4709-aacd-f6a7cc2897e0 could not be found. {{(pid=72504) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 20:00:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8c352a19-20f6-40e7-8c53-164daa6a5738 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8c352a19-20f6-40e7-8c53-164daa6a5738 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:22 user nova-compute[72504]: DEBUG nova.compute.manager [req-8167340b-8e4a-43e3-a182-8768d9ec0214 req-7ed3e4ce-909d-4bdf-a7ae-bca0d0b0c6ea service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Received event network-vif-plugged-d46af6d6-430b-4d54-a553-937e9bf21d16 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:00:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-8167340b-8e4a-43e3-a182-8768d9ec0214 req-7ed3e4ce-909d-4bdf-a7ae-bca0d0b0c6ea service nova] Acquiring lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-8167340b-8e4a-43e3-a182-8768d9ec0214 req-7ed3e4ce-909d-4bdf-a7ae-bca0d0b0c6ea service nova] Lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-8167340b-8e4a-43e3-a182-8768d9ec0214 req-7ed3e4ce-909d-4bdf-a7ae-bca0d0b0c6ea service nova] Lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:22 user nova-compute[72504]: DEBUG nova.compute.manager [req-8167340b-8e4a-43e3-a182-8768d9ec0214 req-7ed3e4ce-909d-4bdf-a7ae-bca0d0b0c6ea service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] No waiting events found dispatching network-vif-plugged-d46af6d6-430b-4d54-a553-937e9bf21d16 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:00:22 user nova-compute[72504]: WARNING nova.compute.manager [req-8167340b-8e4a-43e3-a182-8768d9ec0214 req-7ed3e4ce-909d-4bdf-a7ae-bca0d0b0c6ea service nova] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Received unexpected event network-vif-plugged-d46af6d6-430b-4d54-a553-937e9bf21d16 for instance with vm_state deleted and task_state None.
Aug 01 20:00:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:00:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:23 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-8c352a19-20f6-40e7-8c53-164daa6a5738 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:00:23 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-8c352a19-20f6-40e7-8c53-164daa6a5738 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:00:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8c352a19-20f6-40e7-8c53-164daa6a5738 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.470s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:23 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-8c352a19-20f6-40e7-8c53-164daa6a5738 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Deleted allocations for instance de2b2e01-4be0-4709-aacd-f6a7cc2897e0
Aug 01 20:00:23 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690920008.238739, dad07310-5f62-48f9-a17f-6e960dcf5060 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:00:23 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] VM Stopped (Lifecycle Event)
Aug 01 20:00:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-9c60f98d-b5a5-4a61-8057-1a45f5209fca None None] [instance: dad07310-5f62-48f9-a17f-6e960dcf5060] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:00:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:00:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8c352a19-20f6-40e7-8c53-164daa6a5738 tempest-TaggedAttachmentsTest-740827412 tempest-TaggedAttachmentsTest-740827412-project-member] Lock "de2b2e01-4be0-4709-aacd-f6a7cc2897e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.068s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/554ecd73-e393-4db1-9a8c-6749991dd44c/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/554ecd73-e393-4db1-9a8c-6749991dd44c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/554ecd73-e393-4db1-9a8c-6749991dd44c/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/554ecd73-e393-4db1-9a8c-6749991dd44c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:25 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:00:25 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:00:25 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=7540MB free_disk=25.20372772216797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:00:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:25 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:00:25 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 7391a8ce-7ce5-47ec-97f6-6159645688ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:00:25 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:00:25 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 128c2981-363c-4ae9-b46d-15b5e5d9cac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:00:25 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:00:25 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 88f95d20-e391-4100-93b2-da29bfcf9704 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:00:25 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 54812de2-bfe3-46f1-a327-8081fbb80bec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:00:25 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:00:25 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 554ecd73-e393-4db1-9a8c-6749991dd44c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:00:25 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:00:25 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:00:25 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:00:25 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:00:25 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:00:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:27 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:00:27 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:00:27 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:00:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:00:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:00:27 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:00:28 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Updating instance_info_cache with network_info: [{"id": "1ae5b451-36d3-474b-b576-26b42d8dbb6d", "address": "fa:16:3e:9d:e3:8f", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae5b451-36", "ovs_interfaceid": "1ae5b451-36d3-474b-b576-26b42d8dbb6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:00:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:00:28 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:00:28 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:00:28 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:00:28 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:00:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:32 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:00:32 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72504) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 20:00:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:36 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690920021.1190932, de2b2e01-4be0-4709-aacd-f6a7cc2897e0 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:00:36 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] VM Stopped (Lifecycle Event)
Aug 01 20:00:36 user nova-compute[72504]: DEBUG nova.compute.manager [None req-8e11a2cf-8581-4d55-864d-c72aac984d3f None None] [instance: de2b2e01-4be0-4709-aacd-f6a7cc2897e0] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:00:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "6377103d-7606-4a5d-a905-6b1439e52c93" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "6377103d-7606-4a5d-a905-6b1439e52c93" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:47 user nova-compute[72504]: INFO nova.compute.manager [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Unshelving
Aug 01 20:00:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:47 user nova-compute[72504]: DEBUG nova.objects.instance [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lazy-loading 'pci_requests' on Instance uuid 6377103d-7606-4a5d-a905-6b1439e52c93 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:00:47 user nova-compute[72504]: DEBUG nova.objects.instance [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lazy-loading 'numa_topology' on Instance uuid 6377103d-7606-4a5d-a905-6b1439e52c93 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:00:47 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:00:47 user nova-compute[72504]: INFO nova.compute.claims [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Claim successful on node user
Aug 01 20:00:48 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:00:48 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:00:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:48 user nova-compute[72504]: INFO nova.network.neutron [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Updating port 9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 01 20:00:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "refresh_cache-6377103d-7606-4a5d-a905-6b1439e52c93" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:00:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquired lock "refresh_cache-6377103d-7606-4a5d-a905-6b1439e52c93" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:00:49 user nova-compute[72504]: DEBUG nova.network.neutron [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:00:49 user nova-compute[72504]: DEBUG nova.compute.manager [req-4978488a-480b-4bbf-aa10-60543dcbde0e req-2f6f3090-a869-4501-b107-dae6349fa331 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received event network-changed-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:00:49 user nova-compute[72504]: DEBUG nova.compute.manager [req-4978488a-480b-4bbf-aa10-60543dcbde0e req-2f6f3090-a869-4501-b107-dae6349fa331 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Refreshing instance network info cache due to event network-changed-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:00:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4978488a-480b-4bbf-aa10-60543dcbde0e req-2f6f3090-a869-4501-b107-dae6349fa331 service nova] Acquiring lock "refresh_cache-6377103d-7606-4a5d-a905-6b1439e52c93" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:00:49 user nova-compute[72504]: DEBUG nova.network.neutron [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Updating instance_info_cache with network_info: [{"id": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "address": "fa:16:3e:3e:71:62", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9af0b4bf-bc", "ovs_interfaceid": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:00:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Releasing lock "refresh_cache-6377103d-7606-4a5d-a905-6b1439e52c93" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:00:49 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:00:49 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Creating image(s)
Aug 01 20:00:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "/opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "/opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "/opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:49 user nova-compute[72504]: DEBUG nova.objects.instance [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6377103d-7606-4a5d-a905-6b1439e52c93 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:00:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4978488a-480b-4bbf-aa10-60543dcbde0e req-2f6f3090-a869-4501-b107-dae6349fa331 service nova] Acquired lock "refresh_cache-6377103d-7606-4a5d-a905-6b1439e52c93" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:00:49 user nova-compute[72504]: DEBUG nova.network.neutron [req-4978488a-480b-4bbf-aa10-60543dcbde0e req-2f6f3090-a869-4501-b107-dae6349fa331 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Refreshing network info cache for port 9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:00:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "6c0fe78d1a8b5118e82636c49401685c312a7c10" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "6c0fe78d1a8b5118e82636c49401685c312a7c10" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c0fe78d1a8b5118e82636c49401685c312a7c10.part --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c0fe78d1a8b5118e82636c49401685c312a7c10.part --force-share --output=json" returned: 0 in 0.149s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:50 user nova-compute[72504]: DEBUG nova.virt.images [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] dfbbb5cd-aae2-4264-aefd-8b44817a474c was qcow2, converting to raw {{(pid=72504) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 20:00:51 user nova-compute[72504]: DEBUG nova.privsep.utils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72504) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 20:00:51 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6c0fe78d1a8b5118e82636c49401685c312a7c10.part /opt/stack/data/nova/instances/_base/6c0fe78d1a8b5118e82636c49401685c312a7c10.converted {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:51 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:51 user nova-compute[72504]: DEBUG nova.network.neutron [req-4978488a-480b-4bbf-aa10-60543dcbde0e req-2f6f3090-a869-4501-b107-dae6349fa331 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Updated VIF entry in instance network info cache for port 9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:00:51 user nova-compute[72504]: DEBUG nova.network.neutron [req-4978488a-480b-4bbf-aa10-60543dcbde0e req-2f6f3090-a869-4501-b107-dae6349fa331 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Updating instance_info_cache with network_info: [{"id": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "address": "fa:16:3e:3e:71:62", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9af0b4bf-bc", "ovs_interfaceid": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:00:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4978488a-480b-4bbf-aa10-60543dcbde0e req-2f6f3090-a869-4501-b107-dae6349fa331 service nova] Releasing lock "refresh_cache-6377103d-7606-4a5d-a905-6b1439e52c93" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:00:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6c0fe78d1a8b5118e82636c49401685c312a7c10.part /opt/stack/data/nova/instances/_base/6c0fe78d1a8b5118e82636c49401685c312a7c10.converted" returned: 0 in 1.006s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c0fe78d1a8b5118e82636c49401685c312a7c10.converted --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c0fe78d1a8b5118e82636c49401685c312a7c10.converted --force-share --output=json" returned: 0 in 0.151s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "6c0fe78d1a8b5118e82636c49401685c312a7c10" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.423s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c0fe78d1a8b5118e82636c49401685c312a7c10 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c0fe78d1a8b5118e82636c49401685c312a7c10 --force-share --output=json" returned: 0 in 0.215s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "6c0fe78d1a8b5118e82636c49401685c312a7c10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "6c0fe78d1a8b5118e82636c49401685c312a7c10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c0fe78d1a8b5118e82636c49401685c312a7c10 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c0fe78d1a8b5118e82636c49401685c312a7c10 --force-share --output=json" returned: 0 in 0.129s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6c0fe78d1a8b5118e82636c49401685c312a7c10,backing_fmt=raw /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6c0fe78d1a8b5118e82636c49401685c312a7c10,backing_fmt=raw /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk 1073741824" returned: 0 in 0.048s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "6c0fe78d1a8b5118e82636c49401685c312a7c10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c0fe78d1a8b5118e82636c49401685c312a7c10 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c0fe78d1a8b5118e82636c49401685c312a7c10 --force-share --output=json" returned: 0 in 0.134s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:52 user nova-compute[72504]: DEBUG nova.objects.instance [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lazy-loading 'migration_context' on Instance uuid 6377103d-7606-4a5d-a905-6b1439e52c93 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:00:52 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Rebasing disk image.
Aug 01 20:00:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.145s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 -F raw /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 -F raw /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk" returned: 0 in 2.114s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Ensure instance console log exists: /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Start _get_guest_xml network_info=[{"id": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "address": "fa:16:3e:3e:71:62", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9af0b4bf-bc", "ovs_interfaceid": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='f345efa66b325e817b8165c76ca0fa60',container_format='bare',created_at=2023-08-01T19:58:55Z,direct_url=<?>,disk_format='qcow2',id=dfbbb5cd-aae2-4264-aefd-8b44817a474c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-166257871-shelved',owner='da04aaa8143b44d5aa21f59a89cd57ee',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-01T19:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:00:55 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:00:55 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f345efa66b325e817b8165c76ca0fa60',container_format='bare',created_at=2023-08-01T19:58:55Z,direct_url=<?>,disk_format='qcow2',id=dfbbb5cd-aae2-4264-aefd-8b44817a474c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-166257871-shelved',owner='da04aaa8143b44d5aa21f59a89cd57ee',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-01T19:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.objects.instance [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6377103d-7606-4a5d-a905-6b1439e52c93 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T19:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-166257871',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-166257871',id=22,image_ref='dfbbb5cd-aae2-4264-aefd-8b44817a474c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1753450990',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:57:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='da04aaa8143b44d5aa21f59a89cd57ee',ramdisk_id='',reservation_id='r-mdxab4hw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-836718209',owner_user_name='tempest-AttachVolumeShelveTestJSON-836718209-project-member',shelved_at='2023-08-01T19:58:59.286128',shelved_host='user',shelved_image_id='dfbbb5cd-aae2-4264-aefd-8b44817a474c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:00:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6260679430fa4828b07bc890c62878c3',uuid=6377103d-7606-4a5d-a905-6b1439e52c93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "address": "fa:16:3e:3e:71:62", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9af0b4bf-bc", "ovs_interfaceid": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Converting VIF {"id": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "address": "fa:16:3e:3e:71:62", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9af0b4bf-bc", "ovs_interfaceid": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:71:62,bridge_name='br-int',has_traffic_filtering=True,id=9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e,network=Network(40b3d49e-3592-411a-93d6-5a44019ef136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9af0b4bf-bc') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.objects.instance [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lazy-loading 'pci_devices' on Instance uuid 6377103d-7606-4a5d-a905-6b1439e52c93 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:00:55 user nova-compute[72504]:   <uuid>6377103d-7606-4a5d-a905-6b1439e52c93</uuid>
Aug 01 20:00:55 user nova-compute[72504]:   <name>instance-00000016</name>
Aug 01 20:00:55 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:00:55 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:00:55 user nova-compute[72504]:   <metadata>
Aug 01 20:00:55 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:00:55 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:00:55 user nova-compute[72504]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-166257871</nova:name>
Aug 01 20:00:55 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:00:55</nova:creationTime>
Aug 01 20:00:55 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:00:55 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:00:55 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:00:55 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:00:55 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:00:55 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:00:55 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:00:55 user nova-compute[72504]:       <nova:owner>
Aug 01 20:00:55 user nova-compute[72504]:         <nova:user uuid="6260679430fa4828b07bc890c62878c3">tempest-AttachVolumeShelveTestJSON-836718209-project-member</nova:user>
Aug 01 20:00:55 user nova-compute[72504]:         <nova:project uuid="da04aaa8143b44d5aa21f59a89cd57ee">tempest-AttachVolumeShelveTestJSON-836718209</nova:project>
Aug 01 20:00:55 user nova-compute[72504]:       </nova:owner>
Aug 01 20:00:55 user nova-compute[72504]:       <nova:root type="image" uuid="dfbbb5cd-aae2-4264-aefd-8b44817a474c"/>
Aug 01 20:00:55 user nova-compute[72504]:       <nova:ports>
Aug 01 20:00:55 user nova-compute[72504]:         <nova:port uuid="9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e">
Aug 01 20:00:55 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 20:00:55 user nova-compute[72504]:         </nova:port>
Aug 01 20:00:55 user nova-compute[72504]:       </nova:ports>
Aug 01 20:00:55 user nova-compute[72504]:     </nova:instance>
Aug 01 20:00:55 user nova-compute[72504]:   </metadata>
Aug 01 20:00:55 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:00:55 user nova-compute[72504]:     <system>
Aug 01 20:00:55 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:00:55 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:00:55 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:00:55 user nova-compute[72504]:       <entry name="serial">6377103d-7606-4a5d-a905-6b1439e52c93</entry>
Aug 01 20:00:55 user nova-compute[72504]:       <entry name="uuid">6377103d-7606-4a5d-a905-6b1439e52c93</entry>
Aug 01 20:00:55 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:00:55 user nova-compute[72504]:     </system>
Aug 01 20:00:55 user nova-compute[72504]:   </sysinfo>
Aug 01 20:00:55 user nova-compute[72504]:   <os>
Aug 01 20:00:55 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:00:55 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:00:55 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:00:55 user nova-compute[72504]:   </os>
Aug 01 20:00:55 user nova-compute[72504]:   <features>
Aug 01 20:00:55 user nova-compute[72504]:     <acpi/>
Aug 01 20:00:55 user nova-compute[72504]:     <apic/>
Aug 01 20:00:55 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:00:55 user nova-compute[72504]:   </features>
Aug 01 20:00:55 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:00:55 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:00:55 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:00:55 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:00:55 user nova-compute[72504]:   </clock>
Aug 01 20:00:55 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:00:55 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:00:55 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:00:55 user nova-compute[72504]:   </cpu>
Aug 01 20:00:55 user nova-compute[72504]:   <devices>
Aug 01 20:00:55 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 20:00:55 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 20:00:55 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk"/>
Aug 01 20:00:55 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:00:55 user nova-compute[72504]:     </disk>
Aug 01 20:00:55 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:00:55 user nova-compute[72504]:       <mac address="fa:16:3e:3e:71:62"/>
Aug 01 20:00:55 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:00:55 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:00:55 user nova-compute[72504]:       <target dev="tap9af0b4bf-bc"/>
Aug 01 20:00:55 user nova-compute[72504]:     </interface>
Aug 01 20:00:55 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:00:55 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/console.log" append="off"/>
Aug 01 20:00:55 user nova-compute[72504]:     </serial>
Aug 01 20:00:55 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:00:55 user nova-compute[72504]:     <video>
Aug 01 20:00:55 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:00:55 user nova-compute[72504]:     </video>
Aug 01 20:00:55 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:00:55 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:00:55 user nova-compute[72504]:     </rng>
Aug 01 20:00:55 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:00:55 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:00:55 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:00:55 user nova-compute[72504]:     </memballoon>
Aug 01 20:00:55 user nova-compute[72504]:   </devices>
Aug 01 20:00:55 user nova-compute[72504]: </domain>
Aug 01 20:00:55 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T19:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-166257871',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-166257871',id=22,image_ref='dfbbb5cd-aae2-4264-aefd-8b44817a474c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1753450990',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:57:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='da04aaa8143b44d5aa21f59a89cd57ee',ramdisk_id='',reservation_id='r-mdxab4hw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-836718209',owner_user_name='tempest-AttachVolumeShelveTestJSON-836718209-project-member',shelved_at='2023-08-01T19:58:59.286128',shelved_host='user',shelved_image_id='dfbbb5cd-aae2-4264-aefd-8b44817a474c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:00:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6260679430fa4828b07bc890c62878c3',uuid=6377103d-7606-4a5d-a905-6b1439e52c93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "address": "fa:16:3e:3e:71:62", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9af0b4bf-bc", "ovs_interfaceid": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Converting VIF {"id": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "address": "fa:16:3e:3e:71:62", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9af0b4bf-bc", "ovs_interfaceid": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:71:62,bridge_name='br-int',has_traffic_filtering=True,id=9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e,network=Network(40b3d49e-3592-411a-93d6-5a44019ef136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9af0b4bf-bc') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG os_vif [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:71:62,bridge_name='br-int',has_traffic_filtering=True,id=9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e,network=Network(40b3d49e-3592-411a-93d6-5a44019ef136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9af0b4bf-bc') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9af0b4bf-bc, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9af0b4bf-bc, col_values=(('external_ids', {'iface-id': '9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:71:62', 'vm-uuid': '6377103d-7606-4a5d-a905-6b1439e52c93'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:55 user nova-compute[72504]: INFO os_vif [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:71:62,bridge_name='br-int',has_traffic_filtering=True,id=9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e,network=Network(40b3d49e-3592-411a-93d6-5a44019ef136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9af0b4bf-bc')
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:00:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] No VIF found with MAC fa:16:3e:3e:71:62, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:00:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:56 user nova-compute[72504]: DEBUG nova.compute.manager [req-d3ae144a-549c-4c33-bff5-45a6c44f2267 req-3148d0f4-e7a4-47a9-98bc-464f19b95629 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received event network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:00:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d3ae144a-549c-4c33-bff5-45a6c44f2267 req-3148d0f4-e7a4-47a9-98bc-464f19b95629 service nova] Acquiring lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d3ae144a-549c-4c33-bff5-45a6c44f2267 req-3148d0f4-e7a4-47a9-98bc-464f19b95629 service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d3ae144a-549c-4c33-bff5-45a6c44f2267 req-3148d0f4-e7a4-47a9-98bc-464f19b95629 service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:56 user nova-compute[72504]: DEBUG nova.compute.manager [req-d3ae144a-549c-4c33-bff5-45a6c44f2267 req-3148d0f4-e7a4-47a9-98bc-464f19b95629 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] No waiting events found dispatching network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:00:56 user nova-compute[72504]: WARNING nova.compute.manager [req-d3ae144a-549c-4c33-bff5-45a6c44f2267 req-3148d0f4-e7a4-47a9-98bc-464f19b95629 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received unexpected event network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 20:00:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2c2fdaa2-abe7-4172-88a4-ddb2e730b920 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Acquiring lock "d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2c2fdaa2-abe7-4172-88a4-ddb2e730b920 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2c2fdaa2-abe7-4172-88a4-ddb2e730b920 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Acquiring lock "d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2c2fdaa2-abe7-4172-88a4-ddb2e730b920 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2c2fdaa2-abe7-4172-88a4-ddb2e730b920 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:58 user nova-compute[72504]: INFO nova.compute.manager [None req-2c2fdaa2-abe7-4172-88a4-ddb2e730b920 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Terminating instance
Aug 01 20:00:58 user nova-compute[72504]: DEBUG nova.compute.manager [None req-2c2fdaa2-abe7-4172-88a4-ddb2e730b920 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:00:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:58 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920058.9366717, 6377103d-7606-4a5d-a905-6b1439e52c93 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:00:58 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] VM Resumed (Lifecycle Event)
Aug 01 20:00:58 user nova-compute[72504]: DEBUG nova.compute.manager [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:00:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:00:58 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Instance spawned successfully.
Aug 01 20:00:58 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:00:58 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:00:59 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:00:59 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920058.940261, 6377103d-7606-4a5d-a905-6b1439e52c93 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:00:59 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] VM Started (Lifecycle Event)
Aug 01 20:00:59 user nova-compute[72504]: DEBUG nova.compute.manager [req-ebde4899-ff06-433b-ac58-f07caabf2a51 req-612e84fe-2237-4c00-89aa-9399362e1ab6 service nova] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Received event network-vif-unplugged-1ae5b451-36d3-474b-b576-26b42d8dbb6d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ebde4899-ff06-433b-ac58-f07caabf2a51 req-612e84fe-2237-4c00-89aa-9399362e1ab6 service nova] Acquiring lock "d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ebde4899-ff06-433b-ac58-f07caabf2a51 req-612e84fe-2237-4c00-89aa-9399362e1ab6 service nova] Lock "d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ebde4899-ff06-433b-ac58-f07caabf2a51 req-612e84fe-2237-4c00-89aa-9399362e1ab6 service nova] Lock "d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG nova.compute.manager [req-ebde4899-ff06-433b-ac58-f07caabf2a51 req-612e84fe-2237-4c00-89aa-9399362e1ab6 service nova] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] No waiting events found dispatching network-vif-unplugged-1ae5b451-36d3-474b-b576-26b42d8dbb6d {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG nova.compute.manager [req-ebde4899-ff06-433b-ac58-f07caabf2a51 req-612e84fe-2237-4c00-89aa-9399362e1ab6 service nova] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Received event network-vif-unplugged-1ae5b451-36d3-474b-b576-26b42d8dbb6d for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG nova.compute.manager [req-0f6fec55-fea0-4db1-923c-d32c07452d36 req-7633fb70-b26a-4b8f-aa28-81e0726dd05e service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received event network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0f6fec55-fea0-4db1-923c-d32c07452d36 req-7633fb70-b26a-4b8f-aa28-81e0726dd05e service nova] Acquiring lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0f6fec55-fea0-4db1-923c-d32c07452d36 req-7633fb70-b26a-4b8f-aa28-81e0726dd05e service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0f6fec55-fea0-4db1-923c-d32c07452d36 req-7633fb70-b26a-4b8f-aa28-81e0726dd05e service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG nova.compute.manager [req-0f6fec55-fea0-4db1-923c-d32c07452d36 req-7633fb70-b26a-4b8f-aa28-81e0726dd05e service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] No waiting events found dispatching network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:00:59 user nova-compute[72504]: WARNING nova.compute.manager [req-0f6fec55-fea0-4db1-923c-d32c07452d36 req-7633fb70-b26a-4b8f-aa28-81e0726dd05e service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received unexpected event network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 20:00:59 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:00:59 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:00:59 user nova-compute[72504]: DEBUG nova.compute.manager [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ff3e7a3f-b80d-43fd-b421-7a1ae7816d75 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "6377103d-7606-4a5d-a905-6b1439e52c93" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.570s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:00:59 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Instance destroyed successfully.
Aug 01 20:00:59 user nova-compute[72504]: DEBUG nova.objects.instance [None req-2c2fdaa2-abe7-4172-88a4-ddb2e730b920 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lazy-loading 'resources' on Instance uuid d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-2c2fdaa2-abe7-4172-88a4-ddb2e730b920 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:54:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-368818763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-368818763',id=17,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQCD+zOzDrd1/CCpM6oSIMgSHsBflnqyFlcd8fKpthsdAbVFpTofSu3G34nwV4VW+3QK6NYd0lmqH2X7kyYik3VPR8N9fNexhWmS0Q3ij+8T7bAbFUZwST+7wOwH0oY7g==',key_name='tempest-keypair-1838146836',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:54:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9540d878e5ea4bfda3d342e5a78035f5',ramdisk_id='',reservation_id='r-599zglgv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2015428092',owner_user_name='tempest-ServerActionsV293TestJSON-2015428092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97ef13eef2a345909187312f5a62e0f6',uuid=d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ae5b451-36d3-474b-b576-26b42d8dbb6d", "address": "fa:16:3e:9d:e3:8f", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae5b451-36", "ovs_interfaceid": "1ae5b451-36d3-474b-b576-26b42d8dbb6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-2c2fdaa2-abe7-4172-88a4-ddb2e730b920 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Converting VIF {"id": "1ae5b451-36d3-474b-b576-26b42d8dbb6d", "address": "fa:16:3e:9d:e3:8f", "network": {"id": "d4da5ad8-9045-4076-9f31-ea9faaf8e6b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-619232003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9540d878e5ea4bfda3d342e5a78035f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae5b451-36", "ovs_interfaceid": "1ae5b451-36d3-474b-b576-26b42d8dbb6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-2c2fdaa2-abe7-4172-88a4-ddb2e730b920 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:e3:8f,bridge_name='br-int',has_traffic_filtering=True,id=1ae5b451-36d3-474b-b576-26b42d8dbb6d,network=Network(d4da5ad8-9045-4076-9f31-ea9faaf8e6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ae5b451-36') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG os_vif [None req-2c2fdaa2-abe7-4172-88a4-ddb2e730b920 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:e3:8f,bridge_name='br-int',has_traffic_filtering=True,id=1ae5b451-36d3-474b-b576-26b42d8dbb6d,network=Network(d4da5ad8-9045-4076-9f31-ea9faaf8e6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ae5b451-36') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ae5b451-36, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:00:59 user nova-compute[72504]: INFO os_vif [None req-2c2fdaa2-abe7-4172-88a4-ddb2e730b920 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:e3:8f,bridge_name='br-int',has_traffic_filtering=True,id=1ae5b451-36d3-474b-b576-26b42d8dbb6d,network=Network(d4da5ad8-9045-4076-9f31-ea9faaf8e6b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ae5b451-36')
Aug 01 20:00:59 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-2c2fdaa2-abe7-4172-88a4-ddb2e730b920 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Deleting instance files /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd_del
Aug 01 20:00:59 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-2c2fdaa2-abe7-4172-88a4-ddb2e730b920 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Deletion of /opt/stack/data/nova/instances/d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd_del complete
Aug 01 20:00:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "a53847a9-5dfc-422b-ba06-617dda589042" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "a53847a9-5dfc-422b-ba06-617dda589042" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:59 user nova-compute[72504]: INFO nova.compute.manager [None req-2c2fdaa2-abe7-4172-88a4-ddb2e730b920 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 01 20:00:59 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-2c2fdaa2-abe7-4172-88a4-ddb2e730b920 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:00:59 user nova-compute[72504]: INFO nova.compute.claims [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Claim successful on node user
Aug 01 20:00:59 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Refreshing inventories for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Updating ProviderTree inventory for provider b951a798-e88c-472c-8347-2c5f6a05d47c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Updating inventory in ProviderTree for provider b951a798-e88c-472c-8347-2c5f6a05d47c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Refreshing aggregate associations for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c, aggregates: None {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 20:00:59 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Refreshing trait associations for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c, traits: HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 20:01:00 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:01:00 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:01:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.558s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:01:00 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 20:01:00 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 20:01:00 user nova-compute[72504]: DEBUG nova.network.neutron [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 20:01:00 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 20:01:00 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 20:01:00 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:01:00 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Took 0.95 seconds to deallocate network for instance.
Aug 01 20:01:00 user nova-compute[72504]: INFO nova.virt.block_device [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Booting with volume-backed-image 3f5e9e2d-95fb-46b2-b205-6c41a2b0b089 at /dev/vda
Aug 01 20:01:00 user nova-compute[72504]: DEBUG nova.policy [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01263cb2c1874026be1c735abc966b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82898c99bce4f04afda7e9ff6e4d5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 20:01:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2c2fdaa2-abe7-4172-88a4-ddb2e730b920 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:01:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2c2fdaa2-abe7-4172-88a4-ddb2e730b920 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:01:00 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-2c2fdaa2-abe7-4172-88a4-ddb2e730b920 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:01:00 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-2c2fdaa2-abe7-4172-88a4-ddb2e730b920 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:01:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2c2fdaa2-abe7-4172-88a4-ddb2e730b920 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:01:00 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-2c2fdaa2-abe7-4172-88a4-ddb2e730b920 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Deleted allocations for instance d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd
Aug 01 20:01:01 user nova-compute[72504]: DEBUG nova.compute.manager [req-03f80156-dd36-4df9-8400-7ac7304f471d req-d755a406-9a14-4099-a680-f594a7ad8583 service nova] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Received event network-vif-deleted-1ae5b451-36d3-474b-b576-26b42d8dbb6d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:01:01 user nova-compute[72504]: DEBUG nova.compute.manager [req-b801c289-a357-400b-a233-72f801951baa req-52710ad3-9963-4d21-919b-e1626e85f83b service nova] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Received event network-vif-plugged-1ae5b451-36d3-474b-b576-26b42d8dbb6d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:01:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b801c289-a357-400b-a233-72f801951baa req-52710ad3-9963-4d21-919b-e1626e85f83b service nova] Acquiring lock "d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:01:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b801c289-a357-400b-a233-72f801951baa req-52710ad3-9963-4d21-919b-e1626e85f83b service nova] Lock "d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:01:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b801c289-a357-400b-a233-72f801951baa req-52710ad3-9963-4d21-919b-e1626e85f83b service nova] Lock "d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:01:01 user nova-compute[72504]: DEBUG nova.compute.manager [req-b801c289-a357-400b-a233-72f801951baa req-52710ad3-9963-4d21-919b-e1626e85f83b service nova] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] No waiting events found dispatching network-vif-plugged-1ae5b451-36d3-474b-b576-26b42d8dbb6d {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:01:01 user nova-compute[72504]: WARNING nova.compute.manager [req-b801c289-a357-400b-a233-72f801951baa req-52710ad3-9963-4d21-919b-e1626e85f83b service nova] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Received unexpected event network-vif-plugged-1ae5b451-36d3-474b-b576-26b42d8dbb6d for instance with vm_state deleted and task_state None.
Aug 01 20:01:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2c2fdaa2-abe7-4172-88a4-ddb2e730b920 tempest-ServerActionsV293TestJSON-2015428092 tempest-ServerActionsV293TestJSON-2015428092-project-member] Lock "d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.454s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:01:02 user nova-compute[72504]: DEBUG nova.network.neutron [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Successfully created port: 48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 20:01:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:03 user nova-compute[72504]: DEBUG nova.network.neutron [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Successfully updated port: 48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 20:01:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "refresh_cache-a53847a9-5dfc-422b-ba06-617dda589042" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:01:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquired lock "refresh_cache-a53847a9-5dfc-422b-ba06-617dda589042" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:01:03 user nova-compute[72504]: DEBUG nova.network.neutron [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:01:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-8467988e-a62d-43fa-a6bf-856ecbf74dea req-007d50d4-93fe-40fe-86e4-d1d490a22125 service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Received event network-changed-48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:01:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-8467988e-a62d-43fa-a6bf-856ecbf74dea req-007d50d4-93fe-40fe-86e4-d1d490a22125 service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Refreshing instance network info cache due to event network-changed-48c8fc49-f988-42f1-8275-836370d6a5a8. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:01:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-8467988e-a62d-43fa-a6bf-856ecbf74dea req-007d50d4-93fe-40fe-86e4-d1d490a22125 service nova] Acquiring lock "refresh_cache-a53847a9-5dfc-422b-ba06-617dda589042" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:01:03 user nova-compute[72504]: DEBUG nova.network.neutron [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:01:03 user nova-compute[72504]: DEBUG nova.network.neutron [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Updating instance_info_cache with network_info: [{"id": "48c8fc49-f988-42f1-8275-836370d6a5a8", "address": "fa:16:3e:c4:fb:c8", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c8fc49-f9", "ovs_interfaceid": "48c8fc49-f988-42f1-8275-836370d6a5a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:01:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Releasing lock "refresh_cache-a53847a9-5dfc-422b-ba06-617dda589042" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:01:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Instance network_info: |[{"id": "48c8fc49-f988-42f1-8275-836370d6a5a8", "address": "fa:16:3e:c4:fb:c8", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c8fc49-f9", "ovs_interfaceid": "48c8fc49-f988-42f1-8275-836370d6a5a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 20:01:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-8467988e-a62d-43fa-a6bf-856ecbf74dea req-007d50d4-93fe-40fe-86e4-d1d490a22125 service nova] Acquired lock "refresh_cache-a53847a9-5dfc-422b-ba06-617dda589042" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:01:03 user nova-compute[72504]: DEBUG nova.network.neutron [req-8467988e-a62d-43fa-a6bf-856ecbf74dea req-007d50d4-93fe-40fe-86e4-d1d490a22125 service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Refreshing network info cache for port 48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:01:04 user nova-compute[72504]: DEBUG nova.network.neutron [req-8467988e-a62d-43fa-a6bf-856ecbf74dea req-007d50d4-93fe-40fe-86e4-d1d490a22125 service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Updated VIF entry in instance network info cache for port 48c8fc49-f988-42f1-8275-836370d6a5a8. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:01:04 user nova-compute[72504]: DEBUG nova.network.neutron [req-8467988e-a62d-43fa-a6bf-856ecbf74dea req-007d50d4-93fe-40fe-86e4-d1d490a22125 service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Updating instance_info_cache with network_info: [{"id": "48c8fc49-f988-42f1-8275-836370d6a5a8", "address": "fa:16:3e:c4:fb:c8", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c8fc49-f9", "ovs_interfaceid": "48c8fc49-f988-42f1-8275-836370d6a5a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:01:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-8467988e-a62d-43fa-a6bf-856ecbf74dea req-007d50d4-93fe-40fe-86e4-d1d490a22125 service nova] Releasing lock "refresh_cache-a53847a9-5dfc-422b-ba06-617dda589042" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:01:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:11 user nova-compute[72504]: DEBUG os_brick.utils [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:01:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da1bfc3-5a03-454e-b7c0-7ba86a5f1296]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a89217b-aaaa-4078-bdb3-b8e41e65d2e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d95ba93-6fee-4ce4-b2f6-773ba9a1ba34]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3693ce6f-a151-49ca-a141-60873e784a8d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:01:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:01:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:01:11 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:01:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c1f3d4-5d53-4371-b919-2cce6195228c]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:01:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:01:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:01:11 user nova-compute[72504]: DEBUG os_brick.utils [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:01:11 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Updating existing volume attachment record: 962f606f-7492-4030-a609-e051d41665a9 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:01:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:14 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690920059.447191, d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:01:14 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] VM Stopped (Lifecycle Event)
Aug 01 20:01:14 user nova-compute[72504]: DEBUG nova.compute.manager [None req-a838fd55-d58e-49e5-b79d-9bc7e5e47799 None None] [instance: d11f4be8-6b26-43b6-9a49-02f6f9dc6bcd] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:01:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:18 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:01:18 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:01:19 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Creating image(s)
Aug 01 20:01:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Did not create local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Ensure instance console log exists: /opt/stack/data/nova/instances/a53847a9-5dfc-422b-ba06-617dda589042/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Start _get_guest_xml network_info=[{"id": "48c8fc49-f988-42f1-8275-836370d6a5a8", "address": "fa:16:3e:c4:fb:c8", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c8fc49-f9", "ovs_interfaceid": "48c8fc49-f988-42f1-8275-836370d6a5a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iLjMVGKq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a53847a9-5dfc-422b-ba06-617dda589042', 'attached_at': '', 'detached_at': '', 'volume_id': 'd37f13f6-502e-4e2e-a386-9a7d3ec020f1', 'serial': 'd37f13f6-502e-4e2e-a386-9a7d3ec020f1'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': '962f606f-7492-4030-a609-e051d41665a9', 'volume_type': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:01:19 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:01:19 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:01:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iLjMVGKq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:01:19 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:01:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:01:19 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:01:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:01:19 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ca06db-2ce2-4dbe-9259-7893a3e71a03]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:01:19 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbb5401-a614-448a-97a5-8672360d0b6c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1] added
Aug 01 20:01:19 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a242197-9884-4abf-b938-c7969af71659]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[787ddd04-eebb-42b2-b389-92f0176f57a0]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iLjMVGKq {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iLjMVGKq" returned: 0 in 0.027s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[85febc80-b832-4494-b1d2-344721024fcd]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iLjMVGKq'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[727c1755-cee6-47a4-bc1e-62eaf49bdcd1]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a8437f-5eb7-473c-88e6-5b652e2ee243]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:01:19 user nova-compute[72504]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 (non-flash)
Aug 01 20:01:19 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:01:19 user nova-compute[72504]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 (non-flash)
Aug 01 20:01:19 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b89e770-3b55-4ec0-af9b-346dc4342f1b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1, portal: 172.16.0.220,3260]
Aug 01 20:01:19 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1, portal: 172.16.0.220,3260] successful.
Aug 01 20:01:19 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69f0c68-3d35-45da-884b-3c011ab20bc6]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[155d4aed-1545-4e81-bf0a-917e9beb133e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:01:19 user nova-compute[72504]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 (non-flash)
Aug 01 20:01:19 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:01:19 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:01:19 user nova-compute[72504]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 (non-flash)
Aug 01 20:01:19 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:01:19 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8b791e-708c-4906-b7fa-c6bdee5dddbb]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: None {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:01:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:20 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:01:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iLjMVGKq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:01:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:01:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23033343862616530', 'path': '/dev/sdd'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:01:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033343862616530', 'path': '/dev/sdd'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:01:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:00:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1477817368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1477817368',id=27,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b82898c99bce4f04afda7e9ff6e4d5db',ramdisk_id='',reservation_id='r-0ous9rfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-519115368',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:01:01Z,user_data=None,user_id='01263cb2c1874026be1c735abc966b45',uuid=a53847a9-5dfc-422b-ba06-617dda589042,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48c8fc49-f988-42f1-8275-836370d6a5a8", "address": "fa:16:3e:c4:fb:c8", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c8fc49-f9", "ovs_interfaceid": "48c8fc49-f988-42f1-8275-836370d6a5a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:01:20 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Converting VIF {"id": "48c8fc49-f988-42f1-8275-836370d6a5a8", "address": "fa:16:3e:c4:fb:c8", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c8fc49-f9", "ovs_interfaceid": "48c8fc49-f988-42f1-8275-836370d6a5a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:01:20 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:fb:c8,bridge_name='br-int',has_traffic_filtering=True,id=48c8fc49-f988-42f1-8275-836370d6a5a8,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c8fc49-f9') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:01:20 user nova-compute[72504]: DEBUG nova.objects.instance [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lazy-loading 'pci_devices' on Instance uuid a53847a9-5dfc-422b-ba06-617dda589042 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:01:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:01:20 user nova-compute[72504]:   <uuid>a53847a9-5dfc-422b-ba06-617dda589042</uuid>
Aug 01 20:01:20 user nova-compute[72504]:   <name>instance-0000001b</name>
Aug 01 20:01:20 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:01:20 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:01:20 user nova-compute[72504]:   <metadata>
Aug 01 20:01:20 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:01:20 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:01:20 user nova-compute[72504]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1477817368</nova:name>
Aug 01 20:01:20 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:01:19</nova:creationTime>
Aug 01 20:01:20 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:01:20 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:01:20 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:01:20 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:01:20 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:01:20 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:01:20 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:01:20 user nova-compute[72504]:       <nova:owner>
Aug 01 20:01:20 user nova-compute[72504]:         <nova:user uuid="01263cb2c1874026be1c735abc966b45">tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member</nova:user>
Aug 01 20:01:20 user nova-compute[72504]:         <nova:project uuid="b82898c99bce4f04afda7e9ff6e4d5db">tempest-ServerBootFromVolumeStableRescueTest-519115368</nova:project>
Aug 01 20:01:20 user nova-compute[72504]:       </nova:owner>
Aug 01 20:01:20 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 20:01:20 user nova-compute[72504]:       <nova:ports>
Aug 01 20:01:20 user nova-compute[72504]:         <nova:port uuid="48c8fc49-f988-42f1-8275-836370d6a5a8">
Aug 01 20:01:20 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 20:01:20 user nova-compute[72504]:         </nova:port>
Aug 01 20:01:20 user nova-compute[72504]:       </nova:ports>
Aug 01 20:01:20 user nova-compute[72504]:     </nova:instance>
Aug 01 20:01:20 user nova-compute[72504]:   </metadata>
Aug 01 20:01:20 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:01:20 user nova-compute[72504]:     <system>
Aug 01 20:01:20 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:01:20 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:01:20 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:01:20 user nova-compute[72504]:       <entry name="serial">a53847a9-5dfc-422b-ba06-617dda589042</entry>
Aug 01 20:01:20 user nova-compute[72504]:       <entry name="uuid">a53847a9-5dfc-422b-ba06-617dda589042</entry>
Aug 01 20:01:20 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:01:20 user nova-compute[72504]:     </system>
Aug 01 20:01:20 user nova-compute[72504]:   </sysinfo>
Aug 01 20:01:20 user nova-compute[72504]:   <os>
Aug 01 20:01:20 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:01:20 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:01:20 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:01:20 user nova-compute[72504]:   </os>
Aug 01 20:01:20 user nova-compute[72504]:   <features>
Aug 01 20:01:20 user nova-compute[72504]:     <acpi/>
Aug 01 20:01:20 user nova-compute[72504]:     <apic/>
Aug 01 20:01:20 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:01:20 user nova-compute[72504]:   </features>
Aug 01 20:01:20 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:01:20 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:01:20 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:01:20 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:01:20 user nova-compute[72504]:   </clock>
Aug 01 20:01:20 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:01:20 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:01:20 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:01:20 user nova-compute[72504]:   </cpu>
Aug 01 20:01:20 user nova-compute[72504]:   <devices>
Aug 01 20:01:20 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 20:01:20 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:01:20 user nova-compute[72504]:       <source dev="/dev/sdd"/>
Aug 01 20:01:20 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:01:20 user nova-compute[72504]:       <serial>d37f13f6-502e-4e2e-a386-9a7d3ec020f1</serial>
Aug 01 20:01:20 user nova-compute[72504]:     </disk>
Aug 01 20:01:20 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:01:20 user nova-compute[72504]:       <mac address="fa:16:3e:c4:fb:c8"/>
Aug 01 20:01:20 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:01:20 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:01:20 user nova-compute[72504]:       <target dev="tap48c8fc49-f9"/>
Aug 01 20:01:20 user nova-compute[72504]:     </interface>
Aug 01 20:01:20 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:01:20 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/a53847a9-5dfc-422b-ba06-617dda589042/console.log" append="off"/>
Aug 01 20:01:20 user nova-compute[72504]:     </serial>
Aug 01 20:01:20 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:01:20 user nova-compute[72504]:     <video>
Aug 01 20:01:20 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:01:20 user nova-compute[72504]:     </video>
Aug 01 20:01:20 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:01:20 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:01:20 user nova-compute[72504]:     </rng>
Aug 01 20:01:20 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:01:20 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:01:20 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:01:20 user nova-compute[72504]:     </memballoon>
Aug 01 20:01:20 user nova-compute[72504]:   </devices>
Aug 01 20:01:20 user nova-compute[72504]: </domain>
Aug 01 20:01:20 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:01:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:00:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1477817368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1477817368',id=27,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b82898c99bce4f04afda7e9ff6e4d5db',ramdisk_id='',reservation_id='r-0ous9rfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-519115368',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:01:01Z,user_data=None,user_id='01263cb2c1874026be1c735abc966b45',uuid=a53847a9-5dfc-422b-ba06-617dda589042,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48c8fc49-f988-42f1-8275-836370d6a5a8", "address": "fa:16:3e:c4:fb:c8", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c8fc49-f9", "ovs_interfaceid": "48c8fc49-f988-42f1-8275-836370d6a5a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:01:20 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Converting VIF {"id": "48c8fc49-f988-42f1-8275-836370d6a5a8", "address": "fa:16:3e:c4:fb:c8", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c8fc49-f9", "ovs_interfaceid": "48c8fc49-f988-42f1-8275-836370d6a5a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:01:20 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:fb:c8,bridge_name='br-int',has_traffic_filtering=True,id=48c8fc49-f988-42f1-8275-836370d6a5a8,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c8fc49-f9') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:01:20 user nova-compute[72504]: DEBUG os_vif [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:fb:c8,bridge_name='br-int',has_traffic_filtering=True,id=48c8fc49-f988-42f1-8275-836370d6a5a8,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c8fc49-f9') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:01:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:01:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:01:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48c8fc49-f9, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:01:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap48c8fc49-f9, col_values=(('external_ids', {'iface-id': '48c8fc49-f988-42f1-8275-836370d6a5a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:fb:c8', 'vm-uuid': 'a53847a9-5dfc-422b-ba06-617dda589042'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:01:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:01:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:20 user nova-compute[72504]: INFO os_vif [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:fb:c8,bridge_name='br-int',has_traffic_filtering=True,id=48c8fc49-f988-42f1-8275-836370d6a5a8,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c8fc49-f9')
Aug 01 20:01:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:01:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] No VIF found with MAC fa:16:3e:c4:fb:c8, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:01:21 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:01:21 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:01:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:22 user nova-compute[72504]: DEBUG nova.compute.manager [req-65aa2ff9-7b12-4f4a-bbc4-4cfc916ae206 req-dfd39a9c-2ba7-4174-a3ef-9b4636319e1e service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Received event network-vif-plugged-48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:01:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-65aa2ff9-7b12-4f4a-bbc4-4cfc916ae206 req-dfd39a9c-2ba7-4174-a3ef-9b4636319e1e service nova] Acquiring lock "a53847a9-5dfc-422b-ba06-617dda589042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:01:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-65aa2ff9-7b12-4f4a-bbc4-4cfc916ae206 req-dfd39a9c-2ba7-4174-a3ef-9b4636319e1e service nova] Lock "a53847a9-5dfc-422b-ba06-617dda589042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:01:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-65aa2ff9-7b12-4f4a-bbc4-4cfc916ae206 req-dfd39a9c-2ba7-4174-a3ef-9b4636319e1e service nova] Lock "a53847a9-5dfc-422b-ba06-617dda589042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:01:22 user nova-compute[72504]: DEBUG nova.compute.manager [req-65aa2ff9-7b12-4f4a-bbc4-4cfc916ae206 req-dfd39a9c-2ba7-4174-a3ef-9b4636319e1e service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] No waiting events found dispatching network-vif-plugged-48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:01:22 user nova-compute[72504]: WARNING nova.compute.manager [req-65aa2ff9-7b12-4f4a-bbc4-4cfc916ae206 req-dfd39a9c-2ba7-4174-a3ef-9b4636319e1e service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Received unexpected event network-vif-plugged-48c8fc49-f988-42f1-8275-836370d6a5a8 for instance with vm_state building and task_state spawning.
Aug 01 20:01:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:22 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:01:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:23 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:01:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:01:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:01:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:01:23 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920084.0242198, a53847a9-5dfc-422b-ba06-617dda589042 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:01:24 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a53847a9-5dfc-422b-ba06-617dda589042] VM Resumed (Lifecycle Event)
Aug 01 20:01:24 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:01:24 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Instance spawned successfully.
Aug 01 20:01:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:01:24 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a53847a9-5dfc-422b-ba06-617dda589042] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:01:24 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920084.0254016, a53847a9-5dfc-422b-ba06-617dda589042 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:01:24 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a53847a9-5dfc-422b-ba06-617dda589042] VM Started (Lifecycle Event)
Aug 01 20:01:24 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:24 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a53847a9-5dfc-422b-ba06-617dda589042] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:01:24 user nova-compute[72504]: INFO nova.compute.manager [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Took 5.02 seconds to spawn the instance on the hypervisor.
Aug 01 20:01:24 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG nova.compute.manager [req-101364af-3d43-44fe-b1e7-b8b8b3d5061b req-7278909c-23d5-4c84-8961-d14990e8b251 service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Received event network-vif-plugged-48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-101364af-3d43-44fe-b1e7-b8b8b3d5061b req-7278909c-23d5-4c84-8961-d14990e8b251 service nova] Acquiring lock "a53847a9-5dfc-422b-ba06-617dda589042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-101364af-3d43-44fe-b1e7-b8b8b3d5061b req-7278909c-23d5-4c84-8961-d14990e8b251 service nova] Lock "a53847a9-5dfc-422b-ba06-617dda589042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-101364af-3d43-44fe-b1e7-b8b8b3d5061b req-7278909c-23d5-4c84-8961-d14990e8b251 service nova] Lock "a53847a9-5dfc-422b-ba06-617dda589042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG nova.compute.manager [req-101364af-3d43-44fe-b1e7-b8b8b3d5061b req-7278909c-23d5-4c84-8961-d14990e8b251 service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] No waiting events found dispatching network-vif-plugged-48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:01:24 user nova-compute[72504]: WARNING nova.compute.manager [req-101364af-3d43-44fe-b1e7-b8b8b3d5061b req-7278909c-23d5-4c84-8961-d14990e8b251 service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Received unexpected event network-vif-plugged-48c8fc49-f988-42f1-8275-836370d6a5a8 for instance with vm_state building and task_state spawning.
Aug 01 20:01:24 user nova-compute[72504]: INFO nova.compute.manager [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Took 24.69 seconds to build instance.
Aug 01 20:01:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3a2c24f4-7f58-435c-bc36-c19bf57a33cd tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "a53847a9-5dfc-422b-ba06-617dda589042" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.812s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:01:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:01:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:01:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/554ecd73-e393-4db1-9a8c-6749991dd44c/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/554ecd73-e393-4db1-9a8c-6749991dd44c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/554ecd73-e393-4db1-9a8c-6749991dd44c/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/554ecd73-e393-4db1-9a8c-6749991dd44c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:27 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:01:27 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:01:27 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=7650MB free_disk=25.164535522460938GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:01:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:01:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:01:27 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:01:27 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 7391a8ce-7ce5-47ec-97f6-6159645688ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:01:27 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:01:27 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 128c2981-363c-4ae9-b46d-15b5e5d9cac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:01:27 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 88f95d20-e391-4100-93b2-da29bfcf9704 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:01:27 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 54812de2-bfe3-46f1-a327-8081fbb80bec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:01:27 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:01:27 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 554ecd73-e393-4db1-9a8c-6749991dd44c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:01:27 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 6377103d-7606-4a5d-a905-6b1439e52c93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:01:27 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance a53847a9-5dfc-422b-ba06-617dda589042 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:01:27 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:01:27 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:01:27 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:01:27 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:01:27 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:01:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.479s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:01:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:29 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:01:29 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:01:29 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:01:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-88f95d20-e391-4100-93b2-da29bfcf9704" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:01:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-88f95d20-e391-4100-93b2-da29bfcf9704" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:01:29 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:01:30 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Updating instance_info_cache with network_info: [{"id": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "address": "fa:16:3e:c3:aa:1c", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a4ace30-3c", "ovs_interfaceid": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:01:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-88f95d20-e391-4100-93b2-da29bfcf9704" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:01:30 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:01:30 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:01:30 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:01:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:01:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:01:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:01:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:01:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:01:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:45 user nova-compute[72504]: DEBUG nova.compute.manager [req-d5833e77-e39a-4562-a8d3-fe5735ecb707 req-cee6825e-fbd5-454c-a911-a168d6e23c4e service nova] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Received event network-changed-8fc6472d-34da-4e77-ba88-4dfdbbb615eb {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:01:45 user nova-compute[72504]: DEBUG nova.compute.manager [req-d5833e77-e39a-4562-a8d3-fe5735ecb707 req-cee6825e-fbd5-454c-a911-a168d6e23c4e service nova] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Refreshing instance network info cache due to event network-changed-8fc6472d-34da-4e77-ba88-4dfdbbb615eb. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:01:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d5833e77-e39a-4562-a8d3-fe5735ecb707 req-cee6825e-fbd5-454c-a911-a168d6e23c4e service nova] Acquiring lock "refresh_cache-87d57e7a-e0d8-4f4d-8ad9-de46259a2161" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:01:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d5833e77-e39a-4562-a8d3-fe5735ecb707 req-cee6825e-fbd5-454c-a911-a168d6e23c4e service nova] Acquired lock "refresh_cache-87d57e7a-e0d8-4f4d-8ad9-de46259a2161" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:01:45 user nova-compute[72504]: DEBUG nova.network.neutron [req-d5833e77-e39a-4562-a8d3-fe5735ecb707 req-cee6825e-fbd5-454c-a911-a168d6e23c4e service nova] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Refreshing network info cache for port 8fc6472d-34da-4e77-ba88-4dfdbbb615eb {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:01:46 user nova-compute[72504]: DEBUG nova.network.neutron [req-d5833e77-e39a-4562-a8d3-fe5735ecb707 req-cee6825e-fbd5-454c-a911-a168d6e23c4e service nova] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Updated VIF entry in instance network info cache for port 8fc6472d-34da-4e77-ba88-4dfdbbb615eb. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:01:46 user nova-compute[72504]: DEBUG nova.network.neutron [req-d5833e77-e39a-4562-a8d3-fe5735ecb707 req-cee6825e-fbd5-454c-a911-a168d6e23c4e service nova] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Updating instance_info_cache with network_info: [{"id": "8fc6472d-34da-4e77-ba88-4dfdbbb615eb", "address": "fa:16:3e:45:db:12", "network": {"id": "1f06e326-e832-4d23-8b67-ab7568720b59", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1277548875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e853806cb434f6ba589f1c92227fdc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fc6472d-34", "ovs_interfaceid": "8fc6472d-34da-4e77-ba88-4dfdbbb615eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:01:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d5833e77-e39a-4562-a8d3-fe5735ecb707 req-cee6825e-fbd5-454c-a911-a168d6e23c4e service nova] Releasing lock "refresh_cache-87d57e7a-e0d8-4f4d-8ad9-de46259a2161" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:01:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:01:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:01:50 user nova-compute[72504]: DEBUG nova.objects.instance [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lazy-loading 'flavor' on Instance uuid 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:01:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:01:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:01:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:01:50 user nova-compute[72504]: INFO nova.compute.manager [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Attaching volume c5259bc8-1355-4150-b79a-1c08383fb32f to /dev/vdb
Aug 01 20:01:50 user nova-compute[72504]: DEBUG os_brick.utils [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:01:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:50 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2a6731-63cf-4a59-beaa-6df4c331979b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:50 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8274cf-2d78-42be-8a92-ba80ff458318]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:50 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[14dca602-486d-40f0-b343-9d79734f274f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:50 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[910303e5-4085-46cf-b804-fbdfd3d2117c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:01:50 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:01:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:51 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:01:51 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:01:51 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[858a5a2e-06c1-4928-a18f-27799b005730]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:51 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:01:51 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:01:51 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:01:51 user nova-compute[72504]: DEBUG os_brick.utils [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:01:51 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Updating existing volume attachment record: bc00da2a-7961-4b43-b4b9-e5a69c599f85 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:01:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:01:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:01:55 user nova-compute[72504]: DEBUG nova.compute.manager [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 20:01:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:01:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:01:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:01:55 user nova-compute[72504]: INFO nova.compute.claims [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Claim successful on node user
Aug 01 20:01:56 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:01:56 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:01:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:01:56 user nova-compute[72504]: DEBUG nova.compute.manager [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 20:01:56 user nova-compute[72504]: DEBUG nova.compute.manager [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 20:01:56 user nova-compute[72504]: DEBUG nova.network.neutron [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 20:01:56 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 20:01:56 user nova-compute[72504]: DEBUG nova.compute.manager [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 20:01:56 user nova-compute[72504]: DEBUG nova.policy [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be219e31095441269a1f140a77ad0d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274aed6773224c4fb534aac970d6bb34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 20:01:56 user nova-compute[72504]: DEBUG nova.compute.manager [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 20:01:56 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:01:56 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Creating image(s)
Aug 01 20:01:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "/opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:01:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "/opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:01:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "/opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:01:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.144s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:01:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:01:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.186s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk 1073741824" returned: 0 in 0.058s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:01:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.153s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:57 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 20:01:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:57 user nova-compute[72504]: DEBUG nova.network.neutron [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Successfully created port: 6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 20:01:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:57 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Cannot resize image /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 20:01:57 user nova-compute[72504]: DEBUG nova.objects.instance [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'migration_context' on Instance uuid e19bf04b-43e0-4153-a6b5-74dbe36fedb0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:01:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 20:01:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Ensure instance console log exists: /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:01:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:01:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:01:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:01:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.network.neutron [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Successfully updated port: 6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "refresh_cache-e19bf04b-43e0-4153-a6b5-74dbe36fedb0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquired lock "refresh_cache-e19bf04b-43e0-4153-a6b5-74dbe36fedb0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.network.neutron [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.compute.manager [req-cd8f9d94-0c51-4274-a43c-d6c51ab32b44 req-fedcf43d-5704-4240-82aa-90bffde81649 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received event network-changed-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.compute.manager [req-cd8f9d94-0c51-4274-a43c-d6c51ab32b44 req-fedcf43d-5704-4240-82aa-90bffde81649 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Refreshing instance network info cache due to event network-changed-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cd8f9d94-0c51-4274-a43c-d6c51ab32b44 req-fedcf43d-5704-4240-82aa-90bffde81649 service nova] Acquiring lock "refresh_cache-e19bf04b-43e0-4153-a6b5-74dbe36fedb0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.network.neutron [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.network.neutron [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Updating instance_info_cache with network_info: [{"id": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "address": "fa:16:3e:c2:53:7c", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d66fd17-3c", "ovs_interfaceid": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Releasing lock "refresh_cache-e19bf04b-43e0-4153-a6b5-74dbe36fedb0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.compute.manager [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Instance network_info: |[{"id": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "address": "fa:16:3e:c2:53:7c", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d66fd17-3c", "ovs_interfaceid": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cd8f9d94-0c51-4274-a43c-d6c51ab32b44 req-fedcf43d-5704-4240-82aa-90bffde81649 service nova] Acquired lock "refresh_cache-e19bf04b-43e0-4153-a6b5-74dbe36fedb0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.network.neutron [req-cd8f9d94-0c51-4274-a43c-d6c51ab32b44 req-fedcf43d-5704-4240-82aa-90bffde81649 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Refreshing network info cache for port 6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Start _get_guest_xml network_info=[{"id": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "address": "fa:16:3e:c2:53:7c", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d66fd17-3c", "ovs_interfaceid": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:01:58 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:01:58 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-858127926',display_name='tempest-ServerRescueNegativeTestJSON-server-858127926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-858127926',id=28,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAulB7xKrQ3iwNSG1rJvFE3+trA8hmdkFqfWEnv5agU7clcZsDlocF6bKk7yN97AViHaHy9lGlueRa4sqKvs59bCNJwiRRu0euW/6zYzligMJY09K4XGFq7Tvk8Z/XH+rQ==',key_name='tempest-keypair-1316147877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='274aed6773224c4fb534aac970d6bb34',ramdisk_id='',reservation_id='r-vx3ehgmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-897201375',owner_user_name='tempest-ServerRescueNegativeTestJSON-897201375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:01:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be219e31095441269a1f140a77ad0d57',uuid=e19bf04b-43e0-4153-a6b5-74dbe36fedb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "address": "fa:16:3e:c2:53:7c", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d66fd17-3c", "ovs_interfaceid": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Converting VIF {"id": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "address": "fa:16:3e:c2:53:7c", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d66fd17-3c", "ovs_interfaceid": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:53:7c,bridge_name='br-int',has_traffic_filtering=True,id=6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc,network=Network(9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d66fd17-3c') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.objects.instance [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'pci_devices' on Instance uuid e19bf04b-43e0-4153-a6b5-74dbe36fedb0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:01:58 user nova-compute[72504]:   <uuid>e19bf04b-43e0-4153-a6b5-74dbe36fedb0</uuid>
Aug 01 20:01:58 user nova-compute[72504]:   <name>instance-0000001c</name>
Aug 01 20:01:58 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:01:58 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:01:58 user nova-compute[72504]:   <metadata>
Aug 01 20:01:58 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:01:58 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:01:58 user nova-compute[72504]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-858127926</nova:name>
Aug 01 20:01:58 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:01:58</nova:creationTime>
Aug 01 20:01:58 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:01:58 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:01:58 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:01:58 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:01:58 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:01:58 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:01:58 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:01:58 user nova-compute[72504]:       <nova:owner>
Aug 01 20:01:58 user nova-compute[72504]:         <nova:user uuid="be219e31095441269a1f140a77ad0d57">tempest-ServerRescueNegativeTestJSON-897201375-project-member</nova:user>
Aug 01 20:01:58 user nova-compute[72504]:         <nova:project uuid="274aed6773224c4fb534aac970d6bb34">tempest-ServerRescueNegativeTestJSON-897201375</nova:project>
Aug 01 20:01:58 user nova-compute[72504]:       </nova:owner>
Aug 01 20:01:58 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 20:01:58 user nova-compute[72504]:       <nova:ports>
Aug 01 20:01:58 user nova-compute[72504]:         <nova:port uuid="6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc">
Aug 01 20:01:58 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 20:01:58 user nova-compute[72504]:         </nova:port>
Aug 01 20:01:58 user nova-compute[72504]:       </nova:ports>
Aug 01 20:01:58 user nova-compute[72504]:     </nova:instance>
Aug 01 20:01:58 user nova-compute[72504]:   </metadata>
Aug 01 20:01:58 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:01:58 user nova-compute[72504]:     <system>
Aug 01 20:01:58 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:01:58 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:01:58 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:01:58 user nova-compute[72504]:       <entry name="serial">e19bf04b-43e0-4153-a6b5-74dbe36fedb0</entry>
Aug 01 20:01:58 user nova-compute[72504]:       <entry name="uuid">e19bf04b-43e0-4153-a6b5-74dbe36fedb0</entry>
Aug 01 20:01:58 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:01:58 user nova-compute[72504]:     </system>
Aug 01 20:01:58 user nova-compute[72504]:   </sysinfo>
Aug 01 20:01:58 user nova-compute[72504]:   <os>
Aug 01 20:01:58 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:01:58 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:01:58 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:01:58 user nova-compute[72504]:   </os>
Aug 01 20:01:58 user nova-compute[72504]:   <features>
Aug 01 20:01:58 user nova-compute[72504]:     <acpi/>
Aug 01 20:01:58 user nova-compute[72504]:     <apic/>
Aug 01 20:01:58 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:01:58 user nova-compute[72504]:   </features>
Aug 01 20:01:58 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:01:58 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:01:58 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:01:58 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:01:58 user nova-compute[72504]:   </clock>
Aug 01 20:01:58 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:01:58 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:01:58 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:01:58 user nova-compute[72504]:   </cpu>
Aug 01 20:01:58 user nova-compute[72504]:   <devices>
Aug 01 20:01:58 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 20:01:58 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 20:01:58 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk"/>
Aug 01 20:01:58 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:01:58 user nova-compute[72504]:     </disk>
Aug 01 20:01:58 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:01:58 user nova-compute[72504]:       <mac address="fa:16:3e:c2:53:7c"/>
Aug 01 20:01:58 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:01:58 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:01:58 user nova-compute[72504]:       <target dev="tap6d66fd17-3c"/>
Aug 01 20:01:58 user nova-compute[72504]:     </interface>
Aug 01 20:01:58 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:01:58 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/console.log" append="off"/>
Aug 01 20:01:58 user nova-compute[72504]:     </serial>
Aug 01 20:01:58 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:01:58 user nova-compute[72504]:     <video>
Aug 01 20:01:58 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:01:58 user nova-compute[72504]:     </video>
Aug 01 20:01:58 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:01:58 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:01:58 user nova-compute[72504]:     </rng>
Aug 01 20:01:58 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:01:58 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:01:58 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:01:58 user nova-compute[72504]:     </memballoon>
Aug 01 20:01:58 user nova-compute[72504]:   </devices>
Aug 01 20:01:58 user nova-compute[72504]: </domain>
Aug 01 20:01:58 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-858127926',display_name='tempest-ServerRescueNegativeTestJSON-server-858127926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-858127926',id=28,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAulB7xKrQ3iwNSG1rJvFE3+trA8hmdkFqfWEnv5agU7clcZsDlocF6bKk7yN97AViHaHy9lGlueRa4sqKvs59bCNJwiRRu0euW/6zYzligMJY09K4XGFq7Tvk8Z/XH+rQ==',key_name='tempest-keypair-1316147877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='274aed6773224c4fb534aac970d6bb34',ramdisk_id='',reservation_id='r-vx3ehgmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-897201375',owner_user_name='tempest-ServerRescueNegativeTestJSON-897201375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:01:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be219e31095441269a1f140a77ad0d57',uuid=e19bf04b-43e0-4153-a6b5-74dbe36fedb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "address": "fa:16:3e:c2:53:7c", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d66fd17-3c", "ovs_interfaceid": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Converting VIF {"id": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "address": "fa:16:3e:c2:53:7c", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d66fd17-3c", "ovs_interfaceid": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:53:7c,bridge_name='br-int',has_traffic_filtering=True,id=6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc,network=Network(9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d66fd17-3c') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG os_vif [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:53:7c,bridge_name='br-int',has_traffic_filtering=True,id=6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc,network=Network(9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d66fd17-3c') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d66fd17-3c, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6d66fd17-3c, col_values=(('external_ids', {'iface-id': '6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:53:7c', 'vm-uuid': 'e19bf04b-43e0-4153-a6b5-74dbe36fedb0'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:58 user nova-compute[72504]: INFO os_vif [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:53:7c,bridge_name='br-int',has_traffic_filtering=True,id=6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc,network=Network(9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d66fd17-3c')
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] No VIF found with MAC fa:16:3e:c2:53:7c, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmhxKvRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:01:58 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:01:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:01:58 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:01:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:01:58 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:01:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d10174-abf0-4366-b925-8aa9220b4b23]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:01:58 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee6cd0c-ee12-4a0c-bdbe-6d507e5be1c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f] added
Aug 01 20:01:58 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.network.neutron [req-cd8f9d94-0c51-4274-a43c-d6c51ab32b44 req-fedcf43d-5704-4240-82aa-90bffde81649 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Updated VIF entry in instance network info cache for port 6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG nova.network.neutron [req-cd8f9d94-0c51-4274-a43c-d6c51ab32b44 req-fedcf43d-5704-4240-82aa-90bffde81649 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Updating instance_info_cache with network_info: [{"id": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "address": "fa:16:3e:c2:53:7c", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d66fd17-3c", "ovs_interfaceid": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb90c3f4-b83d-4949-a834-b53e543f60bd]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:01:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cd8f9d94-0c51-4274-a43c-d6c51ab32b44 req-fedcf43d-5704-4240-82aa-90bffde81649 service nova] Releasing lock "refresh_cache-e19bf04b-43e0-4153-a6b5-74dbe36fedb0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[065d8ee3-c1e2-442d-b95f-e764b732140e]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XmhxKvRL {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XmhxKvRL" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5f938d-a727-4897-8870-6ccda6a28368]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XmhxKvRL'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37b1eee-5b9f-4cfd-8565-314192a02bd1]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[55848b72-4811-40ff-83a9-00e61b99aa2d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:01:59 user nova-compute[72504]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 (non-flash)
Aug 01 20:01:59 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:01:59 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:01:59 user nova-compute[72504]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 (non-flash)
Aug 01 20:01:59 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:01:59 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c699044-b8eb-4db0-ba62-f06c9867b19c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f, portal: 172.16.0.220,3260]
Aug 01 20:01:59 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f, portal: 172.16.0.220,3260] successful.
Aug 01 20:01:59 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea7256a-6d41-494f-88d4-84aa6cda368a]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[536fcb38-209e-4dbc-b022-eb26067e8cbd]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:01:59 user nova-compute[72504]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 (non-flash)
Aug 01 20:01:59 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:01:59 user nova-compute[72504]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f (non-flash)
Aug 01 20:01:59 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:01:59 user nova-compute[72504]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 (non-flash)
Aug 01 20:01:59 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:01:59 user nova-compute[72504]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f (non-flash)
Aug 01 20:01:59 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fc0ab9-beb9-4974-8d88-4435ab0d2a47]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:01:59 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmhxKvRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:02:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:02:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '26563306335656564', 'path': '/dev/sde'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:02:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563306335656564', 'path': '/dev/sde'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:02:00 user nova-compute[72504]: DEBUG nova.objects.instance [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lazy-loading 'flavor' on Instance uuid 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:02:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 20:02:00 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:02:00 user nova-compute[72504]:   <source dev="/dev/sde"/>
Aug 01 20:02:00 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:02:00 user nova-compute[72504]:   <serial>c5259bc8-1355-4150-b79a-1c08383fb32f</serial>
Aug 01 20:02:00 user nova-compute[72504]: </disk>
Aug 01 20:02:00 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 20:02:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:00 user nova-compute[72504]: DEBUG nova.compute.manager [req-f2239be8-cb6a-4f4c-b3e1-986b752e962f req-c95aafd4-ead0-4622-9524-996bb71fa551 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received event network-vif-plugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:02:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f2239be8-cb6a-4f4c-b3e1-986b752e962f req-c95aafd4-ead0-4622-9524-996bb71fa551 service nova] Acquiring lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f2239be8-cb6a-4f4c-b3e1-986b752e962f req-c95aafd4-ead0-4622-9524-996bb71fa551 service nova] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f2239be8-cb6a-4f4c-b3e1-986b752e962f req-c95aafd4-ead0-4622-9524-996bb71fa551 service nova] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:00 user nova-compute[72504]: DEBUG nova.compute.manager [req-f2239be8-cb6a-4f4c-b3e1-986b752e962f req-c95aafd4-ead0-4622-9524-996bb71fa551 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] No waiting events found dispatching network-vif-plugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:02:00 user nova-compute[72504]: WARNING nova.compute.manager [req-f2239be8-cb6a-4f4c-b3e1-986b752e962f req-c95aafd4-ead0-4622-9524-996bb71fa551 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received unexpected event network-vif-plugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc for instance with vm_state building and task_state spawning.
Aug 01 20:02:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:02:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:02:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] No VIF found with MAC fa:16:3e:45:db:12, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:02:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-79ab5107-823c-4f25-a3c6-351a2dcb724f tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.212s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:02 user nova-compute[72504]: DEBUG nova.compute.manager [req-94663412-2ac8-4426-873b-cab41b3eaf0a req-ee8aa76b-2119-429b-8f76-d26c71af15c7 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received event network-vif-plugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:02:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-94663412-2ac8-4426-873b-cab41b3eaf0a req-ee8aa76b-2119-429b-8f76-d26c71af15c7 service nova] Acquiring lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-94663412-2ac8-4426-873b-cab41b3eaf0a req-ee8aa76b-2119-429b-8f76-d26c71af15c7 service nova] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-94663412-2ac8-4426-873b-cab41b3eaf0a req-ee8aa76b-2119-429b-8f76-d26c71af15c7 service nova] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:02 user nova-compute[72504]: DEBUG nova.compute.manager [req-94663412-2ac8-4426-873b-cab41b3eaf0a req-ee8aa76b-2119-429b-8f76-d26c71af15c7 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] No waiting events found dispatching network-vif-plugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:02:02 user nova-compute[72504]: WARNING nova.compute.manager [req-94663412-2ac8-4426-873b-cab41b3eaf0a req-ee8aa76b-2119-429b-8f76-d26c71af15c7 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received unexpected event network-vif-plugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc for instance with vm_state building and task_state spawning.
Aug 01 20:02:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:03 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920123.0452287, e19bf04b-43e0-4153-a6b5-74dbe36fedb0 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:02:03 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] VM Resumed (Lifecycle Event)
Aug 01 20:02:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:02:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:02:03 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Instance spawned successfully.
Aug 01 20:02:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 20:02:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:02:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:02:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:02:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:02:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:02:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:02:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:02:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:02:03 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:02:03 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920123.0489688, e19bf04b-43e0-4153-a6b5-74dbe36fedb0 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:02:03 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] VM Started (Lifecycle Event)
Aug 01 20:02:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:02:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:02:03 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:02:03 user nova-compute[72504]: INFO nova.compute.manager [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Took 6.76 seconds to spawn the instance on the hypervisor.
Aug 01 20:02:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:02:03 user nova-compute[72504]: INFO nova.compute.manager [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Took 7.64 seconds to build instance.
Aug 01 20:02:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-be854c29-e2e1-45e7-9a80-01a79971a814 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.757s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Acquiring lock "1ac6e0af-4adb-47a7-988e-971aa5efeb2c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "1ac6e0af-4adb-47a7-988e-971aa5efeb2c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:04 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 20:02:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:02:04 user nova-compute[72504]: INFO nova.compute.claims [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Claim successful on node user
Aug 01 20:02:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-cd62abe3-9409-48a5-bb58-049dd23ebc0b req-5bab0901-1900-490d-8864-65a873a06364 service nova] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Received event network-changed-31d5c352-dfc0-4a1a-8ed8-327c933661c9 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:02:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-cd62abe3-9409-48a5-bb58-049dd23ebc0b req-5bab0901-1900-490d-8864-65a873a06364 service nova] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Refreshing instance network info cache due to event network-changed-31d5c352-dfc0-4a1a-8ed8-327c933661c9. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:02:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cd62abe3-9409-48a5-bb58-049dd23ebc0b req-5bab0901-1900-490d-8864-65a873a06364 service nova] Acquiring lock "refresh_cache-554ecd73-e393-4db1-9a8c-6749991dd44c" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:02:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cd62abe3-9409-48a5-bb58-049dd23ebc0b req-5bab0901-1900-490d-8864-65a873a06364 service nova] Acquired lock "refresh_cache-554ecd73-e393-4db1-9a8c-6749991dd44c" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:02:04 user nova-compute[72504]: DEBUG nova.network.neutron [req-cd62abe3-9409-48a5-bb58-049dd23ebc0b req-5bab0901-1900-490d-8864-65a873a06364 service nova] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Refreshing network info cache for port 31d5c352-dfc0-4a1a-8ed8-327c933661c9 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:02:05 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:02:05 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:02:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.565s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 20:02:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 20:02:05 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 20:02:05 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 20:02:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 20:02:05 user nova-compute[72504]: DEBUG nova.network.neutron [req-cd62abe3-9409-48a5-bb58-049dd23ebc0b req-5bab0901-1900-490d-8864-65a873a06364 service nova] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Updated VIF entry in instance network info cache for port 31d5c352-dfc0-4a1a-8ed8-327c933661c9. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:02:05 user nova-compute[72504]: DEBUG nova.network.neutron [req-cd62abe3-9409-48a5-bb58-049dd23ebc0b req-5bab0901-1900-490d-8864-65a873a06364 service nova] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Updating instance_info_cache with network_info: [{"id": "31d5c352-dfc0-4a1a-8ed8-327c933661c9", "address": "fa:16:3e:32:1c:cc", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d5c352-df", "ovs_interfaceid": "31d5c352-dfc0-4a1a-8ed8-327c933661c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:02:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cd62abe3-9409-48a5-bb58-049dd23ebc0b req-5bab0901-1900-490d-8864-65a873a06364 service nova] Releasing lock "refresh_cache-554ecd73-e393-4db1-9a8c-6749991dd44c" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:02:05 user nova-compute[72504]: DEBUG nova.policy [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a04ab5f67aaa4969b3df48d274a86d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0f5bb5775e4071ab28bea2d9dd2512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 20:02:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 20:02:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:02:05 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Creating image(s)
Aug 01 20:02:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "/opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "/opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.173s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.195s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk 1073741824" returned: 0 in 0.081s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "88f95d20-e391-4100-93b2-da29bfcf9704" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "88f95d20-e391-4100-93b2-da29bfcf9704" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:05 user nova-compute[72504]: INFO nova.compute.manager [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Detaching volume c3b5577d-9370-489d-b16f-1a88059a3d51
Aug 01 20:02:06 user nova-compute[72504]: INFO nova.virt.block_device [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Attempting to driver detach volume c3b5577d-9370-489d-b16f-1a88059a3d51 from mountpoint /dev/vdb
Aug 01 20:02:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Attempting to detach device vdb from instance 88f95d20-e391-4100-93b2-da29bfcf9704 from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:02:06 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:02:06 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 20:02:06 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:02:06 user nova-compute[72504]:   <serial>c3b5577d-9370-489d-b16f-1a88059a3d51</serial>
Aug 01 20:02:06 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 20:02:06 user nova-compute[72504]: </disk>
Aug 01 20:02:06 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.168s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:06 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Successfully detached device vdb from instance 88f95d20-e391-4100-93b2-da29bfcf9704 from the persistent domain config.
Aug 01 20:02:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 88f95d20-e391-4100-93b2-da29bfcf9704 from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:02:06 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:02:06 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 20:02:06 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:02:06 user nova-compute[72504]:   <serial>c3b5577d-9370-489d-b16f-1a88059a3d51</serial>
Aug 01 20:02:06 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 20:02:06 user nova-compute[72504]: </disk>
Aug 01 20:02:06 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Successfully created port: 2fbee8e8-4a4b-44d6-812b-f50729e5b45f {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Cannot resize image /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lazy-loading 'migration_context' on Instance uuid 1ac6e0af-4adb-47a7-988e-971aa5efeb2c {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Ensure instance console log exists: /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690920126.6986444, 88f95d20-e391-4100-93b2-da29bfcf9704 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 88f95d20-e391-4100-93b2-da29bfcf9704 {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 20:02:06 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Successfully detached device vdb from instance 88f95d20-e391-4100-93b2-da29bfcf9704 from the live domain config.
Aug 01 20:02:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OufDlhFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:02:06 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:02:06 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[764d5f67-d68c-4bb3-9076-480585c7f0aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aff1b39-31c5-4071-9757-345cba913b3f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:02:06 user nova-compute[72504]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 (non-flash)
Aug 01 20:02:06 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:02:06 user nova-compute[72504]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f (non-flash)
Aug 01 20:02:06 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:02:06 user nova-compute[72504]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 (non-flash)
Aug 01 20:02:06 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:02:06 user nova-compute[72504]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f (non-flash)
Aug 01 20:02:06 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3f4404af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51'): ({'sdc'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Removing single pathed devices sdc {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2970d9b-2e97-4025-9d0a-026242539cdc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.036s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5721a6f1-a437-4de4-9165-f37568027e9d]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Flushing IO for device /dev/sdc {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cbe21e-477e-4816-84f9-b13e876abfd2]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6904b7f-283d-4802-a772-b54e87557d77]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db51c51-04a4-4112-b197-6fbd7722d08a]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:02:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5744254-a574-454e-8611-b66e0b98e0b9]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51, portal: 172.16.0.220,3260]
Aug 01 20:02:07 user nova-compute[72504]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51, portal: 172.16.0.220,3260] successful.
Aug 01 20:02:07 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b5577d-9370-489d-b16f-1a88059a3d51 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e128b7d3-6983-4ef9-a0ee-6e719710b0d2]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] <== disconnect_volume: return (359ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Successfully updated port: 2fbee8e8-4a4b-44d6-812b-f50729e5b45f {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Acquiring lock "refresh_cache-1ac6e0af-4adb-47a7-988e-971aa5efeb2c" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Acquired lock "refresh_cache-1ac6e0af-4adb-47a7-988e-971aa5efeb2c" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.compute.manager [req-cbd2eb24-d877-4a91-80d3-fc00228db49b req-a4f9db83-27ea-4222-bfc1-53b8d43ea50d service nova] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Received event network-changed-2fbee8e8-4a4b-44d6-812b-f50729e5b45f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.compute.manager [req-cbd2eb24-d877-4a91-80d3-fc00228db49b req-a4f9db83-27ea-4222-bfc1-53b8d43ea50d service nova] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Refreshing instance network info cache due to event network-changed-2fbee8e8-4a4b-44d6-812b-f50729e5b45f. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cbd2eb24-d877-4a91-80d3-fc00228db49b req-a4f9db83-27ea-4222-bfc1-53b8d43ea50d service nova] Acquiring lock "refresh_cache-1ac6e0af-4adb-47a7-988e-971aa5efeb2c" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Updating instance_info_cache with network_info: [{"id": "2fbee8e8-4a4b-44d6-812b-f50729e5b45f", "address": "fa:16:3e:b0:b8:e6", "network": {"id": "b8489ede-9e34-4dfa-b6d7-d0948a7bad05", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1846924261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea0f5bb5775e4071ab28bea2d9dd2512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbee8e8-4a", "ovs_interfaceid": "2fbee8e8-4a4b-44d6-812b-f50729e5b45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Releasing lock "refresh_cache-1ac6e0af-4adb-47a7-988e-971aa5efeb2c" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Instance network_info: |[{"id": "2fbee8e8-4a4b-44d6-812b-f50729e5b45f", "address": "fa:16:3e:b0:b8:e6", "network": {"id": "b8489ede-9e34-4dfa-b6d7-d0948a7bad05", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1846924261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea0f5bb5775e4071ab28bea2d9dd2512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbee8e8-4a", "ovs_interfaceid": "2fbee8e8-4a4b-44d6-812b-f50729e5b45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cbd2eb24-d877-4a91-80d3-fc00228db49b req-a4f9db83-27ea-4222-bfc1-53b8d43ea50d service nova] Acquired lock "refresh_cache-1ac6e0af-4adb-47a7-988e-971aa5efeb2c" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.network.neutron [req-cbd2eb24-d877-4a91-80d3-fc00228db49b req-a4f9db83-27ea-4222-bfc1-53b8d43ea50d service nova] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Refreshing network info cache for port 2fbee8e8-4a4b-44d6-812b-f50729e5b45f {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Start _get_guest_xml network_info=[{"id": "2fbee8e8-4a4b-44d6-812b-f50729e5b45f", "address": "fa:16:3e:b0:b8:e6", "network": {"id": "b8489ede-9e34-4dfa-b6d7-d0948a7bad05", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1846924261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea0f5bb5775e4071ab28bea2d9dd2512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbee8e8-4a", "ovs_interfaceid": "2fbee8e8-4a4b-44d6-812b-f50729e5b45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:02:07 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:02:07 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:02:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1929287952',display_name='tempest-ServersNegativeTestJSON-server-1929287952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1929287952',id=29,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea0f5bb5775e4071ab28bea2d9dd2512',ramdisk_id='',reservation_id='r-cnzbl54v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-865865258',owner_user_name='tempest-ServersNegativeTestJSON-865865258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:02:05Z,user_data=None,user_id='a04ab5f67aaa4969b3df48d274a86d5e',uuid=1ac6e0af-4adb-47a7-988e-971aa5efeb2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fbee8e8-4a4b-44d6-812b-f50729e5b45f", "address": "fa:16:3e:b0:b8:e6", "network": {"id": "b8489ede-9e34-4dfa-b6d7-d0948a7bad05", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1846924261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea0f5bb5775e4071ab28bea2d9dd2512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbee8e8-4a", "ovs_interfaceid": "2fbee8e8-4a4b-44d6-812b-f50729e5b45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Converting VIF {"id": "2fbee8e8-4a4b-44d6-812b-f50729e5b45f", "address": "fa:16:3e:b0:b8:e6", "network": {"id": "b8489ede-9e34-4dfa-b6d7-d0948a7bad05", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1846924261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea0f5bb5775e4071ab28bea2d9dd2512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbee8e8-4a", "ovs_interfaceid": "2fbee8e8-4a4b-44d6-812b-f50729e5b45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:b8:e6,bridge_name='br-int',has_traffic_filtering=True,id=2fbee8e8-4a4b-44d6-812b-f50729e5b45f,network=Network(b8489ede-9e34-4dfa-b6d7-d0948a7bad05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fbee8e8-4a') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ac6e0af-4adb-47a7-988e-971aa5efeb2c {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:02:07 user nova-compute[72504]:   <uuid>1ac6e0af-4adb-47a7-988e-971aa5efeb2c</uuid>
Aug 01 20:02:07 user nova-compute[72504]:   <name>instance-0000001d</name>
Aug 01 20:02:07 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:02:07 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:02:07 user nova-compute[72504]:   <metadata>
Aug 01 20:02:07 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:02:07 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:02:07 user nova-compute[72504]:       <nova:name>tempest-ServersNegativeTestJSON-server-1929287952</nova:name>
Aug 01 20:02:07 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:02:07</nova:creationTime>
Aug 01 20:02:07 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:02:07 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:02:07 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:02:07 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:02:07 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:02:07 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:02:07 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:02:07 user nova-compute[72504]:       <nova:owner>
Aug 01 20:02:07 user nova-compute[72504]:         <nova:user uuid="a04ab5f67aaa4969b3df48d274a86d5e">tempest-ServersNegativeTestJSON-865865258-project-member</nova:user>
Aug 01 20:02:07 user nova-compute[72504]:         <nova:project uuid="ea0f5bb5775e4071ab28bea2d9dd2512">tempest-ServersNegativeTestJSON-865865258</nova:project>
Aug 01 20:02:07 user nova-compute[72504]:       </nova:owner>
Aug 01 20:02:07 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 20:02:07 user nova-compute[72504]:       <nova:ports>
Aug 01 20:02:07 user nova-compute[72504]:         <nova:port uuid="2fbee8e8-4a4b-44d6-812b-f50729e5b45f">
Aug 01 20:02:07 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 20:02:07 user nova-compute[72504]:         </nova:port>
Aug 01 20:02:07 user nova-compute[72504]:       </nova:ports>
Aug 01 20:02:07 user nova-compute[72504]:     </nova:instance>
Aug 01 20:02:07 user nova-compute[72504]:   </metadata>
Aug 01 20:02:07 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:02:07 user nova-compute[72504]:     <system>
Aug 01 20:02:07 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:02:07 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:02:07 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:02:07 user nova-compute[72504]:       <entry name="serial">1ac6e0af-4adb-47a7-988e-971aa5efeb2c</entry>
Aug 01 20:02:07 user nova-compute[72504]:       <entry name="uuid">1ac6e0af-4adb-47a7-988e-971aa5efeb2c</entry>
Aug 01 20:02:07 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:02:07 user nova-compute[72504]:     </system>
Aug 01 20:02:07 user nova-compute[72504]:   </sysinfo>
Aug 01 20:02:07 user nova-compute[72504]:   <os>
Aug 01 20:02:07 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:02:07 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:02:07 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:02:07 user nova-compute[72504]:   </os>
Aug 01 20:02:07 user nova-compute[72504]:   <features>
Aug 01 20:02:07 user nova-compute[72504]:     <acpi/>
Aug 01 20:02:07 user nova-compute[72504]:     <apic/>
Aug 01 20:02:07 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:02:07 user nova-compute[72504]:   </features>
Aug 01 20:02:07 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:02:07 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:02:07 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:02:07 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:02:07 user nova-compute[72504]:   </clock>
Aug 01 20:02:07 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:02:07 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:02:07 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:02:07 user nova-compute[72504]:   </cpu>
Aug 01 20:02:07 user nova-compute[72504]:   <devices>
Aug 01 20:02:07 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 20:02:07 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 20:02:07 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk"/>
Aug 01 20:02:07 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:02:07 user nova-compute[72504]:     </disk>
Aug 01 20:02:07 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:02:07 user nova-compute[72504]:       <mac address="fa:16:3e:b0:b8:e6"/>
Aug 01 20:02:07 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:02:07 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:02:07 user nova-compute[72504]:       <target dev="tap2fbee8e8-4a"/>
Aug 01 20:02:07 user nova-compute[72504]:     </interface>
Aug 01 20:02:07 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:02:07 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/console.log" append="off"/>
Aug 01 20:02:07 user nova-compute[72504]:     </serial>
Aug 01 20:02:07 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:02:07 user nova-compute[72504]:     <video>
Aug 01 20:02:07 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:02:07 user nova-compute[72504]:     </video>
Aug 01 20:02:07 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:02:07 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:02:07 user nova-compute[72504]:     </rng>
Aug 01 20:02:07 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:02:07 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:02:07 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:02:07 user nova-compute[72504]:     </memballoon>
Aug 01 20:02:07 user nova-compute[72504]:   </devices>
Aug 01 20:02:07 user nova-compute[72504]: </domain>
Aug 01 20:02:07 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:02:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1929287952',display_name='tempest-ServersNegativeTestJSON-server-1929287952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1929287952',id=29,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea0f5bb5775e4071ab28bea2d9dd2512',ramdisk_id='',reservation_id='r-cnzbl54v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-865865258',owner_user_name='tempest-ServersNegativeTestJSON-865865258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:02:05Z,user_data=None,user_id='a04ab5f67aaa4969b3df48d274a86d5e',uuid=1ac6e0af-4adb-47a7-988e-971aa5efeb2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fbee8e8-4a4b-44d6-812b-f50729e5b45f", "address": "fa:16:3e:b0:b8:e6", "network": {"id": "b8489ede-9e34-4dfa-b6d7-d0948a7bad05", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1846924261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea0f5bb5775e4071ab28bea2d9dd2512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbee8e8-4a", "ovs_interfaceid": "2fbee8e8-4a4b-44d6-812b-f50729e5b45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Converting VIF {"id": "2fbee8e8-4a4b-44d6-812b-f50729e5b45f", "address": "fa:16:3e:b0:b8:e6", "network": {"id": "b8489ede-9e34-4dfa-b6d7-d0948a7bad05", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1846924261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea0f5bb5775e4071ab28bea2d9dd2512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbee8e8-4a", "ovs_interfaceid": "2fbee8e8-4a4b-44d6-812b-f50729e5b45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:b8:e6,bridge_name='br-int',has_traffic_filtering=True,id=2fbee8e8-4a4b-44d6-812b-f50729e5b45f,network=Network(b8489ede-9e34-4dfa-b6d7-d0948a7bad05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fbee8e8-4a') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG os_vif [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:b8:e6,bridge_name='br-int',has_traffic_filtering=True,id=2fbee8e8-4a4b-44d6-812b-f50729e5b45f,network=Network(b8489ede-9e34-4dfa-b6d7-d0948a7bad05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fbee8e8-4a') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2fbee8e8-4a, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2fbee8e8-4a, col_values=(('external_ids', {'iface-id': '2fbee8e8-4a4b-44d6-812b-f50729e5b45f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:b8:e6', 'vm-uuid': '1ac6e0af-4adb-47a7-988e-971aa5efeb2c'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:07 user nova-compute[72504]: INFO os_vif [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:b8:e6,bridge_name='br-int',has_traffic_filtering=True,id=2fbee8e8-4a4b-44d6-812b-f50729e5b45f,network=Network(b8489ede-9e34-4dfa-b6d7-d0948a7bad05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fbee8e8-4a')
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] No VIF found with MAC fa:16:3e:b0:b8:e6, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:02:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG nova.objects.instance [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lazy-loading 'flavor' on Instance uuid 88f95d20-e391-4100-93b2-da29bfcf9704 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7a90a911-5f55-43cd-a281-d267fe1ee3f9 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "88f95d20-e391-4100-93b2-da29bfcf9704" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.165s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "554ecd73-e393-4db1-9a8c-6749991dd44c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "554ecd73-e393-4db1-9a8c-6749991dd44c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG nova.network.neutron [req-cbd2eb24-d877-4a91-80d3-fc00228db49b req-a4f9db83-27ea-4222-bfc1-53b8d43ea50d service nova] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Updated VIF entry in instance network info cache for port 2fbee8e8-4a4b-44d6-812b-f50729e5b45f. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG nova.network.neutron [req-cbd2eb24-d877-4a91-80d3-fc00228db49b req-a4f9db83-27ea-4222-bfc1-53b8d43ea50d service nova] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Updating instance_info_cache with network_info: [{"id": "2fbee8e8-4a4b-44d6-812b-f50729e5b45f", "address": "fa:16:3e:b0:b8:e6", "network": {"id": "b8489ede-9e34-4dfa-b6d7-d0948a7bad05", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1846924261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea0f5bb5775e4071ab28bea2d9dd2512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbee8e8-4a", "ovs_interfaceid": "2fbee8e8-4a4b-44d6-812b-f50729e5b45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG nova.objects.instance [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lazy-loading 'flavor' on Instance uuid 554ecd73-e393-4db1-9a8c-6749991dd44c {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cbd2eb24-d877-4a91-80d3-fc00228db49b req-a4f9db83-27ea-4222-bfc1-53b8d43ea50d service nova] Releasing lock "refresh_cache-1ac6e0af-4adb-47a7-988e-971aa5efeb2c" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "554ecd73-e393-4db1-9a8c-6749991dd44c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "554ecd73-e393-4db1-9a8c-6749991dd44c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "554ecd73-e393-4db1-9a8c-6749991dd44c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:08 user nova-compute[72504]: INFO nova.compute.manager [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Attaching volume 0d47556e-d90c-434c-b0db-cb4d047d5dce to /dev/vdb
Aug 01 20:02:08 user nova-compute[72504]: DEBUG os_brick.utils [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc35af9-8ba4-4cff-adb7-9190bd3cff32]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f36d95e-7c7b-453c-a861-bef26001f31b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a6011e-c4eb-403b-bc76-02da58f30b85]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd12162-5a29-4fbd-8a46-0df98b568c42]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:02:08 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:02:08 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[83745e60-8cc5-4dfe-a180-9b899d261e59]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG os_brick.utils [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:02:08 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Updating existing volume attachment record: 4739b097-685d-42ae-84b9-dfd413498a18 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:02:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:09 user nova-compute[72504]: DEBUG nova.compute.manager [req-3f5b6428-1f82-4563-9a63-f12c9ce55267 req-938b48f8-9f6d-4329-9b93-196308c2a2ee service nova] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Received event network-vif-plugged-2fbee8e8-4a4b-44d6-812b-f50729e5b45f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:02:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3f5b6428-1f82-4563-9a63-f12c9ce55267 req-938b48f8-9f6d-4329-9b93-196308c2a2ee service nova] Acquiring lock "1ac6e0af-4adb-47a7-988e-971aa5efeb2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3f5b6428-1f82-4563-9a63-f12c9ce55267 req-938b48f8-9f6d-4329-9b93-196308c2a2ee service nova] Lock "1ac6e0af-4adb-47a7-988e-971aa5efeb2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3f5b6428-1f82-4563-9a63-f12c9ce55267 req-938b48f8-9f6d-4329-9b93-196308c2a2ee service nova] Lock "1ac6e0af-4adb-47a7-988e-971aa5efeb2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:09 user nova-compute[72504]: DEBUG nova.compute.manager [req-3f5b6428-1f82-4563-9a63-f12c9ce55267 req-938b48f8-9f6d-4329-9b93-196308c2a2ee service nova] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] No waiting events found dispatching network-vif-plugged-2fbee8e8-4a4b-44d6-812b-f50729e5b45f {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:02:09 user nova-compute[72504]: WARNING nova.compute.manager [req-3f5b6428-1f82-4563-9a63-f12c9ce55267 req-938b48f8-9f6d-4329-9b93-196308c2a2ee service nova] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Received unexpected event network-vif-plugged-2fbee8e8-4a4b-44d6-812b-f50729e5b45f for instance with vm_state building and task_state spawning.
Aug 01 20:02:10 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:10 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:10 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:11 user nova-compute[72504]: DEBUG nova.compute.manager [req-0bef31fc-d126-4cea-9491-d88199115c91 req-cb998556-0e37-4176-b6bd-d015f412850d service nova] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Received event network-vif-plugged-2fbee8e8-4a4b-44d6-812b-f50729e5b45f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:02:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0bef31fc-d126-4cea-9491-d88199115c91 req-cb998556-0e37-4176-b6bd-d015f412850d service nova] Acquiring lock "1ac6e0af-4adb-47a7-988e-971aa5efeb2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0bef31fc-d126-4cea-9491-d88199115c91 req-cb998556-0e37-4176-b6bd-d015f412850d service nova] Lock "1ac6e0af-4adb-47a7-988e-971aa5efeb2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0bef31fc-d126-4cea-9491-d88199115c91 req-cb998556-0e37-4176-b6bd-d015f412850d service nova] Lock "1ac6e0af-4adb-47a7-988e-971aa5efeb2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:11 user nova-compute[72504]: DEBUG nova.compute.manager [req-0bef31fc-d126-4cea-9491-d88199115c91 req-cb998556-0e37-4176-b6bd-d015f412850d service nova] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] No waiting events found dispatching network-vif-plugged-2fbee8e8-4a4b-44d6-812b-f50729e5b45f {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:02:11 user nova-compute[72504]: WARNING nova.compute.manager [req-0bef31fc-d126-4cea-9491-d88199115c91 req-cb998556-0e37-4176-b6bd-d015f412850d service nova] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Received unexpected event network-vif-plugged-2fbee8e8-4a4b-44d6-812b-f50729e5b45f for instance with vm_state building and task_state spawning.
Aug 01 20:02:11 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920131.9870942, 1ac6e0af-4adb-47a7-988e-971aa5efeb2c => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:02:11 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] VM Resumed (Lifecycle Event)
Aug 01 20:02:12 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:02:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:02:12 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:02:12 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Instance spawned successfully.
Aug 01 20:02:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 20:02:12 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:02:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:02:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:02:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:02:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:02:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:02:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:02:12 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:02:12 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920131.9939206, 1ac6e0af-4adb-47a7-988e-971aa5efeb2c => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:02:12 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] VM Started (Lifecycle Event)
Aug 01 20:02:12 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:02:12 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:02:12 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:02:12 user nova-compute[72504]: INFO nova.compute.manager [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Took 6.77 seconds to spawn the instance on the hypervisor.
Aug 01 20:02:12 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:02:12 user nova-compute[72504]: INFO nova.compute.manager [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Took 7.73 seconds to build instance.
Aug 01 20:02:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e936fe3e-c9e1-49a8-8fb2-b6c4c2d21606 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "1ac6e0af-4adb-47a7-988e-971aa5efeb2c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.896s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UwSLKeDX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:02:17 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:02:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:02:17 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:02:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:02:17 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbc3a3b-4866-437c-9060-67c25a6a9f80]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:02:17 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ed75ad-e7ee-48bf-90cf-8148efcf368f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce] added
Aug 01 20:02:17 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8813b0e6-1174-4773-aeae-15150c820f22]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2031d851-e890-4af7-96f3-01428412d890]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UwSLKeDX {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UwSLKeDX" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[284acf90-0d02-49ce-a7bc-6d1f40b61b26]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UwSLKeDX'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefc46d0-afa0-481f-9e37-27d8b5a2cc67]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c46ce31-a0e6-41b7-a55e-7bb664ac879b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:02:17 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:02:17 user nova-compute[72504]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f (non-flash)
Aug 01 20:02:17 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:02:17 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:02:17 user nova-compute[72504]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f (non-flash)
Aug 01 20:02:17 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9050fb6-4372-4849-b992-9bb5ab7c63b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce, portal: 172.16.0.220,3260]
Aug 01 20:02:17 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce, portal: 172.16.0.220,3260] successful.
Aug 01 20:02:17 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1283a2d4-0fac-4490-972b-6ae7d13cb77f]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b99dfd-0135-40c9-91bf-70cab1734e1c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:02:17 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:02:17 user nova-compute[72504]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f (non-flash)
Aug 01 20:02:17 user nova-compute[72504]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce (non-flash)
Aug 01 20:02:17 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:02:17 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:02:17 user nova-compute[72504]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f (non-flash)
Aug 01 20:02:17 user nova-compute[72504]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce (non-flash)
Aug 01 20:02:17 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9176fb7-94cc-4850-a9fe-f52e07c160b2]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UwSLKeDX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:02:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:02:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '26535383866346634', 'path': '/dev/sdc'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:02:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535383866346634', 'path': '/dev/sdc'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:02:18 user nova-compute[72504]: DEBUG nova.objects.instance [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lazy-loading 'flavor' on Instance uuid 554ecd73-e393-4db1-9a8c-6749991dd44c {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:02:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 20:02:18 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:02:18 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 20:02:18 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:02:18 user nova-compute[72504]:   <serial>0d47556e-d90c-434c-b0db-cb4d047d5dce</serial>
Aug 01 20:02:18 user nova-compute[72504]: </disk>
Aug 01 20:02:18 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 20:02:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:02:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:02:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] No VIF found with MAC fa:16:3e:32:1c:cc, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:02:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-888cfa6c-9be5-431f-8faf-7716b9ca5c78 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "554ecd73-e393-4db1-9a8c-6749991dd44c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.123s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:19 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:02:19 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:02:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "554ecd73-e393-4db1-9a8c-6749991dd44c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "554ecd73-e393-4db1-9a8c-6749991dd44c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:20 user nova-compute[72504]: INFO nova.compute.manager [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Detaching volume 0d47556e-d90c-434c-b0db-cb4d047d5dce
Aug 01 20:02:20 user nova-compute[72504]: INFO nova.virt.block_device [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Attempting to driver detach volume 0d47556e-d90c-434c-b0db-cb4d047d5dce from mountpoint /dev/vdb
Aug 01 20:02:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Attempting to detach device vdb from instance 554ecd73-e393-4db1-9a8c-6749991dd44c from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 20:02:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:02:20 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:02:20 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 20:02:20 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:02:20 user nova-compute[72504]:   <serial>0d47556e-d90c-434c-b0db-cb4d047d5dce</serial>
Aug 01 20:02:20 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:02:20 user nova-compute[72504]: </disk>
Aug 01 20:02:20 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:02:20 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Successfully detached device vdb from instance 554ecd73-e393-4db1-9a8c-6749991dd44c from the persistent domain config.
Aug 01 20:02:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 554ecd73-e393-4db1-9a8c-6749991dd44c from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 20:02:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:02:20 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:02:20 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 20:02:20 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:02:20 user nova-compute[72504]:   <serial>0d47556e-d90c-434c-b0db-cb4d047d5dce</serial>
Aug 01 20:02:20 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:02:20 user nova-compute[72504]: </disk>
Aug 01 20:02:20 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690920141.3020961, 554ecd73-e393-4db1-9a8c-6749991dd44c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 554ecd73-e393-4db1-9a8c-6749991dd44c {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 20:02:21 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Successfully detached device vdb from instance 554ecd73-e393-4db1-9a8c-6749991dd44c from the live domain config.
Aug 01 20:02:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UwSLKeDX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:02:21 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:02:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[72355223-9035-4a90-94e3-56fa6606d9a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9971214-cee3-42f9-a8f3-026b1b0cc6f4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:02:21 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:02:21 user nova-compute[72504]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f (non-flash)
Aug 01 20:02:21 user nova-compute[72504]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce (non-flash)
Aug 01 20:02:21 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:02:21 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:02:21 user nova-compute[72504]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f (non-flash)
Aug 01 20:02:21 user nova-compute[72504]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce (non-flash)
Aug 01 20:02:21 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff40c348700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce'): ({'sdc'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Removing single pathed devices sdc {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bd01e0-9aae-4f96-a130-3d95f1c772b0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa24762-aaea-4f6c-a923-a5c3b3f6c415]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Flushing IO for device /dev/sdc {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cd4bf5-cd62-498f-95bf-6c5491016937]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3d3e9a-b033-4817-94f7-ae6e1152a8d5]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e49ea3-e4d6-4dca-8710-8cdab8184a09]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a94a86-37da-4532-a5ab-b2f1a6e18835]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce, portal: 172.16.0.220,3260]
Aug 01 20:02:21 user nova-compute[72504]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce, portal: 172.16.0.220,3260] successful.
Aug 01 20:02:21 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d47556e-d90c-434c-b0db-cb4d047d5dce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[39509f71-52bf-4d84-9b36-5d3cfcd68e93]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] <== disconnect_volume: return (303ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:21 user nova-compute[72504]: INFO nova.compute.manager [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Detaching volume c5259bc8-1355-4150-b79a-1c08383fb32f
Aug 01 20:02:21 user nova-compute[72504]: INFO nova.virt.block_device [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Attempting to driver detach volume c5259bc8-1355-4150-b79a-1c08383fb32f from mountpoint /dev/vdb
Aug 01 20:02:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Attempting to detach device vdb from instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:02:21 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:02:21 user nova-compute[72504]:   <source dev="/dev/sde"/>
Aug 01 20:02:21 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:02:21 user nova-compute[72504]:   <serial>c5259bc8-1355-4150-b79a-1c08383fb32f</serial>
Aug 01 20:02:21 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:02:21 user nova-compute[72504]: </disk>
Aug 01 20:02:21 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:02:21 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Successfully detached device vdb from instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 from the persistent domain config.
Aug 01 20:02:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 20:02:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:02:21 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:02:21 user nova-compute[72504]:   <source dev="/dev/sde"/>
Aug 01 20:02:21 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:02:21 user nova-compute[72504]:   <serial>c5259bc8-1355-4150-b79a-1c08383fb32f</serial>
Aug 01 20:02:21 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:02:21 user nova-compute[72504]: </disk>
Aug 01 20:02:21 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690920142.2868261, 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 20:02:22 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Successfully detached device vdb from instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 from the live domain config.
Aug 01 20:02:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmhxKvRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:02:22 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:02:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d4a55f-7f7c-40d8-b3a8-b83778800af6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[958d7ec9-4bf5-4562-96e3-9247060699b9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:02:22 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:02:22 user nova-compute[72504]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f (non-flash)
Aug 01 20:02:22 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:02:22 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:02:22 user nova-compute[72504]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f (non-flash)
Aug 01 20:02:22 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff41a8e2b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f'): ({'sde'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Removing single pathed devices sde {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d55eca7-a1fe-464e-99d7-8615792dd8fe]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a77f26-6dee-41bd-88dc-ef8ae70c2cb6]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Flushing IO for device /dev/sde {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lazy-loading 'flavor' on Instance uuid 554ecd73-e393-4db1-9a8c-6749991dd44c {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c05fed-57fa-455c-8398-839e661cff0a]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a781b7-a59f-4d97-9a8f-9d1462a1a2bd]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] SCSI volumes sde have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e2ce19d8-0563-41de-9fec-bc5e1d03c4a0 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "554ecd73-e393-4db1-9a8c-6749991dd44c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.878s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb25b69b-8319-4a14-9c4a-2c27e590a6fe]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2b6b7a-ae6e-4032-bb19-8b01ef06f803]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f, portal: 172.16.0.220,3260]
Aug 01 20:02:22 user nova-compute[72504]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f, portal: 172.16.0.220,3260] successful.
Aug 01 20:02:22 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5259bc8-1355-4150-b79a-1c08383fb32f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0c8e7a-897f-4563-a746-631c30527ee2]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] <== disconnect_volume: return (395ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:23 user nova-compute[72504]: DEBUG nova.objects.instance [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lazy-loading 'flavor' on Instance uuid 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:02:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4e9119ae-5fae-47eb-8868-72f92d626fad tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.792s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:23 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:02:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:02:23 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:02:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:23 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:02:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:02:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:02:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/554ecd73-e393-4db1-9a8c-6749991dd44c/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/554ecd73-e393-4db1-9a8c-6749991dd44c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/554ecd73-e393-4db1-9a8c-6749991dd44c/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/554ecd73-e393-4db1-9a8c-6749991dd44c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:27 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:02:27 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:02:27 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=7312MB free_disk=25.12286376953125GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:02:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:28 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:02:28 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 7391a8ce-7ce5-47ec-97f6-6159645688ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:02:28 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:02:28 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 128c2981-363c-4ae9-b46d-15b5e5d9cac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:02:28 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 88f95d20-e391-4100-93b2-da29bfcf9704 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:02:28 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 54812de2-bfe3-46f1-a327-8081fbb80bec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:02:28 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:02:28 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 554ecd73-e393-4db1-9a8c-6749991dd44c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:02:28 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 6377103d-7606-4a5d-a905-6b1439e52c93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:02:28 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance a53847a9-5dfc-422b-ba06-617dda589042 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:02:28 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance e19bf04b-43e0-4153-a6b5-74dbe36fedb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:02:28 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1ac6e0af-4adb-47a7-988e-971aa5efeb2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:02:28 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:02:28 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:02:28 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:02:28 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:02:28 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:02:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.536s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:30 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:02:30 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:02:30 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:02:30 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 20:02:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-39b3076d-ce59-4e7c-976f-9355bf2f6ff4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:02:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-39b3076d-ce59-4e7c-976f-9355bf2f6ff4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:02:30 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:02:30 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lazy-loading 'info_cache' on Instance uuid 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:02:31 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Updating instance_info_cache with network_info: [{"id": "a4953c19-ef72-4bbe-b271-40cc5162842d", "address": "fa:16:3e:86:10:53", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4953c19-ef", "ovs_interfaceid": "a4953c19-ef72-4bbe-b271-40cc5162842d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:02:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-39b3076d-ce59-4e7c-976f-9355bf2f6ff4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:02:31 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:02:31 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:02:31 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:02:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-693954e8-ae61-4881-845a-d521dc2e0ad2 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "6377103d-7606-4a5d-a905-6b1439e52c93" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-693954e8-ae61-4881-845a-d521dc2e0ad2 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "6377103d-7606-4a5d-a905-6b1439e52c93" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-693954e8-ae61-4881-845a-d521dc2e0ad2 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-693954e8-ae61-4881-845a-d521dc2e0ad2 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-693954e8-ae61-4881-845a-d521dc2e0ad2 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:37 user nova-compute[72504]: INFO nova.compute.manager [None req-693954e8-ae61-4881-845a-d521dc2e0ad2 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Terminating instance
Aug 01 20:02:37 user nova-compute[72504]: DEBUG nova.compute.manager [None req-693954e8-ae61-4881-845a-d521dc2e0ad2 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:02:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:38 user nova-compute[72504]: DEBUG nova.compute.manager [req-f9362397-89f6-462f-86cf-610a798ab7c9 req-90774146-a141-4926-968b-d008bdab8be3 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received event network-vif-unplugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:02:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f9362397-89f6-462f-86cf-610a798ab7c9 req-90774146-a141-4926-968b-d008bdab8be3 service nova] Acquiring lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f9362397-89f6-462f-86cf-610a798ab7c9 req-90774146-a141-4926-968b-d008bdab8be3 service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f9362397-89f6-462f-86cf-610a798ab7c9 req-90774146-a141-4926-968b-d008bdab8be3 service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:38 user nova-compute[72504]: DEBUG nova.compute.manager [req-f9362397-89f6-462f-86cf-610a798ab7c9 req-90774146-a141-4926-968b-d008bdab8be3 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] No waiting events found dispatching network-vif-unplugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:02:38 user nova-compute[72504]: DEBUG nova.compute.manager [req-f9362397-89f6-462f-86cf-610a798ab7c9 req-90774146-a141-4926-968b-d008bdab8be3 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received event network-vif-unplugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:02:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:38 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Instance destroyed successfully.
Aug 01 20:02:38 user nova-compute[72504]: DEBUG nova.objects.instance [None req-693954e8-ae61-4881-845a-d521dc2e0ad2 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lazy-loading 'resources' on Instance uuid 6377103d-7606-4a5d-a905-6b1439e52c93 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:02:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-693954e8-ae61-4881-845a-d521dc2e0ad2 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T19:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-166257871',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-166257871',id=22,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+wl8rcNpZ1mqzCl3rGvjYe+0M4mVedb0jJNstGOFGDnMLONV5/yGL7F28WYBgjT0J58cwNLWa81cZxxdYgg2c9g087PvPGLb9nXvb0L3iX84/jpo1Bt/FyUc3dte3RhQ==',key_name='tempest-keypair-1753450990',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:00:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da04aaa8143b44d5aa21f59a89cd57ee',ramdisk_id='',reservation_id='r-mdxab4hw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-836718209',owner_user_name='tempest-AttachVolumeShelveTestJSON-836718209-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:00:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6260679430fa4828b07bc890c62878c3',uuid=6377103d-7606-4a5d-a905-6b1439e52c93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "address": "fa:16:3e:3e:71:62", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9af0b4bf-bc", "ovs_interfaceid": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:02:38 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-693954e8-ae61-4881-845a-d521dc2e0ad2 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Converting VIF {"id": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "address": "fa:16:3e:3e:71:62", "network": {"id": "40b3d49e-3592-411a-93d6-5a44019ef136", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1495733246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da04aaa8143b44d5aa21f59a89cd57ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9af0b4bf-bc", "ovs_interfaceid": "9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:02:38 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-693954e8-ae61-4881-845a-d521dc2e0ad2 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:71:62,bridge_name='br-int',has_traffic_filtering=True,id=9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e,network=Network(40b3d49e-3592-411a-93d6-5a44019ef136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9af0b4bf-bc') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:02:38 user nova-compute[72504]: DEBUG os_vif [None req-693954e8-ae61-4881-845a-d521dc2e0ad2 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:71:62,bridge_name='br-int',has_traffic_filtering=True,id=9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e,network=Network(40b3d49e-3592-411a-93d6-5a44019ef136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9af0b4bf-bc') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:02:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9af0b4bf-bc, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:02:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:02:38 user nova-compute[72504]: INFO os_vif [None req-693954e8-ae61-4881-845a-d521dc2e0ad2 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:71:62,bridge_name='br-int',has_traffic_filtering=True,id=9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e,network=Network(40b3d49e-3592-411a-93d6-5a44019ef136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9af0b4bf-bc')
Aug 01 20:02:38 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-693954e8-ae61-4881-845a-d521dc2e0ad2 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Deleting instance files /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93_del
Aug 01 20:02:38 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-693954e8-ae61-4881-845a-d521dc2e0ad2 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Deletion of /opt/stack/data/nova/instances/6377103d-7606-4a5d-a905-6b1439e52c93_del complete
Aug 01 20:02:38 user nova-compute[72504]: INFO nova.compute.manager [None req-693954e8-ae61-4881-845a-d521dc2e0ad2 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 01 20:02:38 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-693954e8-ae61-4881-845a-d521dc2e0ad2 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:02:38 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:02:38 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:02:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-cac7a210-6a04-4984-b7ee-b4efc067e992 req-88c5ff51-c894-4dd0-8228-7cc16b2c0d14 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received event network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:02:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cac7a210-6a04-4984-b7ee-b4efc067e992 req-88c5ff51-c894-4dd0-8228-7cc16b2c0d14 service nova] Acquiring lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cac7a210-6a04-4984-b7ee-b4efc067e992 req-88c5ff51-c894-4dd0-8228-7cc16b2c0d14 service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cac7a210-6a04-4984-b7ee-b4efc067e992 req-88c5ff51-c894-4dd0-8228-7cc16b2c0d14 service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-cac7a210-6a04-4984-b7ee-b4efc067e992 req-88c5ff51-c894-4dd0-8228-7cc16b2c0d14 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] No waiting events found dispatching network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:02:40 user nova-compute[72504]: WARNING nova.compute.manager [req-cac7a210-6a04-4984-b7ee-b4efc067e992 req-88c5ff51-c894-4dd0-8228-7cc16b2c0d14 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received unexpected event network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e for instance with vm_state active and task_state deleting.
Aug 01 20:02:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-cac7a210-6a04-4984-b7ee-b4efc067e992 req-88c5ff51-c894-4dd0-8228-7cc16b2c0d14 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received event network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:02:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cac7a210-6a04-4984-b7ee-b4efc067e992 req-88c5ff51-c894-4dd0-8228-7cc16b2c0d14 service nova] Acquiring lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cac7a210-6a04-4984-b7ee-b4efc067e992 req-88c5ff51-c894-4dd0-8228-7cc16b2c0d14 service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cac7a210-6a04-4984-b7ee-b4efc067e992 req-88c5ff51-c894-4dd0-8228-7cc16b2c0d14 service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-cac7a210-6a04-4984-b7ee-b4efc067e992 req-88c5ff51-c894-4dd0-8228-7cc16b2c0d14 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] No waiting events found dispatching network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:02:40 user nova-compute[72504]: WARNING nova.compute.manager [req-cac7a210-6a04-4984-b7ee-b4efc067e992 req-88c5ff51-c894-4dd0-8228-7cc16b2c0d14 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received unexpected event network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e for instance with vm_state active and task_state deleting.
Aug 01 20:02:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-cac7a210-6a04-4984-b7ee-b4efc067e992 req-88c5ff51-c894-4dd0-8228-7cc16b2c0d14 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received event network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:02:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cac7a210-6a04-4984-b7ee-b4efc067e992 req-88c5ff51-c894-4dd0-8228-7cc16b2c0d14 service nova] Acquiring lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cac7a210-6a04-4984-b7ee-b4efc067e992 req-88c5ff51-c894-4dd0-8228-7cc16b2c0d14 service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cac7a210-6a04-4984-b7ee-b4efc067e992 req-88c5ff51-c894-4dd0-8228-7cc16b2c0d14 service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-cac7a210-6a04-4984-b7ee-b4efc067e992 req-88c5ff51-c894-4dd0-8228-7cc16b2c0d14 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] No waiting events found dispatching network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:02:40 user nova-compute[72504]: WARNING nova.compute.manager [req-cac7a210-6a04-4984-b7ee-b4efc067e992 req-88c5ff51-c894-4dd0-8228-7cc16b2c0d14 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received unexpected event network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e for instance with vm_state active and task_state deleting.
Aug 01 20:02:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-cac7a210-6a04-4984-b7ee-b4efc067e992 req-88c5ff51-c894-4dd0-8228-7cc16b2c0d14 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received event network-vif-unplugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:02:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cac7a210-6a04-4984-b7ee-b4efc067e992 req-88c5ff51-c894-4dd0-8228-7cc16b2c0d14 service nova] Acquiring lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cac7a210-6a04-4984-b7ee-b4efc067e992 req-88c5ff51-c894-4dd0-8228-7cc16b2c0d14 service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cac7a210-6a04-4984-b7ee-b4efc067e992 req-88c5ff51-c894-4dd0-8228-7cc16b2c0d14 service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-cac7a210-6a04-4984-b7ee-b4efc067e992 req-88c5ff51-c894-4dd0-8228-7cc16b2c0d14 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] No waiting events found dispatching network-vif-unplugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:02:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-cac7a210-6a04-4984-b7ee-b4efc067e992 req-88c5ff51-c894-4dd0-8228-7cc16b2c0d14 service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received event network-vif-unplugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:02:40 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:02:40 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Took 1.78 seconds to deallocate network for instance.
Aug 01 20:02:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-693954e8-ae61-4881-845a-d521dc2e0ad2 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-693954e8-ae61-4881-845a-d521dc2e0ad2 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:40 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-693954e8-ae61-4881-845a-d521dc2e0ad2 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:02:41 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-693954e8-ae61-4881-845a-d521dc2e0ad2 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:02:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-693954e8-ae61-4881-845a-d521dc2e0ad2 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:41 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-693954e8-ae61-4881-845a-d521dc2e0ad2 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Deleted allocations for instance 6377103d-7606-4a5d-a905-6b1439e52c93
Aug 01 20:02:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-693954e8-ae61-4881-845a-d521dc2e0ad2 tempest-AttachVolumeShelveTestJSON-836718209 tempest-AttachVolumeShelveTestJSON-836718209-project-member] Lock "6377103d-7606-4a5d-a905-6b1439e52c93" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.174s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:42 user nova-compute[72504]: DEBUG nova.compute.manager [req-37165321-76ab-46a7-b3af-265a62827ecc req-afd55c2d-542b-4970-b464-5a1b722a0e5a service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received event network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:02:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-37165321-76ab-46a7-b3af-265a62827ecc req-afd55c2d-542b-4970-b464-5a1b722a0e5a service nova] Acquiring lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-37165321-76ab-46a7-b3af-265a62827ecc req-afd55c2d-542b-4970-b464-5a1b722a0e5a service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-37165321-76ab-46a7-b3af-265a62827ecc req-afd55c2d-542b-4970-b464-5a1b722a0e5a service nova] Lock "6377103d-7606-4a5d-a905-6b1439e52c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:42 user nova-compute[72504]: DEBUG nova.compute.manager [req-37165321-76ab-46a7-b3af-265a62827ecc req-afd55c2d-542b-4970-b464-5a1b722a0e5a service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] No waiting events found dispatching network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:02:42 user nova-compute[72504]: WARNING nova.compute.manager [req-37165321-76ab-46a7-b3af-265a62827ecc req-afd55c2d-542b-4970-b464-5a1b722a0e5a service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received unexpected event network-vif-plugged-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e for instance with vm_state deleted and task_state None.
Aug 01 20:02:42 user nova-compute[72504]: DEBUG nova.compute.manager [req-37165321-76ab-46a7-b3af-265a62827ecc req-afd55c2d-542b-4970-b464-5a1b722a0e5a service nova] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Received event network-vif-deleted-9af0b4bf-bc55-493e-b5f9-84a0e4e94a5e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:02:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:50 user nova-compute[72504]: INFO nova.compute.manager [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Rescuing
Aug 01 20:02:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "refresh_cache-a53847a9-5dfc-422b-ba06-617dda589042" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:02:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquired lock "refresh_cache-a53847a9-5dfc-422b-ba06-617dda589042" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:02:50 user nova-compute[72504]: DEBUG nova.network.neutron [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:02:50 user nova-compute[72504]: DEBUG nova.network.neutron [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Updating instance_info_cache with network_info: [{"id": "48c8fc49-f988-42f1-8275-836370d6a5a8", "address": "fa:16:3e:c4:fb:c8", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c8fc49-f9", "ovs_interfaceid": "48c8fc49-f988-42f1-8275-836370d6a5a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:02:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Releasing lock "refresh_cache-a53847a9-5dfc-422b-ba06-617dda589042" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:02:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:51 user nova-compute[72504]: DEBUG nova.compute.manager [req-d74f540d-78ff-4a19-98bc-3a4791815d45 req-3413d576-f808-41bc-a2b2-24328e58d402 service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Received event network-vif-unplugged-48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:02:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d74f540d-78ff-4a19-98bc-3a4791815d45 req-3413d576-f808-41bc-a2b2-24328e58d402 service nova] Acquiring lock "a53847a9-5dfc-422b-ba06-617dda589042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d74f540d-78ff-4a19-98bc-3a4791815d45 req-3413d576-f808-41bc-a2b2-24328e58d402 service nova] Lock "a53847a9-5dfc-422b-ba06-617dda589042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d74f540d-78ff-4a19-98bc-3a4791815d45 req-3413d576-f808-41bc-a2b2-24328e58d402 service nova] Lock "a53847a9-5dfc-422b-ba06-617dda589042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:51 user nova-compute[72504]: DEBUG nova.compute.manager [req-d74f540d-78ff-4a19-98bc-3a4791815d45 req-3413d576-f808-41bc-a2b2-24328e58d402 service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] No waiting events found dispatching network-vif-unplugged-48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:02:51 user nova-compute[72504]: WARNING nova.compute.manager [req-d74f540d-78ff-4a19-98bc-3a4791815d45 req-3413d576-f808-41bc-a2b2-24328e58d402 service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Received unexpected event network-vif-unplugged-48c8fc49-f988-42f1-8275-836370d6a5a8 for instance with vm_state active and task_state rescuing.
Aug 01 20:02:51 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:51 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:51 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Instance destroyed successfully.
Aug 01 20:02:51 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Attempting a stable device rescue
Aug 01 20:02:51 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72504) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 20:02:51 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Instance directory exists: not creating {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 20:02:51 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Creating image(s)
Aug 01 20:02:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "/opt/stack/data/nova/instances/a53847a9-5dfc-422b-ba06-617dda589042/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "/opt/stack/data/nova/instances/a53847a9-5dfc-422b-ba06-617dda589042/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "/opt/stack/data/nova/instances/a53847a9-5dfc-422b-ba06-617dda589042/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:51 user nova-compute[72504]: DEBUG nova.objects.instance [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lazy-loading 'trusted_certs' on Instance uuid a53847a9-5dfc-422b-ba06-617dda589042 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:02:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "84172392ce6ee4d7bc762047142f8bdc7ebe9621" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "84172392ce6ee4d7bc762047142f8bdc7ebe9621" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84172392ce6ee4d7bc762047142f8bdc7ebe9621.part --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84172392ce6ee4d7bc762047142f8bdc7ebe9621.part --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:52 user nova-compute[72504]: DEBUG nova.virt.images [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] f7412a49-4779-4069-bad4-e6f85fa59835 was qcow2, converting to raw {{(pid=72504) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 20:02:52 user nova-compute[72504]: DEBUG nova.privsep.utils [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72504) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 20:02:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/84172392ce6ee4d7bc762047142f8bdc7ebe9621.part /opt/stack/data/nova/instances/_base/84172392ce6ee4d7bc762047142f8bdc7ebe9621.converted {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.compute.manager [req-ea7d41d5-4577-4bd8-aa9e-ac580c2edeb1 req-8b346ab1-8ca2-4010-bd7d-6c68ecc27c38 service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Received event network-vif-plugged-48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ea7d41d5-4577-4bd8-aa9e-ac580c2edeb1 req-8b346ab1-8ca2-4010-bd7d-6c68ecc27c38 service nova] Acquiring lock "a53847a9-5dfc-422b-ba06-617dda589042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ea7d41d5-4577-4bd8-aa9e-ac580c2edeb1 req-8b346ab1-8ca2-4010-bd7d-6c68ecc27c38 service nova] Lock "a53847a9-5dfc-422b-ba06-617dda589042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ea7d41d5-4577-4bd8-aa9e-ac580c2edeb1 req-8b346ab1-8ca2-4010-bd7d-6c68ecc27c38 service nova] Lock "a53847a9-5dfc-422b-ba06-617dda589042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.compute.manager [req-ea7d41d5-4577-4bd8-aa9e-ac580c2edeb1 req-8b346ab1-8ca2-4010-bd7d-6c68ecc27c38 service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] No waiting events found dispatching network-vif-plugged-48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:02:53 user nova-compute[72504]: WARNING nova.compute.manager [req-ea7d41d5-4577-4bd8-aa9e-ac580c2edeb1 req-8b346ab1-8ca2-4010-bd7d-6c68ecc27c38 service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Received unexpected event network-vif-plugged-48c8fc49-f988-42f1-8275-836370d6a5a8 for instance with vm_state active and task_state rescuing.
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/84172392ce6ee4d7bc762047142f8bdc7ebe9621.part /opt/stack/data/nova/instances/_base/84172392ce6ee4d7bc762047142f8bdc7ebe9621.converted" returned: 0 in 0.527s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84172392ce6ee4d7bc762047142f8bdc7ebe9621.converted --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84172392ce6ee4d7bc762047142f8bdc7ebe9621.converted --force-share --output=json" returned: 0 in 0.149s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "84172392ce6ee4d7bc762047142f8bdc7ebe9621" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.833s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "84172392ce6ee4d7bc762047142f8bdc7ebe9621" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "84172392ce6ee4d7bc762047142f8bdc7ebe9621" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84172392ce6ee4d7bc762047142f8bdc7ebe9621 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84172392ce6ee4d7bc762047142f8bdc7ebe9621 --force-share --output=json" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/84172392ce6ee4d7bc762047142f8bdc7ebe9621,backing_fmt=raw /opt/stack/data/nova/instances/a53847a9-5dfc-422b-ba06-617dda589042/disk.rescue {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690920158.6107354, 6377103d-7606-4a5d-a905-6b1439e52c93 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:02:53 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] VM Stopped (Lifecycle Event)
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/84172392ce6ee4d7bc762047142f8bdc7ebe9621,backing_fmt=raw /opt/stack/data/nova/instances/a53847a9-5dfc-422b-ba06-617dda589042/disk.rescue" returned: 0 in 0.065s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "84172392ce6ee4d7bc762047142f8bdc7ebe9621" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.objects.instance [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lazy-loading 'migration_context' on Instance uuid a53847a9-5dfc-422b-ba06-617dda589042 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3194751b-cba9-4b09-b0c3-c7bbab836a07 None None] [instance: 6377103d-7606-4a5d-a905-6b1439e52c93] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Start _get_guest_xml network_info=[{"id": "48c8fc49-f988-42f1-8275-836370d6a5a8", "address": "fa:16:3e:c4:fb:c8", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "vif_mac": "fa:16:3e:c4:fb:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c8fc49-f9", "ovs_interfaceid": "48c8fc49-f988-42f1-8275-836370d6a5a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f7412a49-4779-4069-bad4-e6f85fa59835', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iLjMVGKq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'a53847a9-5dfc-422b-ba06-617dda589042', 'attached_at': '', 'detached_at': '', 'volume_id': 'd37f13f6-502e-4e2e-a386-9a7d3ec020f1', 'serial': 'd37f13f6-502e-4e2e-a386-9a7d3ec020f1'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': '962f606f-7492-4030-a609-e051d41665a9', 'volume_type': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.objects.instance [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lazy-loading 'resources' on Instance uuid a53847a9-5dfc-422b-ba06-617dda589042 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.objects.instance [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lazy-loading 'numa_topology' on Instance uuid a53847a9-5dfc-422b-ba06-617dda589042 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:02:53 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:02:53 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.objects.instance [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lazy-loading 'vcpu_model' on Instance uuid a53847a9-5dfc-422b-ba06-617dda589042 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iLjMVGKq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:02:53 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:02:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:02:53 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:02:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:02:53 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb337769-7560-4012-8e36-43b5b9abf3d8]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = iLjMVGKq\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 01 20:02:53 user nova-compute[72504]: node.name = iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1
Aug 01 20:02:53 user nova-compute[72504]: node.tpgt = -1
Aug 01 20:02:53 user nova-compute[72504]: node.startup = automatic
Aug 01 20:02:53 user nova-compute[72504]: node.leading_login = No
Aug 01 20:02:53 user nova-compute[72504]: iface.iscsi_ifacename = default
Aug 01 20:02:53 user nova-compute[72504]: iface.net_ifacename = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.ipaddress = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.prefix_len = 0
Aug 01 20:02:53 user nova-compute[72504]: iface.hwaddress = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.transport_name = tcp
Aug 01 20:02:53 user nova-compute[72504]: iface.initiatorname = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.state = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.vlan_id = 0
Aug 01 20:02:53 user nova-compute[72504]: iface.vlan_priority = 0
Aug 01 20:02:53 user nova-compute[72504]: iface.vlan_state = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.iface_num = 0
Aug 01 20:02:53 user nova-compute[72504]: iface.mtu = 0
Aug 01 20:02:53 user nova-compute[72504]: iface.port = 0
Aug 01 20:02:53 user nova-compute[72504]: iface.bootproto = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.subnet_mask = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.gateway = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.dhcp_alt_client_id_state = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.dhcp_alt_client_id = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.dhcp_dns = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.dhcp_learn_iqn = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.dhcp_req_vendor_id_state = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.dhcp_vendor_id_state = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.dhcp_vendor_id = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.dhcp_slp_da = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.fragmentation = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.gratuitous_arp = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.incoming_forwarding = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.tos_state = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.tos = 0
Aug 01 20:02:53 user nova-compute[72504]: iface.ttl = 0
Aug 01 20:02:53 user nova-compute[72504]: iface.delayed_ack = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.tcp_nagle = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.tcp_wsf_state = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.tcp_wsf = 0
Aug 01 20:02:53 user nova-compute[72504]: iface.tcp_timer_scale = 0
Aug 01 20:02:53 user nova-compute[72504]: iface.tcp_timestamp = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.redirect = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.def_task_mgmt_timeout = 0
Aug 01 20:02:53 user nova-compute[72504]: iface.header_digest = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.data_digest = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.immediate_data = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.initial_r2t = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.data_seq_inorder = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.data_pdu_inorder = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.erl = 0
Aug 01 20:02:53 user nova-compute[72504]: iface.max_receive_data_len = 0
Aug 01 20:02:53 user nova-compute[72504]: iface.first_burst_len = 0
Aug 01 20:02:53 user nova-compute[72504]: iface.max_outstanding_r2t = 0
Aug 01 20:02:53 user nova-compute[72504]: iface.max_burst_len = 0
Aug 01 20:02:53 user nova-compute[72504]: iface.chap_auth = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.bidi_chap = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.strict_login_compliance = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.discovery_auth = <empty>
Aug 01 20:02:53 user nova-compute[72504]: iface.discovery_logout = <empty>
Aug 01 20:02:53 user nova-compute[72504]: node.discovery_address = <empty>
Aug 01 20:02:53 user nova-compute[72504]: node.discovery_port = 0
Aug 01 20:02:53 user nova-compute[72504]: node.discovery_type = static
Aug 01 20:02:53 user nova-compute[72504]: node.session.initial_cmdsn = 0
Aug 01 20:02:53 user nova-compute[72504]: node.session.initial_login_retry_max = 8
Aug 01 20:02:53 user nova-compute[72504]: node.session.xmit_thread_priority = -20
Aug 01 20:02:53 user nova-compute[72504]: node.session.cmds_max = 128
Aug 01 20:02:53 user nova-compute[72504]: node.session.queue_depth = 32
Aug 01 20:02:53 user nova-compute[72504]: node.session.nr_sessions = 1
Aug 01 20:02:53 user nova-compute[72504]: node.session.auth.authmethod = CHAP
Aug 01 20:02:53 user nova-compute[72504]: node.session.auth.username = iLjMVGKq
Aug 01 20:02:53 user nova-compute[72504]: node.session.auth.password = ***
Aug 01 20:02:53 user nova-compute[72504]: node.session.auth.username_in = <empty>
Aug 01 20:02:53 user nova-compute[72504]: node.session.auth.password_in = <empty>
Aug 01 20:02:53 user nova-compute[72504]: node.session.auth.chap_algs = MD5
Aug 01 20:02:53 user nova-compute[72504]: node.session.timeo.replacement_timeout = 120
Aug 01 20:02:53 user nova-compute[72504]: node.session.err_timeo.abort_timeout = 15
Aug 01 20:02:53 user nova-compute[72504]: node.session.err_timeo.lu_reset_timeout = 30
Aug 01 20:02:53 user nova-compute[72504]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 01 20:02:53 user nova-compute[72504]: node.session.err_timeo.host_reset_timeout = 60
Aug 01 20:02:53 user nova-compute[72504]: node.session.iscsi.FastAbort = Yes
Aug 01 20:02:53 user nova-compute[72504]: node.session.iscsi.InitialR2T = No
Aug 01 20:02:53 user nova-compute[72504]: node.session.iscsi.ImmediateData = Yes
Aug 01 20:02:53 user nova-compute[72504]: node.session.iscsi.FirstBurstLength = 262144
Aug 01 20:02:53 user nova-compute[72504]: node.session.iscsi.MaxBurstLength = 16776192
Aug 01 20:02:53 user nova-compute[72504]: node.session.iscsi.DefaultTime2Retain = 0
Aug 01 20:02:53 user nova-compute[72504]: node.session.iscsi.DefaultTime2Wait = 2
Aug 01 20:02:53 user nova-compute[72504]: node.session.iscsi.MaxConnections = 1
Aug 01 20:02:53 user nova-compute[72504]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 01 20:02:53 user nova-compute[72504]: node.session.iscsi.ERL = 0
Aug 01 20:02:53 user nova-compute[72504]: node.session.scan = manual
Aug 01 20:02:53 user nova-compute[72504]: node.session.reopen_max = 0
Aug 01 20:02:53 user nova-compute[72504]: node.conn[0].address = 172.16.0.220
Aug 01 20:02:53 user nova-compute[72504]: node.conn[0].port = 3260
Aug 01 20:02:53 user nova-compute[72504]: node.conn[0].startup = manual
Aug 01 20:02:53 user nova-compute[72504]: node.conn[0].tcp.window_size = 524288
Aug 01 20:02:53 user nova-compute[72504]: node.conn[0].tcp.type_of_service = 0
Aug 01 20:02:53 user nova-compute[72504]: node.conn[0].timeo.logout_timeout = 15
Aug 01 20:02:53 user nova-compute[72504]: node.conn[0].timeo.login_timeout = 15
Aug 01 20:02:53 user nova-compute[72504]: node.conn[0].timeo.auth_timeout = 45
Aug 01 20:02:53 user nova-compute[72504]: node.conn[0].timeo.noop_out_interval = 5
Aug 01 20:02:53 user nova-compute[72504]: node.conn[0].timeo.noop_out_timeout = 5
Aug 01 20:02:53 user nova-compute[72504]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 01 20:02:53 user nova-compute[72504]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 01 20:02:53 user nova-compute[72504]: node.conn[0].iscsi.HeaderDigest = None
Aug 01 20:02:53 user nova-compute[72504]: node.conn[0].iscsi.DataDigest = None
Aug 01 20:02:53 user nova-compute[72504]: node.conn[0].iscsi.IFMarker = No
Aug 01 20:02:53 user nova-compute[72504]: node.conn[0].iscsi.OFMarker = No
Aug 01 20:02:53 user nova-compute[72504]: # END RECORD
Aug 01 20:02:53 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf2fbc6-6014-4003-9769-caf26326f6d3]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3ecfdf-9e09-4511-a60c-bd0ed990736d]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iLjMVGKq {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iLjMVGKq" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2334578-7e7d-44e8-86aa-9749899094f9]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iLjMVGKq'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b89d09-5afc-4aa1-b406-80c286fafd48]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[166140aa-2893-4f85-93fd-a062d5f19360]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:02:53 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:02:53 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:02:53 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:02:53 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.167s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] HCTL ('35', '0', '0', 0) found on session 30 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1da0c8d-6da0-417c-88de-ea2f0c9a0ac3]: (4, ('0 0 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Searching for a device in session 30 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iLjMVGKq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.195s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] <== connect_volume: return (197ms) {'type': 'block', 'scsi_wwn': '23033343862616530', 'path': '/dev/sdd'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033343862616530', 'path': '/dev/sdd'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:00:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1477817368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1477817368',id=27,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:01:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b82898c99bce4f04afda7e9ff6e4d5db',ramdisk_id='',reservation_id='r-0ous9rfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-519115368',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:01:24Z,user_data=None,user_id='01263cb2c1874026be1c735abc966b45',uuid=a53847a9-5dfc-422b-ba06-617dda589042,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48c8fc49-f988-42f1-8275-836370d6a5a8", "address": "fa:16:3e:c4:fb:c8", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "vif_mac": "fa:16:3e:c4:fb:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c8fc49-f9", "ovs_interfaceid": "48c8fc49-f988-42f1-8275-836370d6a5a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Converting VIF {"id": "48c8fc49-f988-42f1-8275-836370d6a5a8", "address": "fa:16:3e:c4:fb:c8", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "vif_mac": "fa:16:3e:c4:fb:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c8fc49-f9", "ovs_interfaceid": "48c8fc49-f988-42f1-8275-836370d6a5a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:fb:c8,bridge_name='br-int',has_traffic_filtering=True,id=48c8fc49-f988-42f1-8275-836370d6a5a8,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c8fc49-f9') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.objects.instance [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lazy-loading 'pci_devices' on Instance uuid a53847a9-5dfc-422b-ba06-617dda589042 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:02:53 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:02:53 user nova-compute[72504]:   <uuid>a53847a9-5dfc-422b-ba06-617dda589042</uuid>
Aug 01 20:02:53 user nova-compute[72504]:   <name>instance-0000001b</name>
Aug 01 20:02:53 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:02:53 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:02:53 user nova-compute[72504]:   <metadata>
Aug 01 20:02:53 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:02:53 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:02:53 user nova-compute[72504]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1477817368</nova:name>
Aug 01 20:02:53 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:02:53</nova:creationTime>
Aug 01 20:02:53 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:02:53 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:02:53 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:02:53 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:02:53 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:02:53 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:02:53 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:02:53 user nova-compute[72504]:       <nova:owner>
Aug 01 20:02:53 user nova-compute[72504]:         <nova:user uuid="01263cb2c1874026be1c735abc966b45">tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member</nova:user>
Aug 01 20:02:53 user nova-compute[72504]:         <nova:project uuid="b82898c99bce4f04afda7e9ff6e4d5db">tempest-ServerBootFromVolumeStableRescueTest-519115368</nova:project>
Aug 01 20:02:53 user nova-compute[72504]:       </nova:owner>
Aug 01 20:02:53 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 20:02:53 user nova-compute[72504]:       <nova:ports>
Aug 01 20:02:53 user nova-compute[72504]:         <nova:port uuid="48c8fc49-f988-42f1-8275-836370d6a5a8">
Aug 01 20:02:53 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 20:02:53 user nova-compute[72504]:         </nova:port>
Aug 01 20:02:53 user nova-compute[72504]:       </nova:ports>
Aug 01 20:02:53 user nova-compute[72504]:     </nova:instance>
Aug 01 20:02:53 user nova-compute[72504]:   </metadata>
Aug 01 20:02:53 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:02:53 user nova-compute[72504]:     <system>
Aug 01 20:02:53 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:02:53 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:02:53 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:02:53 user nova-compute[72504]:       <entry name="serial">a53847a9-5dfc-422b-ba06-617dda589042</entry>
Aug 01 20:02:53 user nova-compute[72504]:       <entry name="uuid">a53847a9-5dfc-422b-ba06-617dda589042</entry>
Aug 01 20:02:53 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:02:53 user nova-compute[72504]:     </system>
Aug 01 20:02:53 user nova-compute[72504]:   </sysinfo>
Aug 01 20:02:53 user nova-compute[72504]:   <os>
Aug 01 20:02:53 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:02:53 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:02:53 user nova-compute[72504]:   </os>
Aug 01 20:02:53 user nova-compute[72504]:   <features>
Aug 01 20:02:53 user nova-compute[72504]:     <acpi/>
Aug 01 20:02:53 user nova-compute[72504]:     <apic/>
Aug 01 20:02:53 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:02:53 user nova-compute[72504]:   </features>
Aug 01 20:02:53 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:02:53 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:02:53 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:02:53 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:02:53 user nova-compute[72504]:   </clock>
Aug 01 20:02:53 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:02:53 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:02:53 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:02:53 user nova-compute[72504]:   </cpu>
Aug 01 20:02:53 user nova-compute[72504]:   <devices>
Aug 01 20:02:53 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 20:02:53 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:02:53 user nova-compute[72504]:       <source dev="/dev/sdd"/>
Aug 01 20:02:53 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:02:53 user nova-compute[72504]:       <serial>d37f13f6-502e-4e2e-a386-9a7d3ec020f1</serial>
Aug 01 20:02:53 user nova-compute[72504]:     </disk>
Aug 01 20:02:53 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 20:02:53 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 20:02:53 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/a53847a9-5dfc-422b-ba06-617dda589042/disk.rescue"/>
Aug 01 20:02:53 user nova-compute[72504]:       <target dev="vdb" bus="virtio"/>
Aug 01 20:02:53 user nova-compute[72504]:       <boot order="1"/>
Aug 01 20:02:53 user nova-compute[72504]:     </disk>
Aug 01 20:02:53 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:02:53 user nova-compute[72504]:       <mac address="fa:16:3e:c4:fb:c8"/>
Aug 01 20:02:53 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:02:53 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:02:53 user nova-compute[72504]:       <target dev="tap48c8fc49-f9"/>
Aug 01 20:02:53 user nova-compute[72504]:     </interface>
Aug 01 20:02:53 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:02:53 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/a53847a9-5dfc-422b-ba06-617dda589042/console.log" append="off"/>
Aug 01 20:02:53 user nova-compute[72504]:     </serial>
Aug 01 20:02:53 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:02:53 user nova-compute[72504]:     <video>
Aug 01 20:02:53 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:02:53 user nova-compute[72504]:     </video>
Aug 01 20:02:53 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:02:53 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:02:53 user nova-compute[72504]:     </rng>
Aug 01 20:02:53 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:02:53 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:02:53 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:02:53 user nova-compute[72504]:     </memballoon>
Aug 01 20:02:53 user nova-compute[72504]:   </devices>
Aug 01 20:02:53 user nova-compute[72504]: </domain>
Aug 01 20:02:53 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:02:54 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Instance destroyed successfully.
Aug 01 20:02:54 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:02:54 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:02:54 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] No VIF found with MAC fa:16:3e:c4:fb:c8, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:02:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-0251af3b-7136-47c9-a83e-74d451abed4f req-a8653548-e413-47f2-b257-56f2873e9462 service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Received event network-vif-plugged-48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:02:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0251af3b-7136-47c9-a83e-74d451abed4f req-a8653548-e413-47f2-b257-56f2873e9462 service nova] Acquiring lock "a53847a9-5dfc-422b-ba06-617dda589042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0251af3b-7136-47c9-a83e-74d451abed4f req-a8653548-e413-47f2-b257-56f2873e9462 service nova] Lock "a53847a9-5dfc-422b-ba06-617dda589042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0251af3b-7136-47c9-a83e-74d451abed4f req-a8653548-e413-47f2-b257-56f2873e9462 service nova] Lock "a53847a9-5dfc-422b-ba06-617dda589042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-0251af3b-7136-47c9-a83e-74d451abed4f req-a8653548-e413-47f2-b257-56f2873e9462 service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] No waiting events found dispatching network-vif-plugged-48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:02:55 user nova-compute[72504]: WARNING nova.compute.manager [req-0251af3b-7136-47c9-a83e-74d451abed4f req-a8653548-e413-47f2-b257-56f2873e9462 service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Received unexpected event network-vif-plugged-48c8fc49-f988-42f1-8275-836370d6a5a8 for instance with vm_state active and task_state rescuing.
Aug 01 20:02:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Removed pending event for a53847a9-5dfc-422b-ba06-617dda589042 due to event {{(pid=72504) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 20:02:57 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920177.6315374, a53847a9-5dfc-422b-ba06-617dda589042 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:02:57 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a53847a9-5dfc-422b-ba06-617dda589042] VM Resumed (Lifecycle Event)
Aug 01 20:02:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-f2712d05-71ab-4967-a37a-224c2d3970e7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:02:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:02:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:02:57 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a53847a9-5dfc-422b-ba06-617dda589042] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 20:02:57 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920177.6332574, a53847a9-5dfc-422b-ba06-617dda589042 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:02:57 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a53847a9-5dfc-422b-ba06-617dda589042] VM Started (Lifecycle Event)
Aug 01 20:02:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:02:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:02:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-7630cc71-206d-4f85-a68d-6c68a52de490 req-1fead8fb-87dd-4133-af1f-592fe2d20760 service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Received event network-vif-plugged-48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:02:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7630cc71-206d-4f85-a68d-6c68a52de490 req-1fead8fb-87dd-4133-af1f-592fe2d20760 service nova] Acquiring lock "a53847a9-5dfc-422b-ba06-617dda589042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:02:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7630cc71-206d-4f85-a68d-6c68a52de490 req-1fead8fb-87dd-4133-af1f-592fe2d20760 service nova] Lock "a53847a9-5dfc-422b-ba06-617dda589042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:02:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7630cc71-206d-4f85-a68d-6c68a52de490 req-1fead8fb-87dd-4133-af1f-592fe2d20760 service nova] Lock "a53847a9-5dfc-422b-ba06-617dda589042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:02:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-7630cc71-206d-4f85-a68d-6c68a52de490 req-1fead8fb-87dd-4133-af1f-592fe2d20760 service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] No waiting events found dispatching network-vif-plugged-48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:02:57 user nova-compute[72504]: WARNING nova.compute.manager [req-7630cc71-206d-4f85-a68d-6c68a52de490 req-1fead8fb-87dd-4133-af1f-592fe2d20760 service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Received unexpected event network-vif-plugged-48c8fc49-f988-42f1-8275-836370d6a5a8 for instance with vm_state rescued and task_state None.
Aug 01 20:02:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:02:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:03:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:03:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:03:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:03:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:03:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:03:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-30269c21-628d-47af-8d51-fc2dc70f9d94 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "554ecd73-e393-4db1-9a8c-6749991dd44c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:03:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-30269c21-628d-47af-8d51-fc2dc70f9d94 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "554ecd73-e393-4db1-9a8c-6749991dd44c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:03:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-30269c21-628d-47af-8d51-fc2dc70f9d94 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "554ecd73-e393-4db1-9a8c-6749991dd44c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:03:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-30269c21-628d-47af-8d51-fc2dc70f9d94 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "554ecd73-e393-4db1-9a8c-6749991dd44c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:03:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-30269c21-628d-47af-8d51-fc2dc70f9d94 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "554ecd73-e393-4db1-9a8c-6749991dd44c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:03:11 user nova-compute[72504]: INFO nova.compute.manager [None req-30269c21-628d-47af-8d51-fc2dc70f9d94 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Terminating instance
Aug 01 20:03:11 user nova-compute[72504]: DEBUG nova.compute.manager [None req-30269c21-628d-47af-8d51-fc2dc70f9d94 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:03:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:11 user nova-compute[72504]: DEBUG nova.compute.manager [req-342d02a1-bd47-45cd-be10-8c7b7dee6b71 req-e90bb400-43f1-4bd4-894e-264b71cce974 service nova] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Received event network-vif-unplugged-31d5c352-dfc0-4a1a-8ed8-327c933661c9 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:03:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-342d02a1-bd47-45cd-be10-8c7b7dee6b71 req-e90bb400-43f1-4bd4-894e-264b71cce974 service nova] Acquiring lock "554ecd73-e393-4db1-9a8c-6749991dd44c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:03:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-342d02a1-bd47-45cd-be10-8c7b7dee6b71 req-e90bb400-43f1-4bd4-894e-264b71cce974 service nova] Lock "554ecd73-e393-4db1-9a8c-6749991dd44c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:03:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-342d02a1-bd47-45cd-be10-8c7b7dee6b71 req-e90bb400-43f1-4bd4-894e-264b71cce974 service nova] Lock "554ecd73-e393-4db1-9a8c-6749991dd44c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:03:11 user nova-compute[72504]: DEBUG nova.compute.manager [req-342d02a1-bd47-45cd-be10-8c7b7dee6b71 req-e90bb400-43f1-4bd4-894e-264b71cce974 service nova] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] No waiting events found dispatching network-vif-unplugged-31d5c352-dfc0-4a1a-8ed8-327c933661c9 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:03:11 user nova-compute[72504]: DEBUG nova.compute.manager [req-342d02a1-bd47-45cd-be10-8c7b7dee6b71 req-e90bb400-43f1-4bd4-894e-264b71cce974 service nova] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Received event network-vif-unplugged-31d5c352-dfc0-4a1a-8ed8-327c933661c9 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:03:11 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Instance destroyed successfully.
Aug 01 20:03:11 user nova-compute[72504]: DEBUG nova.objects.instance [None req-30269c21-628d-47af-8d51-fc2dc70f9d94 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lazy-loading 'resources' on Instance uuid 554ecd73-e393-4db1-9a8c-6749991dd44c {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:03:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-30269c21-628d-47af-8d51-fc2dc70f9d94 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:00:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1570974455',display_name='tempest-AttachVolumeNegativeTest-server-1570974455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1570974455',id=26,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwbL/YqhbMbbdLOpeA9vhSfBI5kIRRhYl0eWbAIVuqUdNPRvjk+81V4bQQG1/1eaO4Kjs8LfkO1spXLoUBlaVtDBcv2rH+ePk3Qz+AE+MWOHG85OrOfAtpYB7mAqHoWjg==',key_name='tempest-keypair-2018424560',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:00:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15cc01820f324654b0959d5fb2adefc3',ramdisk_id='',reservation_id='r-0iyyp3jw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2109955223',owner_user_name='tempest-AttachVolumeNegativeTest-2109955223-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:00:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='451baacc96384f35bd8bbb87626ac52d',uuid=554ecd73-e393-4db1-9a8c-6749991dd44c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31d5c352-dfc0-4a1a-8ed8-327c933661c9", "address": "fa:16:3e:32:1c:cc", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d5c352-df", "ovs_interfaceid": "31d5c352-dfc0-4a1a-8ed8-327c933661c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:03:11 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-30269c21-628d-47af-8d51-fc2dc70f9d94 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Converting VIF {"id": "31d5c352-dfc0-4a1a-8ed8-327c933661c9", "address": "fa:16:3e:32:1c:cc", "network": {"id": "67292f1d-2643-4cfa-aaf6-0a698d87bfd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1572246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cc01820f324654b0959d5fb2adefc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d5c352-df", "ovs_interfaceid": "31d5c352-dfc0-4a1a-8ed8-327c933661c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:03:11 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-30269c21-628d-47af-8d51-fc2dc70f9d94 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:1c:cc,bridge_name='br-int',has_traffic_filtering=True,id=31d5c352-dfc0-4a1a-8ed8-327c933661c9,network=Network(67292f1d-2643-4cfa-aaf6-0a698d87bfd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31d5c352-df') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:03:11 user nova-compute[72504]: DEBUG os_vif [None req-30269c21-628d-47af-8d51-fc2dc70f9d94 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:1c:cc,bridge_name='br-int',has_traffic_filtering=True,id=31d5c352-dfc0-4a1a-8ed8-327c933661c9,network=Network(67292f1d-2643-4cfa-aaf6-0a698d87bfd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31d5c352-df') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:03:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31d5c352-df, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:03:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:03:11 user nova-compute[72504]: INFO os_vif [None req-30269c21-628d-47af-8d51-fc2dc70f9d94 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:1c:cc,bridge_name='br-int',has_traffic_filtering=True,id=31d5c352-dfc0-4a1a-8ed8-327c933661c9,network=Network(67292f1d-2643-4cfa-aaf6-0a698d87bfd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31d5c352-df')
Aug 01 20:03:11 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-30269c21-628d-47af-8d51-fc2dc70f9d94 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Deleting instance files /opt/stack/data/nova/instances/554ecd73-e393-4db1-9a8c-6749991dd44c_del
Aug 01 20:03:11 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-30269c21-628d-47af-8d51-fc2dc70f9d94 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Deletion of /opt/stack/data/nova/instances/554ecd73-e393-4db1-9a8c-6749991dd44c_del complete
Aug 01 20:03:11 user nova-compute[72504]: INFO nova.compute.manager [None req-30269c21-628d-47af-8d51-fc2dc70f9d94 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 01 20:03:11 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-30269c21-628d-47af-8d51-fc2dc70f9d94 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:03:11 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:03:11 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:03:12 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:03:12 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Took 0.93 seconds to deallocate network for instance.
Aug 01 20:03:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-30269c21-628d-47af-8d51-fc2dc70f9d94 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:03:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-30269c21-628d-47af-8d51-fc2dc70f9d94 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:03:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:13 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-30269c21-628d-47af-8d51-fc2dc70f9d94 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:03:13 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-30269c21-628d-47af-8d51-fc2dc70f9d94 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:03:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-30269c21-628d-47af-8d51-fc2dc70f9d94 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.430s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:03:13 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-30269c21-628d-47af-8d51-fc2dc70f9d94 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Deleted allocations for instance 554ecd73-e393-4db1-9a8c-6749991dd44c
Aug 01 20:03:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-30269c21-628d-47af-8d51-fc2dc70f9d94 tempest-AttachVolumeNegativeTest-2109955223 tempest-AttachVolumeNegativeTest-2109955223-project-member] Lock "554ecd73-e393-4db1-9a8c-6749991dd44c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.422s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:03:13 user nova-compute[72504]: DEBUG nova.compute.manager [req-dda774c3-0ba4-4966-aabb-0007733fde0a req-68734cbe-d6ed-4cd0-8554-aa7b9880ea1a service nova] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Received event network-vif-plugged-31d5c352-dfc0-4a1a-8ed8-327c933661c9 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:03:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-dda774c3-0ba4-4966-aabb-0007733fde0a req-68734cbe-d6ed-4cd0-8554-aa7b9880ea1a service nova] Acquiring lock "554ecd73-e393-4db1-9a8c-6749991dd44c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:03:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-dda774c3-0ba4-4966-aabb-0007733fde0a req-68734cbe-d6ed-4cd0-8554-aa7b9880ea1a service nova] Lock "554ecd73-e393-4db1-9a8c-6749991dd44c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:03:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-dda774c3-0ba4-4966-aabb-0007733fde0a req-68734cbe-d6ed-4cd0-8554-aa7b9880ea1a service nova] Lock "554ecd73-e393-4db1-9a8c-6749991dd44c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:03:13 user nova-compute[72504]: DEBUG nova.compute.manager [req-dda774c3-0ba4-4966-aabb-0007733fde0a req-68734cbe-d6ed-4cd0-8554-aa7b9880ea1a service nova] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] No waiting events found dispatching network-vif-plugged-31d5c352-dfc0-4a1a-8ed8-327c933661c9 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:03:13 user nova-compute[72504]: WARNING nova.compute.manager [req-dda774c3-0ba4-4966-aabb-0007733fde0a req-68734cbe-d6ed-4cd0-8554-aa7b9880ea1a service nova] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Received unexpected event network-vif-plugged-31d5c352-dfc0-4a1a-8ed8-327c933661c9 for instance with vm_state deleted and task_state None.
Aug 01 20:03:13 user nova-compute[72504]: DEBUG nova.compute.manager [req-dda774c3-0ba4-4966-aabb-0007733fde0a req-68734cbe-d6ed-4cd0-8554-aa7b9880ea1a service nova] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Received event network-vif-deleted-31d5c352-dfc0-4a1a-8ed8-327c933661c9 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:03:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:03:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:03:15 user nova-compute[72504]: DEBUG nova.objects.instance [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lazy-loading 'flavor' on Instance uuid 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:03:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:03:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:03:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:03:16 user nova-compute[72504]: INFO nova.compute.manager [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Attaching volume e86847da-b4ff-4e7d-87a0-2bbf576430c4 to /dev/vdb
Aug 01 20:03:16 user nova-compute[72504]: DEBUG os_brick.utils [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:03:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:16 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[740438b5-03f7-497e-986d-a2f8c83ccd73]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:16 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[febb5a0e-80b1-4612-973a-583a51c559ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:16 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec241e2f-1d3a-4c25-857b-1949c7e5b63f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:16 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdd17fd-6cac-4794-972a-294c8ae0ceb3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:03:16 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:03:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:03:16 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:03:16 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cc76ed-9fed-4fb6-898f-a32cded4acfb]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:16 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:03:16 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:03:16 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:03:16 user nova-compute[72504]: DEBUG os_brick.utils [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:03:16 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Updating existing volume attachment record: c4557984-d913-46bf-a499-b5ac1a1dbf78 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:03:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:19 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:03:21 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:03:21 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:03:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:22 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:03:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KBulVPZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:03:23 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:03:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:03:23 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:03:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:03:23 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:03:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[456cb1cb-b4f8-4ec5-8be0-1cd15c77a217]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:03:23 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be04c82-30d5-4dc0-a57c-0a0245e2a14f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4] added
Aug 01 20:03:23 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a8afc9-ffa0-422d-bd2d-2b48cfbe0243]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f60a50-3105-47ba-be0b-0115598ab31f]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KBulVPZf {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KBulVPZf" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ad026c-196d-405e-8610-50aa968dd24d]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KBulVPZf'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5df332-9bae-4678-8d8e-99a807322b3a]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:03:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:24 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fc7877-759c-4ff5-8c2d-cce7ed275507]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:03:24 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:03:24 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:03:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:03:24 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:03:24 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:03:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:24 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[264be6b2-8a0a-44da-b07c-de87414ff3b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4, portal: 172.16.0.220,3260]
Aug 01 20:03:24 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4, portal: 172.16.0.220,3260] successful.
Aug 01 20:03:24 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:03:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:24 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[43350225-ac3e-4eb8-b16d-c7de83137280]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:03:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:24 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b149142b-7b27-406e-98b8-983d77334078]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:03:24 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:03:24 user nova-compute[72504]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4 (non-flash)
Aug 01 20:03:24 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:03:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:03:24 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:03:24 user nova-compute[72504]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4 (non-flash)
Aug 01 20:03:24 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:03:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:03:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:03:24 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:03:24 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:03:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:24 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d218ec-2ace-4c4a-b5b4-053842230638]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:24 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: None {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:03:25 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:03:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KBulVPZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:03:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:03:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23533313737323939', 'path': '/dev/sdc'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:03:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533313737323939', 'path': '/dev/sdc'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:03:25 user nova-compute[72504]: DEBUG nova.objects.instance [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lazy-loading 'flavor' on Instance uuid 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:03:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 20:03:25 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:03:25 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 20:03:25 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:03:25 user nova-compute[72504]:   <serial>e86847da-b4ff-4e7d-87a0-2bbf576430c4</serial>
Aug 01 20:03:25 user nova-compute[72504]: </disk>
Aug 01 20:03:25 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 20:03:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:03:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:03:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] No VIF found with MAC fa:16:3e:45:db:12, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:03:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-28639c97-57c9-4eaa-8bb5-779a6e3caf7c tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.675s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:03:25 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:03:25 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:03:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:03:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:03:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:03:25 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:03:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:26 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690920191.858373, 554ecd73-e393-4db1-9a8c-6749991dd44c => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:03:26 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] VM Stopped (Lifecycle Event)
Aug 01 20:03:26 user nova-compute[72504]: DEBUG nova.compute.manager [None req-c57cbafd-e34f-4d37-a179-27b872c1147c None None] [instance: 554ecd73-e393-4db1-9a8c-6749991dd44c] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:03:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:03:26 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:03:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:03:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a53847a9-5dfc-422b-ba06-617dda589042/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a53847a9-5dfc-422b-ba06-617dda589042/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a53847a9-5dfc-422b-ba06-617dda589042/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a53847a9-5dfc-422b-ba06-617dda589042/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:03:28 user nova-compute[72504]: INFO nova.compute.manager [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Detaching volume e86847da-b4ff-4e7d-87a0-2bbf576430c4
Aug 01 20:03:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:28 user nova-compute[72504]: INFO nova.virt.block_device [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Attempting to driver detach volume e86847da-b4ff-4e7d-87a0-2bbf576430c4 from mountpoint /dev/vdb
Aug 01 20:03:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Attempting to detach device vdb from instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:03:28 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:03:28 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 20:03:28 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:03:28 user nova-compute[72504]:   <serial>e86847da-b4ff-4e7d-87a0-2bbf576430c4</serial>
Aug 01 20:03:28 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:03:28 user nova-compute[72504]: </disk>
Aug 01 20:03:28 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:03:28 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Successfully detached device vdb from instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 from the persistent domain config.
Aug 01 20:03:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:03:28 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:03:28 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 20:03:28 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:03:28 user nova-compute[72504]:   <serial>e86847da-b4ff-4e7d-87a0-2bbf576430c4</serial>
Aug 01 20:03:28 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:03:28 user nova-compute[72504]: </disk>
Aug 01 20:03:28 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690920208.8898046, 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 20:03:28 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Successfully detached device vdb from instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 from the live domain config.
Aug 01 20:03:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KBulVPZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:03:28 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:03:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0e00a1-73a2-4c34-8288-9a3d0c2dc0db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[900d7ecd-5848-4300-88f1-aba2242e50be]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:03:28 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:03:28 user nova-compute[72504]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4 (non-flash)
Aug 01 20:03:28 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:03:28 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:03:28 user nova-compute[72504]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4 (non-flash)
Aug 01 20:03:28 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff40c196cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4'): ({'sdc'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Removing single pathed devices sdc {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:03:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffdc3be-95ab-4b03-b460-6455470b538b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc1282c-2bb0-456b-a37e-137a85803701]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Flushing IO for device /dev/sdc {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56748e5-b744-47fc-9ffd-19b8f49b9a74]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ec26df-ea8f-46fc-aacc-951b290949a4]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:29 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:03:29 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:03:29 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=7505MB free_disk=25.050174713134766GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7c71ed-a635-4abc-9c42-a2910be43080]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4a293d-1f9a-4d52-913e-d0b5f7adc004]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4, portal: 172.16.0.220,3260]
Aug 01 20:03:29 user nova-compute[72504]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4, portal: 172.16.0.220,3260] successful.
Aug 01 20:03:29 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e86847da-b4ff-4e7d-87a0-2bbf576430c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[69113169-42e1-4091-a76c-7ced19a00660]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.800s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] <== disconnect_volume: return (802ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 7391a8ce-7ce5-47ec-97f6-6159645688ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 128c2981-363c-4ae9-b46d-15b5e5d9cac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 88f95d20-e391-4100-93b2-da29bfcf9704 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 54812de2-bfe3-46f1-a327-8081fbb80bec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance a53847a9-5dfc-422b-ba06-617dda589042 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance e19bf04b-43e0-4153-a6b5-74dbe36fedb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1ac6e0af-4adb-47a7-988e-971aa5efeb2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:03:29 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:03:30 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:03:30 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:03:30 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:03:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.587s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:03:30 user nova-compute[72504]: DEBUG nova.objects.instance [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lazy-loading 'flavor' on Instance uuid 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:03:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f21913b1-df0b-4bf5-bab9-e65c1413cc18 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.439s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:03:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:33 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:03:33 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:03:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:03:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-7391a8ce-7ce5-47ec-97f6-6159645688ea" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:03:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-7391a8ce-7ce5-47ec-97f6-6159645688ea" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:03:33 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:03:33 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Updating instance_info_cache with network_info: [{"id": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "address": "fa:16:3e:08:82:e6", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd06cd7-81", "ovs_interfaceid": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:03:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-7391a8ce-7ce5-47ec-97f6-6159645688ea" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:03:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:03:33 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:03:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Acquiring lock "ce155874-97ba-4266-86e1-3271c9879430" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:03:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "ce155874-97ba-4266-86e1-3271c9879430" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:03:40 user nova-compute[72504]: DEBUG nova.compute.manager [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 20:03:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:03:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:03:40 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:03:40 user nova-compute[72504]: INFO nova.compute.claims [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Claim successful on node user
Aug 01 20:03:41 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:03:41 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:03:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:03:41 user nova-compute[72504]: DEBUG nova.compute.manager [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 20:03:41 user nova-compute[72504]: DEBUG nova.compute.manager [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 20:03:41 user nova-compute[72504]: DEBUG nova.network.neutron [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 20:03:41 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 20:03:41 user nova-compute[72504]: DEBUG nova.compute.manager [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 20:03:41 user nova-compute[72504]: DEBUG nova.policy [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b77d4b9227844b3180c2f68ff394358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775eb768511548d4b67c176de13c0965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 20:03:41 user nova-compute[72504]: DEBUG nova.compute.manager [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 20:03:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:03:41 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Creating image(s)
Aug 01 20:03:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:03:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "/opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:03:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "/opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:03:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.183s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:03:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:03:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.134s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430/disk 1073741824" returned: 0 in 0.050s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:03:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:42 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 20:03:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:42 user nova-compute[72504]: DEBUG nova.network.neutron [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Successfully created port: 506369dd-7925-4369-abe3-640b8268b134 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 20:03:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:42 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Cannot resize image /opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 20:03:42 user nova-compute[72504]: DEBUG nova.objects.instance [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lazy-loading 'migration_context' on Instance uuid ce155874-97ba-4266-86e1-3271c9879430 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:03:42 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 20:03:42 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Ensure instance console log exists: /opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:03:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:03:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:03:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:03:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:43 user nova-compute[72504]: DEBUG nova.network.neutron [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Successfully updated port: 506369dd-7925-4369-abe3-640b8268b134 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 20:03:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Acquiring lock "refresh_cache-ce155874-97ba-4266-86e1-3271c9879430" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:03:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Acquired lock "refresh_cache-ce155874-97ba-4266-86e1-3271c9879430" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:03:43 user nova-compute[72504]: DEBUG nova.network.neutron [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:03:43 user nova-compute[72504]: DEBUG nova.compute.manager [req-3f5c48b7-57f9-4969-a1dd-5d047f9c50e9 req-9d9dd9b0-45b6-43ff-99d5-fe6a023985b6 service nova] [instance: ce155874-97ba-4266-86e1-3271c9879430] Received event network-changed-506369dd-7925-4369-abe3-640b8268b134 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:03:43 user nova-compute[72504]: DEBUG nova.compute.manager [req-3f5c48b7-57f9-4969-a1dd-5d047f9c50e9 req-9d9dd9b0-45b6-43ff-99d5-fe6a023985b6 service nova] [instance: ce155874-97ba-4266-86e1-3271c9879430] Refreshing instance network info cache due to event network-changed-506369dd-7925-4369-abe3-640b8268b134. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:03:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3f5c48b7-57f9-4969-a1dd-5d047f9c50e9 req-9d9dd9b0-45b6-43ff-99d5-fe6a023985b6 service nova] Acquiring lock "refresh_cache-ce155874-97ba-4266-86e1-3271c9879430" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:03:43 user nova-compute[72504]: DEBUG nova.network.neutron [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:03:43 user nova-compute[72504]: DEBUG nova.network.neutron [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Updating instance_info_cache with network_info: [{"id": "506369dd-7925-4369-abe3-640b8268b134", "address": "fa:16:3e:7f:e7:bd", "network": {"id": "ae078c7d-f61f-443f-b40a-d176d82bd28c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1545473901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775eb768511548d4b67c176de13c0965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap506369dd-79", "ovs_interfaceid": "506369dd-7925-4369-abe3-640b8268b134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:03:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Releasing lock "refresh_cache-ce155874-97ba-4266-86e1-3271c9879430" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:03:43 user nova-compute[72504]: DEBUG nova.compute.manager [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Instance network_info: |[{"id": "506369dd-7925-4369-abe3-640b8268b134", "address": "fa:16:3e:7f:e7:bd", "network": {"id": "ae078c7d-f61f-443f-b40a-d176d82bd28c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1545473901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775eb768511548d4b67c176de13c0965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap506369dd-79", "ovs_interfaceid": "506369dd-7925-4369-abe3-640b8268b134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 20:03:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3f5c48b7-57f9-4969-a1dd-5d047f9c50e9 req-9d9dd9b0-45b6-43ff-99d5-fe6a023985b6 service nova] Acquired lock "refresh_cache-ce155874-97ba-4266-86e1-3271c9879430" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:03:43 user nova-compute[72504]: DEBUG nova.network.neutron [req-3f5c48b7-57f9-4969-a1dd-5d047f9c50e9 req-9d9dd9b0-45b6-43ff-99d5-fe6a023985b6 service nova] [instance: ce155874-97ba-4266-86e1-3271c9879430] Refreshing network info cache for port 506369dd-7925-4369-abe3-640b8268b134 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:03:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Start _get_guest_xml network_info=[{"id": "506369dd-7925-4369-abe3-640b8268b134", "address": "fa:16:3e:7f:e7:bd", "network": {"id": "ae078c7d-f61f-443f-b40a-d176d82bd28c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1545473901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775eb768511548d4b67c176de13c0965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap506369dd-79", "ovs_interfaceid": "506369dd-7925-4369-abe3-640b8268b134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:03:44 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:03:44 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:03:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:03:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-894837217',display_name='tempest-TestServerVolumeAttachmentScenario-server-894837217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-894837217',id=30,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKOH706o8umkzoFopoT9Vgi6dJSYrEzc7KzHgd7IIPOJTpILOgdtyuhhU0gby0WZMfK/sXgtkFwbvwL8gfM9HC+lnFt1wKjrVtdPgTRzZDTVJYMSbNoNNnH8EHlgevW+g==',key_name='tempest-keypair-1825939942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='775eb768511548d4b67c176de13c0965',ramdisk_id='',reservation_id='r-zbr3san6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1531898548',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1531898548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:03:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b77d4b9227844b3180c2f68ff394358d',uuid=ce155874-97ba-4266-86e1-3271c9879430,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "506369dd-7925-4369-abe3-640b8268b134", "address": "fa:16:3e:7f:e7:bd", "network": {"id": "ae078c7d-f61f-443f-b40a-d176d82bd28c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1545473901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775eb768511548d4b67c176de13c0965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap506369dd-79", "ovs_interfaceid": "506369dd-7925-4369-abe3-640b8268b134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Converting VIF {"id": "506369dd-7925-4369-abe3-640b8268b134", "address": "fa:16:3e:7f:e7:bd", "network": {"id": "ae078c7d-f61f-443f-b40a-d176d82bd28c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1545473901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775eb768511548d4b67c176de13c0965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap506369dd-79", "ovs_interfaceid": "506369dd-7925-4369-abe3-640b8268b134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:e7:bd,bridge_name='br-int',has_traffic_filtering=True,id=506369dd-7925-4369-abe3-640b8268b134,network=Network(ae078c7d-f61f-443f-b40a-d176d82bd28c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap506369dd-79') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG nova.objects.instance [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lazy-loading 'pci_devices' on Instance uuid ce155874-97ba-4266-86e1-3271c9879430 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:03:44 user nova-compute[72504]:   <uuid>ce155874-97ba-4266-86e1-3271c9879430</uuid>
Aug 01 20:03:44 user nova-compute[72504]:   <name>instance-0000001e</name>
Aug 01 20:03:44 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:03:44 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:03:44 user nova-compute[72504]:   <metadata>
Aug 01 20:03:44 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:03:44 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:03:44 user nova-compute[72504]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-894837217</nova:name>
Aug 01 20:03:44 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:03:44</nova:creationTime>
Aug 01 20:03:44 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:03:44 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:03:44 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:03:44 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:03:44 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:03:44 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:03:44 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:03:44 user nova-compute[72504]:       <nova:owner>
Aug 01 20:03:44 user nova-compute[72504]:         <nova:user uuid="b77d4b9227844b3180c2f68ff394358d">tempest-TestServerVolumeAttachmentScenario-1531898548-project-member</nova:user>
Aug 01 20:03:44 user nova-compute[72504]:         <nova:project uuid="775eb768511548d4b67c176de13c0965">tempest-TestServerVolumeAttachmentScenario-1531898548</nova:project>
Aug 01 20:03:44 user nova-compute[72504]:       </nova:owner>
Aug 01 20:03:44 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 20:03:44 user nova-compute[72504]:       <nova:ports>
Aug 01 20:03:44 user nova-compute[72504]:         <nova:port uuid="506369dd-7925-4369-abe3-640b8268b134">
Aug 01 20:03:44 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 20:03:44 user nova-compute[72504]:         </nova:port>
Aug 01 20:03:44 user nova-compute[72504]:       </nova:ports>
Aug 01 20:03:44 user nova-compute[72504]:     </nova:instance>
Aug 01 20:03:44 user nova-compute[72504]:   </metadata>
Aug 01 20:03:44 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:03:44 user nova-compute[72504]:     <system>
Aug 01 20:03:44 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:03:44 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:03:44 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:03:44 user nova-compute[72504]:       <entry name="serial">ce155874-97ba-4266-86e1-3271c9879430</entry>
Aug 01 20:03:44 user nova-compute[72504]:       <entry name="uuid">ce155874-97ba-4266-86e1-3271c9879430</entry>
Aug 01 20:03:44 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:03:44 user nova-compute[72504]:     </system>
Aug 01 20:03:44 user nova-compute[72504]:   </sysinfo>
Aug 01 20:03:44 user nova-compute[72504]:   <os>
Aug 01 20:03:44 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:03:44 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:03:44 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:03:44 user nova-compute[72504]:   </os>
Aug 01 20:03:44 user nova-compute[72504]:   <features>
Aug 01 20:03:44 user nova-compute[72504]:     <acpi/>
Aug 01 20:03:44 user nova-compute[72504]:     <apic/>
Aug 01 20:03:44 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:03:44 user nova-compute[72504]:   </features>
Aug 01 20:03:44 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:03:44 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:03:44 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:03:44 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:03:44 user nova-compute[72504]:   </clock>
Aug 01 20:03:44 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:03:44 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:03:44 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:03:44 user nova-compute[72504]:   </cpu>
Aug 01 20:03:44 user nova-compute[72504]:   <devices>
Aug 01 20:03:44 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 20:03:44 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 20:03:44 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430/disk"/>
Aug 01 20:03:44 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:03:44 user nova-compute[72504]:     </disk>
Aug 01 20:03:44 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:03:44 user nova-compute[72504]:       <mac address="fa:16:3e:7f:e7:bd"/>
Aug 01 20:03:44 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:03:44 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:03:44 user nova-compute[72504]:       <target dev="tap506369dd-79"/>
Aug 01 20:03:44 user nova-compute[72504]:     </interface>
Aug 01 20:03:44 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:03:44 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430/console.log" append="off"/>
Aug 01 20:03:44 user nova-compute[72504]:     </serial>
Aug 01 20:03:44 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:03:44 user nova-compute[72504]:     <video>
Aug 01 20:03:44 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:03:44 user nova-compute[72504]:     </video>
Aug 01 20:03:44 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:03:44 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:03:44 user nova-compute[72504]:     </rng>
Aug 01 20:03:44 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:03:44 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:03:44 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:03:44 user nova-compute[72504]:     </memballoon>
Aug 01 20:03:44 user nova-compute[72504]:   </devices>
Aug 01 20:03:44 user nova-compute[72504]: </domain>
Aug 01 20:03:44 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:03:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-894837217',display_name='tempest-TestServerVolumeAttachmentScenario-server-894837217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-894837217',id=30,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKOH706o8umkzoFopoT9Vgi6dJSYrEzc7KzHgd7IIPOJTpILOgdtyuhhU0gby0WZMfK/sXgtkFwbvwL8gfM9HC+lnFt1wKjrVtdPgTRzZDTVJYMSbNoNNnH8EHlgevW+g==',key_name='tempest-keypair-1825939942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='775eb768511548d4b67c176de13c0965',ramdisk_id='',reservation_id='r-zbr3san6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1531898548',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1531898548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:03:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b77d4b9227844b3180c2f68ff394358d',uuid=ce155874-97ba-4266-86e1-3271c9879430,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "506369dd-7925-4369-abe3-640b8268b134", "address": "fa:16:3e:7f:e7:bd", "network": {"id": "ae078c7d-f61f-443f-b40a-d176d82bd28c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1545473901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775eb768511548d4b67c176de13c0965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap506369dd-79", "ovs_interfaceid": "506369dd-7925-4369-abe3-640b8268b134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Converting VIF {"id": "506369dd-7925-4369-abe3-640b8268b134", "address": "fa:16:3e:7f:e7:bd", "network": {"id": "ae078c7d-f61f-443f-b40a-d176d82bd28c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1545473901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775eb768511548d4b67c176de13c0965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap506369dd-79", "ovs_interfaceid": "506369dd-7925-4369-abe3-640b8268b134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:e7:bd,bridge_name='br-int',has_traffic_filtering=True,id=506369dd-7925-4369-abe3-640b8268b134,network=Network(ae078c7d-f61f-443f-b40a-d176d82bd28c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap506369dd-79') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG os_vif [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:e7:bd,bridge_name='br-int',has_traffic_filtering=True,id=506369dd-7925-4369-abe3-640b8268b134,network=Network(ae078c7d-f61f-443f-b40a-d176d82bd28c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap506369dd-79') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap506369dd-79, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap506369dd-79, col_values=(('external_ids', {'iface-id': '506369dd-7925-4369-abe3-640b8268b134', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:e7:bd', 'vm-uuid': 'ce155874-97ba-4266-86e1-3271c9879430'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:44 user nova-compute[72504]: INFO os_vif [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:e7:bd,bridge_name='br-int',has_traffic_filtering=True,id=506369dd-7925-4369-abe3-640b8268b134,network=Network(ae078c7d-f61f-443f-b40a-d176d82bd28c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap506369dd-79')
Aug 01 20:03:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] No VIF found with MAC fa:16:3e:7f:e7:bd, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG nova.network.neutron [req-3f5c48b7-57f9-4969-a1dd-5d047f9c50e9 req-9d9dd9b0-45b6-43ff-99d5-fe6a023985b6 service nova] [instance: ce155874-97ba-4266-86e1-3271c9879430] Updated VIF entry in instance network info cache for port 506369dd-7925-4369-abe3-640b8268b134. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG nova.network.neutron [req-3f5c48b7-57f9-4969-a1dd-5d047f9c50e9 req-9d9dd9b0-45b6-43ff-99d5-fe6a023985b6 service nova] [instance: ce155874-97ba-4266-86e1-3271c9879430] Updating instance_info_cache with network_info: [{"id": "506369dd-7925-4369-abe3-640b8268b134", "address": "fa:16:3e:7f:e7:bd", "network": {"id": "ae078c7d-f61f-443f-b40a-d176d82bd28c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1545473901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775eb768511548d4b67c176de13c0965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap506369dd-79", "ovs_interfaceid": "506369dd-7925-4369-abe3-640b8268b134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:03:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3f5c48b7-57f9-4969-a1dd-5d047f9c50e9 req-9d9dd9b0-45b6-43ff-99d5-fe6a023985b6 service nova] Releasing lock "refresh_cache-ce155874-97ba-4266-86e1-3271c9879430" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:03:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:45 user nova-compute[72504]: DEBUG nova.compute.manager [req-fe523a0a-b95d-4d4f-9ad8-dd580b971661 req-b31e744c-15ae-482e-9bdb-decc943c560a service nova] [instance: ce155874-97ba-4266-86e1-3271c9879430] Received event network-vif-plugged-506369dd-7925-4369-abe3-640b8268b134 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:03:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-fe523a0a-b95d-4d4f-9ad8-dd580b971661 req-b31e744c-15ae-482e-9bdb-decc943c560a service nova] Acquiring lock "ce155874-97ba-4266-86e1-3271c9879430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:03:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-fe523a0a-b95d-4d4f-9ad8-dd580b971661 req-b31e744c-15ae-482e-9bdb-decc943c560a service nova] Lock "ce155874-97ba-4266-86e1-3271c9879430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:03:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-fe523a0a-b95d-4d4f-9ad8-dd580b971661 req-b31e744c-15ae-482e-9bdb-decc943c560a service nova] Lock "ce155874-97ba-4266-86e1-3271c9879430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:03:45 user nova-compute[72504]: DEBUG nova.compute.manager [req-fe523a0a-b95d-4d4f-9ad8-dd580b971661 req-b31e744c-15ae-482e-9bdb-decc943c560a service nova] [instance: ce155874-97ba-4266-86e1-3271c9879430] No waiting events found dispatching network-vif-plugged-506369dd-7925-4369-abe3-640b8268b134 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:03:45 user nova-compute[72504]: WARNING nova.compute.manager [req-fe523a0a-b95d-4d4f-9ad8-dd580b971661 req-b31e744c-15ae-482e-9bdb-decc943c560a service nova] [instance: ce155874-97ba-4266-86e1-3271c9879430] Received unexpected event network-vif-plugged-506369dd-7925-4369-abe3-640b8268b134 for instance with vm_state building and task_state spawning.
Aug 01 20:03:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG nova.objects.instance [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'flavor' on Instance uuid e19bf04b-43e0-4153-a6b5-74dbe36fedb0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:03:47 user nova-compute[72504]: INFO nova.compute.manager [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Attaching volume 27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 to /dev/vdb
Aug 01 20:03:47 user nova-compute[72504]: DEBUG os_brick.utils [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ddc9c4-7944-4ce1-a325-79740065d868]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fc2a1b-3f1e-476b-9fbe-711c4f0594f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4c8442-4f13-4f1e-bb9f-0ce924f0d606]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe875b1b-f4e7-42d6-963a-e22928df29ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920227.7197323, ce155874-97ba-4266-86e1-3271c9879430 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:03:47 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: ce155874-97ba-4266-86e1-3271c9879430] VM Resumed (Lifecycle Event)
Aug 01 20:03:47 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG nova.compute.manager [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG nova.compute.manager [req-e32a75c5-655c-4ef2-954b-d58a56fefc64 req-8f401b4f-e28e-48ce-9d70-1143dbdfe757 service nova] [instance: ce155874-97ba-4266-86e1-3271c9879430] Received event network-vif-plugged-506369dd-7925-4369-abe3-640b8268b134 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e32a75c5-655c-4ef2-954b-d58a56fefc64 req-8f401b4f-e28e-48ce-9d70-1143dbdfe757 service nova] Acquiring lock "ce155874-97ba-4266-86e1-3271c9879430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e32a75c5-655c-4ef2-954b-d58a56fefc64 req-8f401b4f-e28e-48ce-9d70-1143dbdfe757 service nova] Lock "ce155874-97ba-4266-86e1-3271c9879430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e32a75c5-655c-4ef2-954b-d58a56fefc64 req-8f401b4f-e28e-48ce-9d70-1143dbdfe757 service nova] Lock "ce155874-97ba-4266-86e1-3271c9879430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG nova.compute.manager [req-e32a75c5-655c-4ef2-954b-d58a56fefc64 req-8f401b4f-e28e-48ce-9d70-1143dbdfe757 service nova] [instance: ce155874-97ba-4266-86e1-3271c9879430] No waiting events found dispatching network-vif-plugged-506369dd-7925-4369-abe3-640b8268b134 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:03:47 user nova-compute[72504]: WARNING nova.compute.manager [req-e32a75c5-655c-4ef2-954b-d58a56fefc64 req-8f401b4f-e28e-48ce-9d70-1143dbdfe757 service nova] [instance: ce155874-97ba-4266-86e1-3271c9879430] Received unexpected event network-vif-plugged-506369dd-7925-4369-abe3-640b8268b134 for instance with vm_state building and task_state spawning.
Aug 01 20:03:47 user nova-compute[72504]: DEBUG nova.compute.manager [req-e32a75c5-655c-4ef2-954b-d58a56fefc64 req-8f401b4f-e28e-48ce-9d70-1143dbdfe757 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received event network-changed-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG nova.compute.manager [req-e32a75c5-655c-4ef2-954b-d58a56fefc64 req-8f401b4f-e28e-48ce-9d70-1143dbdfe757 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Refreshing instance network info cache due to event network-changed-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e32a75c5-655c-4ef2-954b-d58a56fefc64 req-8f401b4f-e28e-48ce-9d70-1143dbdfe757 service nova] Acquiring lock "refresh_cache-e19bf04b-43e0-4153-a6b5-74dbe36fedb0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e32a75c5-655c-4ef2-954b-d58a56fefc64 req-8f401b4f-e28e-48ce-9d70-1143dbdfe757 service nova] Acquired lock "refresh_cache-e19bf04b-43e0-4153-a6b5-74dbe36fedb0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG nova.network.neutron [req-e32a75c5-655c-4ef2-954b-d58a56fefc64 req-8f401b4f-e28e-48ce-9d70-1143dbdfe757 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Refreshing network info cache for port 6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:03:47 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:03:47 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: ce155874-97ba-4266-86e1-3271c9879430] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[541699ed-cd6c-48f5-80bb-6d6a5328f2dd]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG os_brick.utils [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Updating existing volume attachment record: 2829d7a2-4ac8-4729-a486-7fc760f37948 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:03:47 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: ce155874-97ba-4266-86e1-3271c9879430] Instance spawned successfully.
Aug 01 20:03:47 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: ce155874-97ba-4266-86e1-3271c9879430] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:03:47 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: ce155874-97ba-4266-86e1-3271c9879430] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:03:47 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920227.7298994, ce155874-97ba-4266-86e1-3271c9879430 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:03:47 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: ce155874-97ba-4266-86e1-3271c9879430] VM Started (Lifecycle Event)
Aug 01 20:03:47 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: ce155874-97ba-4266-86e1-3271c9879430] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:03:47 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: ce155874-97ba-4266-86e1-3271c9879430] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:03:47 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: ce155874-97ba-4266-86e1-3271c9879430] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:03:47 user nova-compute[72504]: INFO nova.compute.manager [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Took 6.39 seconds to spawn the instance on the hypervisor.
Aug 01 20:03:47 user nova-compute[72504]: DEBUG nova.compute.manager [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:03:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:48 user nova-compute[72504]: INFO nova.compute.manager [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Took 7.21 seconds to build instance.
Aug 01 20:03:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9cec76ae-78eb-477c-9386-19d7743dcbf7 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "ce155874-97ba-4266-86e1-3271c9879430" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.313s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:03:48 user nova-compute[72504]: DEBUG nova.network.neutron [req-e32a75c5-655c-4ef2-954b-d58a56fefc64 req-8f401b4f-e28e-48ce-9d70-1143dbdfe757 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Updated VIF entry in instance network info cache for port 6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:03:48 user nova-compute[72504]: DEBUG nova.network.neutron [req-e32a75c5-655c-4ef2-954b-d58a56fefc64 req-8f401b4f-e28e-48ce-9d70-1143dbdfe757 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Updating instance_info_cache with network_info: [{"id": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "address": "fa:16:3e:c2:53:7c", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d66fd17-3c", "ovs_interfaceid": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:03:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e32a75c5-655c-4ef2-954b-d58a56fefc64 req-8f401b4f-e28e-48ce-9d70-1143dbdfe757 service nova] Releasing lock "refresh_cache-e19bf04b-43e0-4153-a6b5-74dbe36fedb0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:03:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Acquiring lock "0163556c-3f0f-4e08-81a1-56f52ae805a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:03:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "0163556c-3f0f-4e08-81a1-56f52ae805a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:03:55 user nova-compute[72504]: DEBUG nova.compute.manager [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 20:03:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:03:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:03:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:03:55 user nova-compute[72504]: INFO nova.compute.claims [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Claim successful on node user
Aug 01 20:03:56 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUObLgAs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:03:56 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:03:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:03:56 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:03:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:03:56 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a85cbc-f8f3-4384-9d51-a59d1c2f6ca9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:03:56 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92aaf53-4638-4b87-b767-d036c28715f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0] added
Aug 01 20:03:56 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7bac4c-9ed5-4688-af99-1b9692e7a6b6]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5237135-2100-455e-8f21-2e88433fa7be]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qUObLgAs {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qUObLgAs" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1d959e-6e56-43b6-9b4c-4b01513f258b]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qUObLgAs'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[877f8f0e-4c0c-4089-8e19-54bb734c80d9]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd3ccb6-9eba-4b13-89c5-0a3d792ef469]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:03:56 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:03:56 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:03:56 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:03:56 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4e8d00-1516-4f93-ac0f-90620e4572ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0, portal: 172.16.0.220,3260]
Aug 01 20:03:56 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0, portal: 172.16.0.220,3260] successful.
Aug 01 20:03:56 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa205c9-f7c1-4679-9187-3447e164f184]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be26a51-c5c9-47d0-82cf-43c97d4429b7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:03:56 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:03:56 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:03:56 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:03:56 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:03:56 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:03:56 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG nova.compute.manager [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e89d299-3a0b-431c-9914-9080ea0682c6]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUObLgAs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG nova.compute.manager [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG nova.network.neutron [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 20:03:56 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 20:03:56 user nova-compute[72504]: DEBUG nova.compute.manager [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG nova.policy [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a04ab5f67aaa4969b3df48d274a86d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0f5bb5775e4071ab28bea2d9dd2512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG nova.compute.manager [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:03:56 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Creating image(s)
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Acquiring lock "/opt/stack/data/nova/instances/0163556c-3f0f-4e08-81a1-56f52ae805a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "/opt/stack/data/nova/instances/0163556c-3f0f-4e08-81a1-56f52ae805a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "/opt/stack/data/nova/instances/0163556c-3f0f-4e08-81a1-56f52ae805a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.131s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:03:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.156s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/0163556c-3f0f-4e08-81a1-56f52ae805a8/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/0163556c-3f0f-4e08-81a1-56f52ae805a8/disk 1073741824" returned: 0 in 0.052s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:03:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.146s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:57 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0163556c-3f0f-4e08-81a1-56f52ae805a8/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 20:03:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0163556c-3f0f-4e08-81a1-56f52ae805a8/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:03:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0163556c-3f0f-4e08-81a1-56f52ae805a8/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:03:57 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Cannot resize image /opt/stack/data/nova/instances/0163556c-3f0f-4e08-81a1-56f52ae805a8/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 20:03:57 user nova-compute[72504]: DEBUG nova.objects.instance [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lazy-loading 'migration_context' on Instance uuid 0163556c-3f0f-4e08-81a1-56f52ae805a8 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:03:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 20:03:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Ensure instance console log exists: /opt/stack/data/nova/instances/0163556c-3f0f-4e08-81a1-56f52ae805a8/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:03:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:03:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:03:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:03:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:03:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23737633865306631', 'path': '/dev/sdc'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:03:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737633865306631', 'path': '/dev/sdc'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:03:57 user nova-compute[72504]: DEBUG nova.objects.instance [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'flavor' on Instance uuid e19bf04b-43e0-4153-a6b5-74dbe36fedb0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:03:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 20:03:57 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:03:57 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 20:03:57 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:03:57 user nova-compute[72504]:   <serial>27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0</serial>
Aug 01 20:03:57 user nova-compute[72504]: </disk>
Aug 01 20:03:57 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 20:03:57 user nova-compute[72504]: DEBUG nova.network.neutron [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Successfully created port: b21aa368-3683-40c2-b7a8-a604a31a5769 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] No VIF found with MAC fa:16:3e:c2:53:7c, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d58dec4c-696b-4b66-87d6-56021c513ccf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.612s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.network.neutron [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Successfully updated port: b21aa368-3683-40c2-b7a8-a604a31a5769 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Acquiring lock "refresh_cache-0163556c-3f0f-4e08-81a1-56f52ae805a8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Acquired lock "refresh_cache-0163556c-3f0f-4e08-81a1-56f52ae805a8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.network.neutron [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.compute.manager [req-ec1ff45c-e954-4af8-b0d0-15083b77fe1c req-9dbe5d6d-4e94-4571-88f6-0fc2ec767632 service nova] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Received event network-changed-b21aa368-3683-40c2-b7a8-a604a31a5769 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.compute.manager [req-ec1ff45c-e954-4af8-b0d0-15083b77fe1c req-9dbe5d6d-4e94-4571-88f6-0fc2ec767632 service nova] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Refreshing instance network info cache due to event network-changed-b21aa368-3683-40c2-b7a8-a604a31a5769. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ec1ff45c-e954-4af8-b0d0-15083b77fe1c req-9dbe5d6d-4e94-4571-88f6-0fc2ec767632 service nova] Acquiring lock "refresh_cache-0163556c-3f0f-4e08-81a1-56f52ae805a8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.network.neutron [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:03:58 user nova-compute[72504]: INFO nova.compute.manager [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Rescuing
Aug 01 20:03:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "refresh_cache-e19bf04b-43e0-4153-a6b5-74dbe36fedb0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquired lock "refresh_cache-e19bf04b-43e0-4153-a6b5-74dbe36fedb0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.network.neutron [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.network.neutron [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Updating instance_info_cache with network_info: [{"id": "b21aa368-3683-40c2-b7a8-a604a31a5769", "address": "fa:16:3e:17:52:a8", "network": {"id": "b8489ede-9e34-4dfa-b6d7-d0948a7bad05", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1846924261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea0f5bb5775e4071ab28bea2d9dd2512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21aa368-36", "ovs_interfaceid": "b21aa368-3683-40c2-b7a8-a604a31a5769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Releasing lock "refresh_cache-0163556c-3f0f-4e08-81a1-56f52ae805a8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.compute.manager [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Instance network_info: |[{"id": "b21aa368-3683-40c2-b7a8-a604a31a5769", "address": "fa:16:3e:17:52:a8", "network": {"id": "b8489ede-9e34-4dfa-b6d7-d0948a7bad05", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1846924261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea0f5bb5775e4071ab28bea2d9dd2512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21aa368-36", "ovs_interfaceid": "b21aa368-3683-40c2-b7a8-a604a31a5769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ec1ff45c-e954-4af8-b0d0-15083b77fe1c req-9dbe5d6d-4e94-4571-88f6-0fc2ec767632 service nova] Acquired lock "refresh_cache-0163556c-3f0f-4e08-81a1-56f52ae805a8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.network.neutron [req-ec1ff45c-e954-4af8-b0d0-15083b77fe1c req-9dbe5d6d-4e94-4571-88f6-0fc2ec767632 service nova] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Refreshing network info cache for port b21aa368-3683-40c2-b7a8-a604a31a5769 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Start _get_guest_xml network_info=[{"id": "b21aa368-3683-40c2-b7a8-a604a31a5769", "address": "fa:16:3e:17:52:a8", "network": {"id": "b8489ede-9e34-4dfa-b6d7-d0948a7bad05", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1846924261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea0f5bb5775e4071ab28bea2d9dd2512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21aa368-36", "ovs_interfaceid": "b21aa368-3683-40c2-b7a8-a604a31a5769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:03:58 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:03:58 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:03:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-23082982',display_name='tempest-ServersNegativeTestJSON-server-23082982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-23082982',id=31,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea0f5bb5775e4071ab28bea2d9dd2512',ramdisk_id='',reservation_id='r-g09ytv5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-865865258',owner_user_name='tempest-ServersNegativeTestJSON-865865258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:03:57Z,user_data=None,user_id='a04ab5f67aaa4969b3df48d274a86d5e',uuid=0163556c-3f0f-4e08-81a1-56f52ae805a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b21aa368-3683-40c2-b7a8-a604a31a5769", "address": "fa:16:3e:17:52:a8", "network": {"id": "b8489ede-9e34-4dfa-b6d7-d0948a7bad05", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1846924261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea0f5bb5775e4071ab28bea2d9dd2512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21aa368-36", "ovs_interfaceid": "b21aa368-3683-40c2-b7a8-a604a31a5769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Converting VIF {"id": "b21aa368-3683-40c2-b7a8-a604a31a5769", "address": "fa:16:3e:17:52:a8", "network": {"id": "b8489ede-9e34-4dfa-b6d7-d0948a7bad05", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1846924261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea0f5bb5775e4071ab28bea2d9dd2512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21aa368-36", "ovs_interfaceid": "b21aa368-3683-40c2-b7a8-a604a31a5769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:52:a8,bridge_name='br-int',has_traffic_filtering=True,id=b21aa368-3683-40c2-b7a8-a604a31a5769,network=Network(b8489ede-9e34-4dfa-b6d7-d0948a7bad05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb21aa368-36') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.objects.instance [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lazy-loading 'pci_devices' on Instance uuid 0163556c-3f0f-4e08-81a1-56f52ae805a8 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:03:58 user nova-compute[72504]:   <uuid>0163556c-3f0f-4e08-81a1-56f52ae805a8</uuid>
Aug 01 20:03:58 user nova-compute[72504]:   <name>instance-0000001f</name>
Aug 01 20:03:58 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:03:58 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:03:58 user nova-compute[72504]:   <metadata>
Aug 01 20:03:58 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:03:58 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:03:58 user nova-compute[72504]:       <nova:name>tempest-ServersNegativeTestJSON-server-23082982</nova:name>
Aug 01 20:03:58 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:03:58</nova:creationTime>
Aug 01 20:03:58 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:03:58 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:03:58 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:03:58 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:03:58 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:03:58 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:03:58 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:03:58 user nova-compute[72504]:       <nova:owner>
Aug 01 20:03:58 user nova-compute[72504]:         <nova:user uuid="a04ab5f67aaa4969b3df48d274a86d5e">tempest-ServersNegativeTestJSON-865865258-project-member</nova:user>
Aug 01 20:03:58 user nova-compute[72504]:         <nova:project uuid="ea0f5bb5775e4071ab28bea2d9dd2512">tempest-ServersNegativeTestJSON-865865258</nova:project>
Aug 01 20:03:58 user nova-compute[72504]:       </nova:owner>
Aug 01 20:03:58 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 20:03:58 user nova-compute[72504]:       <nova:ports>
Aug 01 20:03:58 user nova-compute[72504]:         <nova:port uuid="b21aa368-3683-40c2-b7a8-a604a31a5769">
Aug 01 20:03:58 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 20:03:58 user nova-compute[72504]:         </nova:port>
Aug 01 20:03:58 user nova-compute[72504]:       </nova:ports>
Aug 01 20:03:58 user nova-compute[72504]:     </nova:instance>
Aug 01 20:03:58 user nova-compute[72504]:   </metadata>
Aug 01 20:03:58 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:03:58 user nova-compute[72504]:     <system>
Aug 01 20:03:58 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:03:58 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:03:58 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:03:58 user nova-compute[72504]:       <entry name="serial">0163556c-3f0f-4e08-81a1-56f52ae805a8</entry>
Aug 01 20:03:58 user nova-compute[72504]:       <entry name="uuid">0163556c-3f0f-4e08-81a1-56f52ae805a8</entry>
Aug 01 20:03:58 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:03:58 user nova-compute[72504]:     </system>
Aug 01 20:03:58 user nova-compute[72504]:   </sysinfo>
Aug 01 20:03:58 user nova-compute[72504]:   <os>
Aug 01 20:03:58 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:03:58 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:03:58 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:03:58 user nova-compute[72504]:   </os>
Aug 01 20:03:58 user nova-compute[72504]:   <features>
Aug 01 20:03:58 user nova-compute[72504]:     <acpi/>
Aug 01 20:03:58 user nova-compute[72504]:     <apic/>
Aug 01 20:03:58 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:03:58 user nova-compute[72504]:   </features>
Aug 01 20:03:58 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:03:58 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:03:58 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:03:58 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:03:58 user nova-compute[72504]:   </clock>
Aug 01 20:03:58 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:03:58 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:03:58 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:03:58 user nova-compute[72504]:   </cpu>
Aug 01 20:03:58 user nova-compute[72504]:   <devices>
Aug 01 20:03:58 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 20:03:58 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 20:03:58 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/0163556c-3f0f-4e08-81a1-56f52ae805a8/disk"/>
Aug 01 20:03:58 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:03:58 user nova-compute[72504]:     </disk>
Aug 01 20:03:58 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:03:58 user nova-compute[72504]:       <mac address="fa:16:3e:17:52:a8"/>
Aug 01 20:03:58 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:03:58 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:03:58 user nova-compute[72504]:       <target dev="tapb21aa368-36"/>
Aug 01 20:03:58 user nova-compute[72504]:     </interface>
Aug 01 20:03:58 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:03:58 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/0163556c-3f0f-4e08-81a1-56f52ae805a8/console.log" append="off"/>
Aug 01 20:03:58 user nova-compute[72504]:     </serial>
Aug 01 20:03:58 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:03:58 user nova-compute[72504]:     <video>
Aug 01 20:03:58 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:03:58 user nova-compute[72504]:     </video>
Aug 01 20:03:58 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:03:58 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:03:58 user nova-compute[72504]:     </rng>
Aug 01 20:03:58 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:03:58 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:03:58 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:03:58 user nova-compute[72504]:     </memballoon>
Aug 01 20:03:58 user nova-compute[72504]:   </devices>
Aug 01 20:03:58 user nova-compute[72504]: </domain>
Aug 01 20:03:58 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:03:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-23082982',display_name='tempest-ServersNegativeTestJSON-server-23082982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-23082982',id=31,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea0f5bb5775e4071ab28bea2d9dd2512',ramdisk_id='',reservation_id='r-g09ytv5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-865865258',owner_user_name='tempest-ServersNegativeTestJSON-865865258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:03:57Z,user_data=None,user_id='a04ab5f67aaa4969b3df48d274a86d5e',uuid=0163556c-3f0f-4e08-81a1-56f52ae805a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b21aa368-3683-40c2-b7a8-a604a31a5769", "address": "fa:16:3e:17:52:a8", "network": {"id": "b8489ede-9e34-4dfa-b6d7-d0948a7bad05", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1846924261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea0f5bb5775e4071ab28bea2d9dd2512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21aa368-36", "ovs_interfaceid": "b21aa368-3683-40c2-b7a8-a604a31a5769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Converting VIF {"id": "b21aa368-3683-40c2-b7a8-a604a31a5769", "address": "fa:16:3e:17:52:a8", "network": {"id": "b8489ede-9e34-4dfa-b6d7-d0948a7bad05", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1846924261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea0f5bb5775e4071ab28bea2d9dd2512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21aa368-36", "ovs_interfaceid": "b21aa368-3683-40c2-b7a8-a604a31a5769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:52:a8,bridge_name='br-int',has_traffic_filtering=True,id=b21aa368-3683-40c2-b7a8-a604a31a5769,network=Network(b8489ede-9e34-4dfa-b6d7-d0948a7bad05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb21aa368-36') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG os_vif [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:52:a8,bridge_name='br-int',has_traffic_filtering=True,id=b21aa368-3683-40c2-b7a8-a604a31a5769,network=Network(b8489ede-9e34-4dfa-b6d7-d0948a7bad05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb21aa368-36') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb21aa368-36, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb21aa368-36, col_values=(('external_ids', {'iface-id': 'b21aa368-3683-40c2-b7a8-a604a31a5769', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:52:a8', 'vm-uuid': '0163556c-3f0f-4e08-81a1-56f52ae805a8'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:03:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:58 user nova-compute[72504]: INFO os_vif [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:52:a8,bridge_name='br-int',has_traffic_filtering=True,id=b21aa368-3683-40c2-b7a8-a604a31a5769,network=Network(b8489ede-9e34-4dfa-b6d7-d0948a7bad05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb21aa368-36')
Aug 01 20:03:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:03:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] No VIF found with MAC fa:16:3e:17:52:a8, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:03:59 user nova-compute[72504]: DEBUG nova.network.neutron [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Updating instance_info_cache with network_info: [{"id": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "address": "fa:16:3e:c2:53:7c", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d66fd17-3c", "ovs_interfaceid": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:03:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Releasing lock "refresh_cache-e19bf04b-43e0-4153-a6b5-74dbe36fedb0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:03:59 user nova-compute[72504]: DEBUG nova.network.neutron [req-ec1ff45c-e954-4af8-b0d0-15083b77fe1c req-9dbe5d6d-4e94-4571-88f6-0fc2ec767632 service nova] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Updated VIF entry in instance network info cache for port b21aa368-3683-40c2-b7a8-a604a31a5769. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:03:59 user nova-compute[72504]: DEBUG nova.network.neutron [req-ec1ff45c-e954-4af8-b0d0-15083b77fe1c req-9dbe5d6d-4e94-4571-88f6-0fc2ec767632 service nova] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Updating instance_info_cache with network_info: [{"id": "b21aa368-3683-40c2-b7a8-a604a31a5769", "address": "fa:16:3e:17:52:a8", "network": {"id": "b8489ede-9e34-4dfa-b6d7-d0948a7bad05", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1846924261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea0f5bb5775e4071ab28bea2d9dd2512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21aa368-36", "ovs_interfaceid": "b21aa368-3683-40c2-b7a8-a604a31a5769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:03:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ec1ff45c-e954-4af8-b0d0-15083b77fe1c req-9dbe5d6d-4e94-4571-88f6-0fc2ec767632 service nova] Releasing lock "refresh_cache-0163556c-3f0f-4e08-81a1-56f52ae805a8" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:03:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:03:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:00 user nova-compute[72504]: DEBUG nova.compute.manager [req-b5dbcb8f-418d-4b72-a3da-7b58e07cf7a8 req-9cfd395b-6c3b-4fb4-90aa-9d6b8c7c528f service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received event network-vif-unplugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:04:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b5dbcb8f-418d-4b72-a3da-7b58e07cf7a8 req-9cfd395b-6c3b-4fb4-90aa-9d6b8c7c528f service nova] Acquiring lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:04:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b5dbcb8f-418d-4b72-a3da-7b58e07cf7a8 req-9cfd395b-6c3b-4fb4-90aa-9d6b8c7c528f service nova] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:04:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b5dbcb8f-418d-4b72-a3da-7b58e07cf7a8 req-9cfd395b-6c3b-4fb4-90aa-9d6b8c7c528f service nova] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:04:00 user nova-compute[72504]: DEBUG nova.compute.manager [req-b5dbcb8f-418d-4b72-a3da-7b58e07cf7a8 req-9cfd395b-6c3b-4fb4-90aa-9d6b8c7c528f service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] No waiting events found dispatching network-vif-unplugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:04:00 user nova-compute[72504]: WARNING nova.compute.manager [req-b5dbcb8f-418d-4b72-a3da-7b58e07cf7a8 req-9cfd395b-6c3b-4fb4-90aa-9d6b8c7c528f service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received unexpected event network-vif-unplugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc for instance with vm_state active and task_state rescuing.
Aug 01 20:04:00 user nova-compute[72504]: DEBUG nova.compute.manager [req-b5dbcb8f-418d-4b72-a3da-7b58e07cf7a8 req-9cfd395b-6c3b-4fb4-90aa-9d6b8c7c528f service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received event network-vif-plugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:04:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b5dbcb8f-418d-4b72-a3da-7b58e07cf7a8 req-9cfd395b-6c3b-4fb4-90aa-9d6b8c7c528f service nova] Acquiring lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:04:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b5dbcb8f-418d-4b72-a3da-7b58e07cf7a8 req-9cfd395b-6c3b-4fb4-90aa-9d6b8c7c528f service nova] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:04:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b5dbcb8f-418d-4b72-a3da-7b58e07cf7a8 req-9cfd395b-6c3b-4fb4-90aa-9d6b8c7c528f service nova] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:04:00 user nova-compute[72504]: DEBUG nova.compute.manager [req-b5dbcb8f-418d-4b72-a3da-7b58e07cf7a8 req-9cfd395b-6c3b-4fb4-90aa-9d6b8c7c528f service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] No waiting events found dispatching network-vif-plugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:04:00 user nova-compute[72504]: WARNING nova.compute.manager [req-b5dbcb8f-418d-4b72-a3da-7b58e07cf7a8 req-9cfd395b-6c3b-4fb4-90aa-9d6b8c7c528f service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received unexpected event network-vif-plugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc for instance with vm_state active and task_state rescuing.
Aug 01 20:04:00 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Instance destroyed successfully.
Aug 01 20:04:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:00 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Attempting rescue
Aug 01 20:04:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72504) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 20:04:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Instance directory exists: not creating {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 20:04:00 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Creating image(s)
Aug 01 20:04:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "/opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:04:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "/opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:04:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "/opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:04:00 user nova-compute[72504]: DEBUG nova.objects.instance [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'trusted_certs' on Instance uuid e19bf04b-43e0-4153-a6b5-74dbe36fedb0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:04:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:04:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:04:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.157s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk.rescue {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk.rescue" returned: 0 in 0.058s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.objects.instance [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'migration_context' on Instance uuid e19bf04b-43e0-4153-a6b5-74dbe36fedb0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.compute.manager [req-69626c32-3930-466e-99df-fe4a4a9fbfd8 req-867e1c33-18f1-44f8-92fe-ca0b59e24857 service nova] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Received event network-vif-plugged-b21aa368-3683-40c2-b7a8-a604a31a5769 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-69626c32-3930-466e-99df-fe4a4a9fbfd8 req-867e1c33-18f1-44f8-92fe-ca0b59e24857 service nova] Acquiring lock "0163556c-3f0f-4e08-81a1-56f52ae805a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-69626c32-3930-466e-99df-fe4a4a9fbfd8 req-867e1c33-18f1-44f8-92fe-ca0b59e24857 service nova] Lock "0163556c-3f0f-4e08-81a1-56f52ae805a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-69626c32-3930-466e-99df-fe4a4a9fbfd8 req-867e1c33-18f1-44f8-92fe-ca0b59e24857 service nova] Lock "0163556c-3f0f-4e08-81a1-56f52ae805a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.compute.manager [req-69626c32-3930-466e-99df-fe4a4a9fbfd8 req-867e1c33-18f1-44f8-92fe-ca0b59e24857 service nova] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] No waiting events found dispatching network-vif-plugged-b21aa368-3683-40c2-b7a8-a604a31a5769 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:04:01 user nova-compute[72504]: WARNING nova.compute.manager [req-69626c32-3930-466e-99df-fe4a4a9fbfd8 req-867e1c33-18f1-44f8-92fe-ca0b59e24857 service nova] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Received unexpected event network-vif-plugged-b21aa368-3683-40c2-b7a8-a604a31a5769 for instance with vm_state building and task_state spawning.
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Start _get_guest_xml network_info=[{"id": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "address": "fa:16:3e:c2:53:7c", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "vif_mac": "fa:16:3e:c2:53:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d66fd17-3c", "ovs_interfaceid": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.objects.instance [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'resources' on Instance uuid e19bf04b-43e0-4153-a6b5-74dbe36fedb0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.objects.instance [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'numa_topology' on Instance uuid e19bf04b-43e0-4153-a6b5-74dbe36fedb0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:01 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:04:01 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.objects.instance [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'vcpu_model' on Instance uuid e19bf04b-43e0-4153-a6b5-74dbe36fedb0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-858127926',display_name='tempest-ServerRescueNegativeTestJSON-server-858127926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-858127926',id=28,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAulB7xKrQ3iwNSG1rJvFE3+trA8hmdkFqfWEnv5agU7clcZsDlocF6bKk7yN97AViHaHy9lGlueRa4sqKvs59bCNJwiRRu0euW/6zYzligMJY09K4XGFq7Tvk8Z/XH+rQ==',key_name='tempest-keypair-1316147877',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:02:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='274aed6773224c4fb534aac970d6bb34',ramdisk_id='',reservation_id='r-vx3ehgmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-897201375',owner_user_name='tempest-ServerRescueNegativeTestJSON-897201375-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:02:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be219e31095441269a1f140a77ad0d57',uuid=e19bf04b-43e0-4153-a6b5-74dbe36fedb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "address": "fa:16:3e:c2:53:7c", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "vif_mac": "fa:16:3e:c2:53:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d66fd17-3c", "ovs_interfaceid": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Converting VIF {"id": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "address": "fa:16:3e:c2:53:7c", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "vif_mac": "fa:16:3e:c2:53:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d66fd17-3c", "ovs_interfaceid": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:53:7c,bridge_name='br-int',has_traffic_filtering=True,id=6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc,network=Network(9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d66fd17-3c') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.objects.instance [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'pci_devices' on Instance uuid e19bf04b-43e0-4153-a6b5-74dbe36fedb0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:04:01 user nova-compute[72504]:   <uuid>e19bf04b-43e0-4153-a6b5-74dbe36fedb0</uuid>
Aug 01 20:04:01 user nova-compute[72504]:   <name>instance-0000001c</name>
Aug 01 20:04:01 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:04:01 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:04:01 user nova-compute[72504]:   <metadata>
Aug 01 20:04:01 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:04:01 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:04:01 user nova-compute[72504]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-858127926</nova:name>
Aug 01 20:04:01 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:04:01</nova:creationTime>
Aug 01 20:04:01 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:04:01 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:04:01 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:04:01 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:04:01 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:04:01 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:04:01 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:04:01 user nova-compute[72504]:       <nova:owner>
Aug 01 20:04:01 user nova-compute[72504]:         <nova:user uuid="be219e31095441269a1f140a77ad0d57">tempest-ServerRescueNegativeTestJSON-897201375-project-member</nova:user>
Aug 01 20:04:01 user nova-compute[72504]:         <nova:project uuid="274aed6773224c4fb534aac970d6bb34">tempest-ServerRescueNegativeTestJSON-897201375</nova:project>
Aug 01 20:04:01 user nova-compute[72504]:       </nova:owner>
Aug 01 20:04:01 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 20:04:01 user nova-compute[72504]:       <nova:ports>
Aug 01 20:04:01 user nova-compute[72504]:         <nova:port uuid="6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc">
Aug 01 20:04:01 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 20:04:01 user nova-compute[72504]:         </nova:port>
Aug 01 20:04:01 user nova-compute[72504]:       </nova:ports>
Aug 01 20:04:01 user nova-compute[72504]:     </nova:instance>
Aug 01 20:04:01 user nova-compute[72504]:   </metadata>
Aug 01 20:04:01 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:04:01 user nova-compute[72504]:     <system>
Aug 01 20:04:01 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:04:01 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:04:01 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:04:01 user nova-compute[72504]:       <entry name="serial">e19bf04b-43e0-4153-a6b5-74dbe36fedb0</entry>
Aug 01 20:04:01 user nova-compute[72504]:       <entry name="uuid">e19bf04b-43e0-4153-a6b5-74dbe36fedb0</entry>
Aug 01 20:04:01 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:04:01 user nova-compute[72504]:     </system>
Aug 01 20:04:01 user nova-compute[72504]:   </sysinfo>
Aug 01 20:04:01 user nova-compute[72504]:   <os>
Aug 01 20:04:01 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:04:01 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:04:01 user nova-compute[72504]:   </os>
Aug 01 20:04:01 user nova-compute[72504]:   <features>
Aug 01 20:04:01 user nova-compute[72504]:     <acpi/>
Aug 01 20:04:01 user nova-compute[72504]:     <apic/>
Aug 01 20:04:01 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:04:01 user nova-compute[72504]:   </features>
Aug 01 20:04:01 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:04:01 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:04:01 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:04:01 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:04:01 user nova-compute[72504]:   </clock>
Aug 01 20:04:01 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:04:01 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:04:01 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:04:01 user nova-compute[72504]:   </cpu>
Aug 01 20:04:01 user nova-compute[72504]:   <devices>
Aug 01 20:04:01 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 20:04:01 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 20:04:01 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk.rescue"/>
Aug 01 20:04:01 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:04:01 user nova-compute[72504]:     </disk>
Aug 01 20:04:01 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 20:04:01 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 20:04:01 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk"/>
Aug 01 20:04:01 user nova-compute[72504]:       <target dev="vdb" bus="virtio"/>
Aug 01 20:04:01 user nova-compute[72504]:     </disk>
Aug 01 20:04:01 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:04:01 user nova-compute[72504]:       <mac address="fa:16:3e:c2:53:7c"/>
Aug 01 20:04:01 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:04:01 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:04:01 user nova-compute[72504]:       <target dev="tap6d66fd17-3c"/>
Aug 01 20:04:01 user nova-compute[72504]:     </interface>
Aug 01 20:04:01 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:04:01 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/console.log" append="off"/>
Aug 01 20:04:01 user nova-compute[72504]:     </serial>
Aug 01 20:04:01 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:04:01 user nova-compute[72504]:     <video>
Aug 01 20:04:01 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:04:01 user nova-compute[72504]:     </video>
Aug 01 20:04:01 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:04:01 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:04:01 user nova-compute[72504]:     </rng>
Aug 01 20:04:01 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:04:01 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:04:01 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:04:01 user nova-compute[72504]:     </memballoon>
Aug 01 20:04:01 user nova-compute[72504]:   </devices>
Aug 01 20:04:01 user nova-compute[72504]: </domain>
Aug 01 20:04:01 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:04:01 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Instance destroyed successfully.
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:04:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] No VIF found with MAC fa:16:3e:c2:53:7c, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:04:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-325f416c-7880-4ad1-bbc9-9bc9fc75457b req-b3f48462-3b49-4159-a7d9-e8238fa3c7f3 service nova] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Received event network-vif-plugged-b21aa368-3683-40c2-b7a8-a604a31a5769 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:04:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-325f416c-7880-4ad1-bbc9-9bc9fc75457b req-b3f48462-3b49-4159-a7d9-e8238fa3c7f3 service nova] Acquiring lock "0163556c-3f0f-4e08-81a1-56f52ae805a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:04:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-325f416c-7880-4ad1-bbc9-9bc9fc75457b req-b3f48462-3b49-4159-a7d9-e8238fa3c7f3 service nova] Lock "0163556c-3f0f-4e08-81a1-56f52ae805a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:04:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-325f416c-7880-4ad1-bbc9-9bc9fc75457b req-b3f48462-3b49-4159-a7d9-e8238fa3c7f3 service nova] Lock "0163556c-3f0f-4e08-81a1-56f52ae805a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:04:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-325f416c-7880-4ad1-bbc9-9bc9fc75457b req-b3f48462-3b49-4159-a7d9-e8238fa3c7f3 service nova] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] No waiting events found dispatching network-vif-plugged-b21aa368-3683-40c2-b7a8-a604a31a5769 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:04:03 user nova-compute[72504]: WARNING nova.compute.manager [req-325f416c-7880-4ad1-bbc9-9bc9fc75457b req-b3f48462-3b49-4159-a7d9-e8238fa3c7f3 service nova] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Received unexpected event network-vif-plugged-b21aa368-3683-40c2-b7a8-a604a31a5769 for instance with vm_state building and task_state spawning.
Aug 01 20:04:03 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920243.3184974, 0163556c-3f0f-4e08-81a1-56f52ae805a8 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:04:03 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] VM Resumed (Lifecycle Event)
Aug 01 20:04:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:04:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:04:03 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Instance spawned successfully.
Aug 01 20:04:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 20:04:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:04:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:04:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-81ab35fc-ba77-4881-8c6b-fe550dd12d85 req-de6fc966-3bce-4014-be94-96e589976559 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received event network-vif-plugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:04:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-81ab35fc-ba77-4881-8c6b-fe550dd12d85 req-de6fc966-3bce-4014-be94-96e589976559 service nova] Acquiring lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:04:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-81ab35fc-ba77-4881-8c6b-fe550dd12d85 req-de6fc966-3bce-4014-be94-96e589976559 service nova] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:04:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-81ab35fc-ba77-4881-8c6b-fe550dd12d85 req-de6fc966-3bce-4014-be94-96e589976559 service nova] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:04:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-81ab35fc-ba77-4881-8c6b-fe550dd12d85 req-de6fc966-3bce-4014-be94-96e589976559 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] No waiting events found dispatching network-vif-plugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:04:03 user nova-compute[72504]: WARNING nova.compute.manager [req-81ab35fc-ba77-4881-8c6b-fe550dd12d85 req-de6fc966-3bce-4014-be94-96e589976559 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received unexpected event network-vif-plugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc for instance with vm_state active and task_state rescuing.
Aug 01 20:04:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:04:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:04:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:04:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:04:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:04:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:04:03 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:04:03 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920243.319701, 0163556c-3f0f-4e08-81a1-56f52ae805a8 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:04:03 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] VM Started (Lifecycle Event)
Aug 01 20:04:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:04:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:04:03 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:04:03 user nova-compute[72504]: INFO nova.compute.manager [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Took 6.76 seconds to spawn the instance on the hypervisor.
Aug 01 20:04:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:04:03 user nova-compute[72504]: INFO nova.compute.manager [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Took 7.73 seconds to build instance.
Aug 01 20:04:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0f39b598-ae79-4416-aa35-0364208dfbf0 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "0163556c-3f0f-4e08-81a1-56f52ae805a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.831s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:04:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:05 user nova-compute[72504]: DEBUG nova.compute.manager [req-9c25a16a-10fe-4232-82c9-daf0596b235c req-3f59a3b3-d8ce-443f-adf7-107ce59dce31 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received event network-vif-plugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:04:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-9c25a16a-10fe-4232-82c9-daf0596b235c req-3f59a3b3-d8ce-443f-adf7-107ce59dce31 service nova] Acquiring lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:04:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-9c25a16a-10fe-4232-82c9-daf0596b235c req-3f59a3b3-d8ce-443f-adf7-107ce59dce31 service nova] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:04:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-9c25a16a-10fe-4232-82c9-daf0596b235c req-3f59a3b3-d8ce-443f-adf7-107ce59dce31 service nova] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:04:05 user nova-compute[72504]: DEBUG nova.compute.manager [req-9c25a16a-10fe-4232-82c9-daf0596b235c req-3f59a3b3-d8ce-443f-adf7-107ce59dce31 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] No waiting events found dispatching network-vif-plugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:04:05 user nova-compute[72504]: WARNING nova.compute.manager [req-9c25a16a-10fe-4232-82c9-daf0596b235c req-3f59a3b3-d8ce-443f-adf7-107ce59dce31 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received unexpected event network-vif-plugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc for instance with vm_state active and task_state rescuing.
Aug 01 20:04:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "8b163903-b08f-44b6-a5b5-56dc897d5640" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:04:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:04:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 20:04:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:04:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:04:05 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:04:05 user nova-compute[72504]: INFO nova.compute.claims [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Claim successful on node user
Aug 01 20:04:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Removed pending event for e19bf04b-43e0-4153-a6b5-74dbe36fedb0 due to event {{(pid=72504) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 20:04:05 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920245.6860757, e19bf04b-43e0-4153-a6b5-74dbe36fedb0 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:04:05 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] VM Resumed (Lifecycle Event)
Aug 01 20:04:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-6774781d-d223-4753-9a14-a89a613c9fcf tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:04:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:04:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:04:05 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 20:04:05 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920245.6884346, e19bf04b-43e0-4153-a6b5-74dbe36fedb0 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:04:05 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] VM Started (Lifecycle Event)
Aug 01 20:04:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:04:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:04:06 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:04:06 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:04:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:04:06 user nova-compute[72504]: DEBUG nova.compute.manager [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 20:04:06 user nova-compute[72504]: DEBUG nova.compute.manager [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 20:04:06 user nova-compute[72504]: DEBUG nova.network.neutron [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 20:04:06 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 20:04:06 user nova-compute[72504]: DEBUG nova.compute.manager [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 20:04:06 user nova-compute[72504]: INFO nova.virt.block_device [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Booting with volume f8d42905-453b-4a20-8b79-736283896160 at /dev/vda
Aug 01 20:04:06 user nova-compute[72504]: DEBUG nova.policy [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd76765d1d24342f99ce0d65f416d382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816239d15d3341cdaa785fc36c8e7cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 20:04:06 user nova-compute[72504]: DEBUG os_brick.utils [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:04:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:06 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cea2098-2943-47db-b3cb-6ea4ca5c730d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:06 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[776c16e4-7d34-4f2c-b635-321be2c53a94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:06 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[218471b2-cd22-401d-9924-b99aa3267f0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:06 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6364dd59-e9e8-4092-ba2c-dc797a7104c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:04:06 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:04:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:04:06 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:04:06 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f5bce3-d23e-4d5a-81ac-18a56b46e95f]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:06 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:04:06 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:04:06 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:04:06 user nova-compute[72504]: DEBUG os_brick.utils [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:04:06 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Updating existing volume attachment record: 66720fd9-6072-4083-b29e-64c975e57dcc {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:04:07 user nova-compute[72504]: DEBUG nova.network.neutron [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Successfully created port: aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 20:04:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:08 user nova-compute[72504]: DEBUG nova.network.neutron [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Successfully updated port: aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 20:04:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "refresh_cache-8b163903-b08f-44b6-a5b5-56dc897d5640" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:04:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquired lock "refresh_cache-8b163903-b08f-44b6-a5b5-56dc897d5640" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:04:08 user nova-compute[72504]: DEBUG nova.network.neutron [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:04:08 user nova-compute[72504]: DEBUG nova.compute.manager [req-9e25998d-b2a6-4f41-8dd7-56b7c97c9019 req-4eb19072-7554-4bf9-b7a4-9b799f15ef01 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Received event network-changed-aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:04:08 user nova-compute[72504]: DEBUG nova.compute.manager [req-9e25998d-b2a6-4f41-8dd7-56b7c97c9019 req-4eb19072-7554-4bf9-b7a4-9b799f15ef01 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Refreshing instance network info cache due to event network-changed-aeea59ba-654d-4640-a3ca-33f8a7f302ff. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:04:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-9e25998d-b2a6-4f41-8dd7-56b7c97c9019 req-4eb19072-7554-4bf9-b7a4-9b799f15ef01 service nova] Acquiring lock "refresh_cache-8b163903-b08f-44b6-a5b5-56dc897d5640" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:04:08 user nova-compute[72504]: DEBUG nova.network.neutron [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:04:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:09 user nova-compute[72504]: DEBUG nova.network.neutron [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Updating instance_info_cache with network_info: [{"id": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "address": "fa:16:3e:ac:33:02", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeea59ba-65", "ovs_interfaceid": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:04:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Releasing lock "refresh_cache-8b163903-b08f-44b6-a5b5-56dc897d5640" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:04:09 user nova-compute[72504]: DEBUG nova.compute.manager [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Instance network_info: |[{"id": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "address": "fa:16:3e:ac:33:02", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeea59ba-65", "ovs_interfaceid": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 20:04:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-9e25998d-b2a6-4f41-8dd7-56b7c97c9019 req-4eb19072-7554-4bf9-b7a4-9b799f15ef01 service nova] Acquired lock "refresh_cache-8b163903-b08f-44b6-a5b5-56dc897d5640" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:04:09 user nova-compute[72504]: DEBUG nova.network.neutron [req-9e25998d-b2a6-4f41-8dd7-56b7c97c9019 req-4eb19072-7554-4bf9-b7a4-9b799f15ef01 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Refreshing network info cache for port aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:04:09 user nova-compute[72504]: DEBUG nova.network.neutron [req-9e25998d-b2a6-4f41-8dd7-56b7c97c9019 req-4eb19072-7554-4bf9-b7a4-9b799f15ef01 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Updated VIF entry in instance network info cache for port aeea59ba-654d-4640-a3ca-33f8a7f302ff. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:04:09 user nova-compute[72504]: DEBUG nova.network.neutron [req-9e25998d-b2a6-4f41-8dd7-56b7c97c9019 req-4eb19072-7554-4bf9-b7a4-9b799f15ef01 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Updating instance_info_cache with network_info: [{"id": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "address": "fa:16:3e:ac:33:02", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeea59ba-65", "ovs_interfaceid": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:04:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-9e25998d-b2a6-4f41-8dd7-56b7c97c9019 req-4eb19072-7554-4bf9-b7a4-9b799f15ef01 service nova] Releasing lock "refresh_cache-8b163903-b08f-44b6-a5b5-56dc897d5640" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:04:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG nova.compute.manager [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:04:15 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Creating image(s)
Aug 01 20:04:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Did not create local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Ensure instance console log exists: /opt/stack/data/nova/instances/8b163903-b08f-44b6-a5b5-56dc897d5640/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Start _get_guest_xml network_info=[{"id": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "address": "fa:16:3e:ac:33:02", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeea59ba-65", "ovs_interfaceid": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrhkdDLS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8b163903-b08f-44b6-a5b5-56dc897d5640', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8d42905-453b-4a20-8b79-736283896160', 'serial': 'f8d42905-453b-4a20-8b79-736283896160'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': '66720fd9-6072-4083-b29e-64c975e57dcc', 'volume_type': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:04:15 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:04:15 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:04:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrhkdDLS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:04:15 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:04:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:04:15 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:04:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:04:15 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ed0f24-21af-4a03-b6ab-f0207b0d1900]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:04:15 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8b53c8-218b-45a8-88f0-196d498a9fe7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160] added
Aug 01 20:04:15 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[88756c6e-39be-4221-834f-383210f22391]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8efa459-0801-413d-8b98-1902efc76f15]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XrhkdDLS {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XrhkdDLS" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1aa7ae-4187-4f5c-b9ef-48dae06d7637]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XrhkdDLS'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca1804c-cf8b-457a-8376-052fa1b481ed]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0a913c-12a5-4f09-81ac-0b066fbf9719]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:04:15 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:04:15 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:04:15 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:04:15 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:04:15 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:04:15 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[096eddc2-efa1-4286-9402-9e963a3b90d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160, portal: 172.16.0.220,3260]
Aug 01 20:04:15 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160, portal: 172.16.0.220,3260] successful.
Aug 01 20:04:15 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f614c7-e3ce-4ffa-a770-899b4226027a]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[19212289-9d7b-441f-ac14-3347dc73b1e6]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:04:15 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:04:15 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:04:15 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:04:15 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:04:15 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:04:15 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:04:15 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:04:15 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68527fc-ba1d-4265-a6fe-6dcf6af02512]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:04:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrhkdDLS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:04:16 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:04:16 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26534313364333937', 'path': '/dev/sde'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:04:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534313364333937', 'path': '/dev/sde'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:04:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:04:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-678696080',display_name='tempest-ServerActionsTestOtherA-server-678696080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-678696080',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLbPu5MF6DPaLmysryryb5dEvmDVe/ZpzyX1JNIgtOIXBuGnF7k0B3yFjfDeyUfOXvFKWH1T1tnnmguBKUJb6gDrcdFY/x4LtLMGVeolXUhKxLNh5O13uubFnujvAs7Sg==',key_name='tempest-keypair-2041585985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='816239d15d3341cdaa785fc36c8e7cdb',ramdisk_id='',reservation_id='r-3tk0djaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1009670506',owner_user_name='tempest-ServerActionsTestOtherA-1009670506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:04:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d76765d1d24342f99ce0d65f416d382b',uuid=8b163903-b08f-44b6-a5b5-56dc897d5640,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "address": "fa:16:3e:ac:33:02", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeea59ba-65", "ovs_interfaceid": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:04:16 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Converting VIF {"id": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "address": "fa:16:3e:ac:33:02", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeea59ba-65", "ovs_interfaceid": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:04:16 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:33:02,bridge_name='br-int',has_traffic_filtering=True,id=aeea59ba-654d-4640-a3ca-33f8a7f302ff,network=Network(92749f96-d369-4df5-85ce-252c277e7ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeea59ba-65') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:04:16 user nova-compute[72504]: DEBUG nova.objects.instance [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b163903-b08f-44b6-a5b5-56dc897d5640 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:04:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:04:16 user nova-compute[72504]:   <uuid>8b163903-b08f-44b6-a5b5-56dc897d5640</uuid>
Aug 01 20:04:16 user nova-compute[72504]:   <name>instance-00000020</name>
Aug 01 20:04:16 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:04:16 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:04:16 user nova-compute[72504]:   <metadata>
Aug 01 20:04:16 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:04:16 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:04:16 user nova-compute[72504]:       <nova:name>tempest-ServerActionsTestOtherA-server-678696080</nova:name>
Aug 01 20:04:16 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:04:15</nova:creationTime>
Aug 01 20:04:16 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:04:16 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:04:16 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:04:16 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:04:16 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:04:16 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:04:16 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:04:16 user nova-compute[72504]:       <nova:owner>
Aug 01 20:04:16 user nova-compute[72504]:         <nova:user uuid="d76765d1d24342f99ce0d65f416d382b">tempest-ServerActionsTestOtherA-1009670506-project-member</nova:user>
Aug 01 20:04:16 user nova-compute[72504]:         <nova:project uuid="816239d15d3341cdaa785fc36c8e7cdb">tempest-ServerActionsTestOtherA-1009670506</nova:project>
Aug 01 20:04:16 user nova-compute[72504]:       </nova:owner>
Aug 01 20:04:16 user nova-compute[72504]:       <nova:ports>
Aug 01 20:04:16 user nova-compute[72504]:         <nova:port uuid="aeea59ba-654d-4640-a3ca-33f8a7f302ff">
Aug 01 20:04:16 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 20:04:16 user nova-compute[72504]:         </nova:port>
Aug 01 20:04:16 user nova-compute[72504]:       </nova:ports>
Aug 01 20:04:16 user nova-compute[72504]:     </nova:instance>
Aug 01 20:04:16 user nova-compute[72504]:   </metadata>
Aug 01 20:04:16 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:04:16 user nova-compute[72504]:     <system>
Aug 01 20:04:16 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:04:16 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:04:16 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:04:16 user nova-compute[72504]:       <entry name="serial">8b163903-b08f-44b6-a5b5-56dc897d5640</entry>
Aug 01 20:04:16 user nova-compute[72504]:       <entry name="uuid">8b163903-b08f-44b6-a5b5-56dc897d5640</entry>
Aug 01 20:04:16 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:04:16 user nova-compute[72504]:     </system>
Aug 01 20:04:16 user nova-compute[72504]:   </sysinfo>
Aug 01 20:04:16 user nova-compute[72504]:   <os>
Aug 01 20:04:16 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:04:16 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:04:16 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:04:16 user nova-compute[72504]:   </os>
Aug 01 20:04:16 user nova-compute[72504]:   <features>
Aug 01 20:04:16 user nova-compute[72504]:     <acpi/>
Aug 01 20:04:16 user nova-compute[72504]:     <apic/>
Aug 01 20:04:16 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:04:16 user nova-compute[72504]:   </features>
Aug 01 20:04:16 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:04:16 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:04:16 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:04:16 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:04:16 user nova-compute[72504]:   </clock>
Aug 01 20:04:16 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:04:16 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:04:16 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:04:16 user nova-compute[72504]:   </cpu>
Aug 01 20:04:16 user nova-compute[72504]:   <devices>
Aug 01 20:04:16 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 20:04:16 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:04:16 user nova-compute[72504]:       <source dev="/dev/sde"/>
Aug 01 20:04:16 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:04:16 user nova-compute[72504]:       <serial>f8d42905-453b-4a20-8b79-736283896160</serial>
Aug 01 20:04:16 user nova-compute[72504]:     </disk>
Aug 01 20:04:16 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:04:16 user nova-compute[72504]:       <mac address="fa:16:3e:ac:33:02"/>
Aug 01 20:04:16 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:04:16 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:04:16 user nova-compute[72504]:       <target dev="tapaeea59ba-65"/>
Aug 01 20:04:16 user nova-compute[72504]:     </interface>
Aug 01 20:04:16 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:04:16 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/8b163903-b08f-44b6-a5b5-56dc897d5640/console.log" append="off"/>
Aug 01 20:04:16 user nova-compute[72504]:     </serial>
Aug 01 20:04:16 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:04:16 user nova-compute[72504]:     <video>
Aug 01 20:04:16 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:04:16 user nova-compute[72504]:     </video>
Aug 01 20:04:16 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:04:16 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:04:16 user nova-compute[72504]:     </rng>
Aug 01 20:04:16 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:04:16 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:04:16 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:04:16 user nova-compute[72504]:     </memballoon>
Aug 01 20:04:16 user nova-compute[72504]:   </devices>
Aug 01 20:04:16 user nova-compute[72504]: </domain>
Aug 01 20:04:16 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:04:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:04:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-678696080',display_name='tempest-ServerActionsTestOtherA-server-678696080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-678696080',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLbPu5MF6DPaLmysryryb5dEvmDVe/ZpzyX1JNIgtOIXBuGnF7k0B3yFjfDeyUfOXvFKWH1T1tnnmguBKUJb6gDrcdFY/x4LtLMGVeolXUhKxLNh5O13uubFnujvAs7Sg==',key_name='tempest-keypair-2041585985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='816239d15d3341cdaa785fc36c8e7cdb',ramdisk_id='',reservation_id='r-3tk0djaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1009670506',owner_user_name='tempest-ServerActionsTestOtherA-1009670506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:04:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d76765d1d24342f99ce0d65f416d382b',uuid=8b163903-b08f-44b6-a5b5-56dc897d5640,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "address": "fa:16:3e:ac:33:02", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeea59ba-65", "ovs_interfaceid": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:04:16 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Converting VIF {"id": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "address": "fa:16:3e:ac:33:02", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeea59ba-65", "ovs_interfaceid": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:04:16 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:33:02,bridge_name='br-int',has_traffic_filtering=True,id=aeea59ba-654d-4640-a3ca-33f8a7f302ff,network=Network(92749f96-d369-4df5-85ce-252c277e7ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeea59ba-65') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:04:16 user nova-compute[72504]: DEBUG os_vif [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:33:02,bridge_name='br-int',has_traffic_filtering=True,id=aeea59ba-654d-4640-a3ca-33f8a7f302ff,network=Network(92749f96-d369-4df5-85ce-252c277e7ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeea59ba-65') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:04:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:04:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:04:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaeea59ba-65, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:04:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaeea59ba-65, col_values=(('external_ids', {'iface-id': 'aeea59ba-654d-4640-a3ca-33f8a7f302ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:33:02', 'vm-uuid': '8b163903-b08f-44b6-a5b5-56dc897d5640'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:04:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:04:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:16 user nova-compute[72504]: INFO os_vif [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:33:02,bridge_name='br-int',has_traffic_filtering=True,id=aeea59ba-654d-4640-a3ca-33f8a7f302ff,network=Network(92749f96-d369-4df5-85ce-252c277e7ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeea59ba-65')
Aug 01 20:04:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:04:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] No VIF found with MAC fa:16:3e:ac:33:02, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:04:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:18 user nova-compute[72504]: DEBUG nova.compute.manager [req-38561849-eecb-4387-bcbd-ff1f723bfb74 req-8d04838b-8095-4e65-9fc4-41c4cb26d051 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Received event network-vif-plugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:04:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-38561849-eecb-4387-bcbd-ff1f723bfb74 req-8d04838b-8095-4e65-9fc4-41c4cb26d051 service nova] Acquiring lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:04:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-38561849-eecb-4387-bcbd-ff1f723bfb74 req-8d04838b-8095-4e65-9fc4-41c4cb26d051 service nova] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:04:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-38561849-eecb-4387-bcbd-ff1f723bfb74 req-8d04838b-8095-4e65-9fc4-41c4cb26d051 service nova] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:04:18 user nova-compute[72504]: DEBUG nova.compute.manager [req-38561849-eecb-4387-bcbd-ff1f723bfb74 req-8d04838b-8095-4e65-9fc4-41c4cb26d051 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] No waiting events found dispatching network-vif-plugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:04:18 user nova-compute[72504]: WARNING nova.compute.manager [req-38561849-eecb-4387-bcbd-ff1f723bfb74 req-8d04838b-8095-4e65-9fc4-41c4cb26d051 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Received unexpected event network-vif-plugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff for instance with vm_state building and task_state spawning.
Aug 01 20:04:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:20 user nova-compute[72504]: DEBUG nova.compute.manager [req-ee39b04d-2910-4b9d-a1ae-7c852c9b8b95 req-dc8c3111-a57f-4e35-89bf-07262a47b3a8 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Received event network-vif-plugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:04:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ee39b04d-2910-4b9d-a1ae-7c852c9b8b95 req-dc8c3111-a57f-4e35-89bf-07262a47b3a8 service nova] Acquiring lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:04:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ee39b04d-2910-4b9d-a1ae-7c852c9b8b95 req-dc8c3111-a57f-4e35-89bf-07262a47b3a8 service nova] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:04:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ee39b04d-2910-4b9d-a1ae-7c852c9b8b95 req-dc8c3111-a57f-4e35-89bf-07262a47b3a8 service nova] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:04:20 user nova-compute[72504]: DEBUG nova.compute.manager [req-ee39b04d-2910-4b9d-a1ae-7c852c9b8b95 req-dc8c3111-a57f-4e35-89bf-07262a47b3a8 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] No waiting events found dispatching network-vif-plugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:04:20 user nova-compute[72504]: WARNING nova.compute.manager [req-ee39b04d-2910-4b9d-a1ae-7c852c9b8b95 req-dc8c3111-a57f-4e35-89bf-07262a47b3a8 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Received unexpected event network-vif-plugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff for instance with vm_state building and task_state spawning.
Aug 01 20:04:20 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920260.574164, 8b163903-b08f-44b6-a5b5-56dc897d5640 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:04:20 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] VM Resumed (Lifecycle Event)
Aug 01 20:04:20 user nova-compute[72504]: DEBUG nova.compute.manager [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:04:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:04:20 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Instance spawned successfully.
Aug 01 20:04:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 20:04:20 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:04:20 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:04:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:04:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:04:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:04:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:04:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:04:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:04:20 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:04:20 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920260.578359, 8b163903-b08f-44b6-a5b5-56dc897d5640 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:04:20 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] VM Started (Lifecycle Event)
Aug 01 20:04:20 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:04:20 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:04:20 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:04:20 user nova-compute[72504]: INFO nova.compute.manager [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Took 5.62 seconds to spawn the instance on the hypervisor.
Aug 01 20:04:20 user nova-compute[72504]: DEBUG nova.compute.manager [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:04:20 user nova-compute[72504]: INFO nova.compute.manager [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Took 15.21 seconds to build instance.
Aug 01 20:04:20 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:04:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-99ef0ac5-859c-4c6c-865f-ee642f732e54 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.312s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:04:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:21 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:04:21 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:04:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:04:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:04:22 user nova-compute[72504]: DEBUG nova.objects.instance [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lazy-loading 'flavor' on Instance uuid 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:04:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:04:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:04:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:04:22 user nova-compute[72504]: INFO nova.compute.manager [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Attaching volume c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 to /dev/vdb
Aug 01 20:04:23 user nova-compute[72504]: DEBUG os_brick.utils [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:04:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[07247799-33e0-4c50-9d58-642ab9628081]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93350fe-3e49-4c53-a9a0-3d58c429f313]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f88e97-9091-4ffb-8754-e397f2f667bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5859e2a-b704-45d3-8ac4-d03a5f551c60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:04:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:04:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:04:23 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:04:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[90aa5686-215c-4b38-a12f-7e8e84cdc1e6]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:04:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:04:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:04:23 user nova-compute[72504]: DEBUG os_brick.utils [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:04:23 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Updating existing volume attachment record: c25d0fa1-fb78-4b88-8924-a2e914729292 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:04:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:25 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:04:25 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:04:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:26 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:04:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:04:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:04:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:04:26 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:04:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:04:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:04:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:04:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a53847a9-5dfc-422b-ba06-617dda589042/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a53847a9-5dfc-422b-ba06-617dda589042/disk.rescue --force-share --output=json" returned: 0 in 0.260s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a53847a9-5dfc-422b-ba06-617dda589042/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a53847a9-5dfc-422b-ba06-617dda589042/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:04:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0163556c-3f0f-4e08-81a1-56f52ae805a8/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0163556c-3f0f-4e08-81a1-56f52ae805a8/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0163556c-3f0f-4e08-81a1-56f52ae805a8/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0163556c-3f0f-4e08-81a1-56f52ae805a8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:31 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:04:31 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:04:31 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=7229MB free_disk=24.971736907958984GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:04:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:04:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:04:31 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:04:31 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 7391a8ce-7ce5-47ec-97f6-6159645688ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:04:31 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:04:31 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 128c2981-363c-4ae9-b46d-15b5e5d9cac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:04:31 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 88f95d20-e391-4100-93b2-da29bfcf9704 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:04:31 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 54812de2-bfe3-46f1-a327-8081fbb80bec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:04:31 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:04:31 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance a53847a9-5dfc-422b-ba06-617dda589042 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:04:31 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance e19bf04b-43e0-4153-a6b5-74dbe36fedb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:04:31 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1ac6e0af-4adb-47a7-988e-971aa5efeb2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:04:31 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance ce155874-97ba-4266-86e1-3271c9879430 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:04:31 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 0163556c-3f0f-4e08-81a1-56f52ae805a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:04:31 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 8b163903-b08f-44b6-a5b5-56dc897d5640 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:04:31 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:04:31 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:04:32 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:04:32 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:04:32 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:04:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.581s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:04:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:33 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:04:33 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:04:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:04:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:04:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:04:33 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:04:33 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Updating instance_info_cache with network_info: [{"id": "f0cefd5c-7285-4f5e-b771-61f61039f900", "address": "fa:16:3e:9a:5b:08", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cefd5c-72", "ovs_interfaceid": "f0cefd5c-7285-4f5e-b771-61f61039f900", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:04:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:04:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:04:33 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:04:33 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:04:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CdAcZwIr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:04:37 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:04:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:04:37 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:04:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:04:37 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e29ec88-6018-4607-b803-4924452aebbc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:04:37 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d4396f-4af2-42b4-b7ef-b053739218a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1] added
Aug 01 20:04:37 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[de433ecd-9230-4203-85d8-4bb33cb1b1f6]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8997bb1c-38c2-4b80-a607-65766f003c3f]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CdAcZwIr {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CdAcZwIr" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5e114a-4043-4993-9cb9-c9ac40b2fc1d]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CdAcZwIr'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6469a70e-0c60-41aa-882c-251863a2dbe1]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6735483f-4a76-46fb-93ad-73a62508ac7e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:04:37 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:04:37 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:04:37 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:04:37 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:04:37 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:04:37 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:04:37 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:04:37 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7298fe-ebdb-4f89-860f-fd9295166616]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1, portal: 172.16.0.220,3260]
Aug 01 20:04:37 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1, portal: 172.16.0.220,3260] successful.
Aug 01 20:04:37 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[24445121-aaaf-4c5f-a200-4769539c4e1c]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab79aab-7995-4854-b583-a2df7f0715fa]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:04:37 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:04:37 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:04:37 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:04:37 user nova-compute[72504]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 (non-flash)
Aug 01 20:04:37 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:04:37 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:04:37 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:04:37 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:04:37 user nova-compute[72504]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 (non-flash)
Aug 01 20:04:37 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8c80eb-845b-4e42-b0cc-d431fed1b78a]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:04:37 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CdAcZwIr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:04:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:04:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26162303033303034', 'path': '/dev/sdf'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:04:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162303033303034', 'path': '/dev/sdf'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:04:38 user nova-compute[72504]: DEBUG nova.objects.instance [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lazy-loading 'flavor' on Instance uuid 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:04:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 20:04:38 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:04:38 user nova-compute[72504]:   <source dev="/dev/sdf"/>
Aug 01 20:04:38 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:04:38 user nova-compute[72504]:   <serial>c8a0a8f4-0c52-4003-81bd-fc0cd72098b1</serial>
Aug 01 20:04:38 user nova-compute[72504]: </disk>
Aug 01 20:04:38 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 20:04:39 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:04:39 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:04:39 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] No VIF found with MAC fa:16:3e:45:db:12, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:04:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-66c1fbf6-bae9-43e2-b289-084723ecdf6d tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.702s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:04:41 user nova-compute[72504]: INFO nova.compute.manager [None req-cff7d795-3b92-486b-862b-cbcc1c1cafb2 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Unrescuing
Aug 01 20:04:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cff7d795-3b92-486b-862b-cbcc1c1cafb2 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "refresh_cache-a53847a9-5dfc-422b-ba06-617dda589042" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:04:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cff7d795-3b92-486b-862b-cbcc1c1cafb2 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquired lock "refresh_cache-a53847a9-5dfc-422b-ba06-617dda589042" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:04:41 user nova-compute[72504]: DEBUG nova.network.neutron [None req-cff7d795-3b92-486b-862b-cbcc1c1cafb2 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:04:41 user nova-compute[72504]: DEBUG nova.network.neutron [None req-cff7d795-3b92-486b-862b-cbcc1c1cafb2 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Updating instance_info_cache with network_info: [{"id": "48c8fc49-f988-42f1-8275-836370d6a5a8", "address": "fa:16:3e:c4:fb:c8", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c8fc49-f9", "ovs_interfaceid": "48c8fc49-f988-42f1-8275-836370d6a5a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:04:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cff7d795-3b92-486b-862b-cbcc1c1cafb2 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Releasing lock "refresh_cache-a53847a9-5dfc-422b-ba06-617dda589042" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:04:41 user nova-compute[72504]: DEBUG nova.objects.instance [None req-cff7d795-3b92-486b-862b-cbcc1c1cafb2 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lazy-loading 'flavor' on Instance uuid a53847a9-5dfc-422b-ba06-617dda589042 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:04:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:04:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:04:41 user nova-compute[72504]: INFO nova.compute.manager [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Detaching volume c8a0a8f4-0c52-4003-81bd-fc0cd72098b1
Aug 01 20:04:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:41 user nova-compute[72504]: INFO nova.virt.block_device [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Attempting to driver detach volume c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 from mountpoint /dev/vdb
Aug 01 20:04:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Attempting to detach device vdb from instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 20:04:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:04:41 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:04:41 user nova-compute[72504]:   <source dev="/dev/sdf"/>
Aug 01 20:04:41 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:04:41 user nova-compute[72504]:   <serial>c8a0a8f4-0c52-4003-81bd-fc0cd72098b1</serial>
Aug 01 20:04:41 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:04:41 user nova-compute[72504]: </disk>
Aug 01 20:04:41 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:04:41 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Successfully detached device vdb from instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 from the persistent domain config.
Aug 01 20:04:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 20:04:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:04:41 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:04:41 user nova-compute[72504]:   <source dev="/dev/sdf"/>
Aug 01 20:04:41 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:04:41 user nova-compute[72504]:   <serial>c8a0a8f4-0c52-4003-81bd-fc0cd72098b1</serial>
Aug 01 20:04:41 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:04:41 user nova-compute[72504]: </disk>
Aug 01 20:04:41 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:04:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-1d5e1ba9-3e5f-4b65-9ef7-d317f568d95d req-f48b9ef5-ae03-45d0-8584-a8c8e007cb21 service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Received event network-vif-unplugged-48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:04:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1d5e1ba9-3e5f-4b65-9ef7-d317f568d95d req-f48b9ef5-ae03-45d0-8584-a8c8e007cb21 service nova] Acquiring lock "a53847a9-5dfc-422b-ba06-617dda589042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:04:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1d5e1ba9-3e5f-4b65-9ef7-d317f568d95d req-f48b9ef5-ae03-45d0-8584-a8c8e007cb21 service nova] Lock "a53847a9-5dfc-422b-ba06-617dda589042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:04:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1d5e1ba9-3e5f-4b65-9ef7-d317f568d95d req-f48b9ef5-ae03-45d0-8584-a8c8e007cb21 service nova] Lock "a53847a9-5dfc-422b-ba06-617dda589042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:04:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-1d5e1ba9-3e5f-4b65-9ef7-d317f568d95d req-f48b9ef5-ae03-45d0-8584-a8c8e007cb21 service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] No waiting events found dispatching network-vif-unplugged-48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:04:41 user nova-compute[72504]: WARNING nova.compute.manager [req-1d5e1ba9-3e5f-4b65-9ef7-d317f568d95d req-f48b9ef5-ae03-45d0-8584-a8c8e007cb21 service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Received unexpected event network-vif-unplugged-48c8fc49-f988-42f1-8275-836370d6a5a8 for instance with vm_state rescued and task_state unrescuing.
Aug 01 20:04:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690920282.352848, 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 20:04:42 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Successfully detached device vdb from instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 from the live domain config.
Aug 01 20:04:42 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CdAcZwIr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:04:42 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:04:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6f2dd4-49c0-4208-b138-5cfd51ffaa4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb50f35-34bf-4619-8166-2d87cf5951cd]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:04:42 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:04:42 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:04:42 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:04:42 user nova-compute[72504]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 (non-flash)
Aug 01 20:04:42 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:04:42 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:04:42 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:04:42 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:04:42 user nova-compute[72504]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 (non-flash)
Aug 01 20:04:42 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3f4734e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1'): ({'sdf'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Removing single pathed devices sdf {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[71927842-0a7b-4bb8-821a-81bcd1249d97]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45139f9-309c-4e4d-aaf7-03717e3d73be]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Flushing IO for device /dev/sdf {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d21e9da-e6ea-466a-9b01-9eff4cdedeeb]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba090f58-8a08-480a-a099-222d5dbe685e]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] SCSI volumes sdf have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff4ae68-ffe3-4456-8ad9-9beead852290]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[471837ae-de75-48cc-b40b-a4048c1ae8c3]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1, portal: 172.16.0.220,3260]
Aug 01 20:04:42 user nova-compute[72504]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1, portal: 172.16.0.220,3260] successful.
Aug 01 20:04:42 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8a0a8f4-0c52-4003-81bd-fc0cd72098b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d962e53d-579d-4128-9394-e2438a43d987]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] <== disconnect_volume: return (327ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:04:42 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:04:42 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Instance destroyed successfully.
Aug 01 20:04:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:43 user nova-compute[72504]: DEBUG nova.objects.instance [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lazy-loading 'flavor' on Instance uuid 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:04:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7610959e-10bd-4b87-82ba-1d43bab139e5 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.842s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:04:43 user nova-compute[72504]: DEBUG nova.compute.manager [req-28eef68f-dda1-446f-9927-d115ca82cb81 req-48dbabe9-55d4-4dcf-b831-51c8951077d3 service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Received event network-vif-plugged-48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:04:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-28eef68f-dda1-446f-9927-d115ca82cb81 req-48dbabe9-55d4-4dcf-b831-51c8951077d3 service nova] Acquiring lock "a53847a9-5dfc-422b-ba06-617dda589042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:04:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-28eef68f-dda1-446f-9927-d115ca82cb81 req-48dbabe9-55d4-4dcf-b831-51c8951077d3 service nova] Lock "a53847a9-5dfc-422b-ba06-617dda589042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:04:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-28eef68f-dda1-446f-9927-d115ca82cb81 req-48dbabe9-55d4-4dcf-b831-51c8951077d3 service nova] Lock "a53847a9-5dfc-422b-ba06-617dda589042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:04:43 user nova-compute[72504]: DEBUG nova.compute.manager [req-28eef68f-dda1-446f-9927-d115ca82cb81 req-48dbabe9-55d4-4dcf-b831-51c8951077d3 service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] No waiting events found dispatching network-vif-plugged-48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:04:43 user nova-compute[72504]: WARNING nova.compute.manager [req-28eef68f-dda1-446f-9927-d115ca82cb81 req-48dbabe9-55d4-4dcf-b831-51c8951077d3 service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Received unexpected event network-vif-plugged-48c8fc49-f988-42f1-8275-836370d6a5a8 for instance with vm_state rescued and task_state unrescuing.
Aug 01 20:04:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:46 user nova-compute[72504]: DEBUG nova.compute.manager [req-e134f0f0-0195-4b74-84a6-5d3a68e7e584 req-34a49d50-6a19-4a44-9fd8-790816d65cda service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Received event network-vif-plugged-48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:04:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e134f0f0-0195-4b74-84a6-5d3a68e7e584 req-34a49d50-6a19-4a44-9fd8-790816d65cda service nova] Acquiring lock "a53847a9-5dfc-422b-ba06-617dda589042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:04:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e134f0f0-0195-4b74-84a6-5d3a68e7e584 req-34a49d50-6a19-4a44-9fd8-790816d65cda service nova] Lock "a53847a9-5dfc-422b-ba06-617dda589042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:04:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e134f0f0-0195-4b74-84a6-5d3a68e7e584 req-34a49d50-6a19-4a44-9fd8-790816d65cda service nova] Lock "a53847a9-5dfc-422b-ba06-617dda589042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:04:46 user nova-compute[72504]: DEBUG nova.compute.manager [req-e134f0f0-0195-4b74-84a6-5d3a68e7e584 req-34a49d50-6a19-4a44-9fd8-790816d65cda service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] No waiting events found dispatching network-vif-plugged-48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:04:46 user nova-compute[72504]: WARNING nova.compute.manager [req-e134f0f0-0195-4b74-84a6-5d3a68e7e584 req-34a49d50-6a19-4a44-9fd8-790816d65cda service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Received unexpected event network-vif-plugged-48c8fc49-f988-42f1-8275-836370d6a5a8 for instance with vm_state rescued and task_state unrescuing.
Aug 01 20:04:46 user nova-compute[72504]: DEBUG nova.compute.manager [req-e134f0f0-0195-4b74-84a6-5d3a68e7e584 req-34a49d50-6a19-4a44-9fd8-790816d65cda service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Received event network-vif-plugged-48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:04:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e134f0f0-0195-4b74-84a6-5d3a68e7e584 req-34a49d50-6a19-4a44-9fd8-790816d65cda service nova] Acquiring lock "a53847a9-5dfc-422b-ba06-617dda589042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:04:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e134f0f0-0195-4b74-84a6-5d3a68e7e584 req-34a49d50-6a19-4a44-9fd8-790816d65cda service nova] Lock "a53847a9-5dfc-422b-ba06-617dda589042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:04:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e134f0f0-0195-4b74-84a6-5d3a68e7e584 req-34a49d50-6a19-4a44-9fd8-790816d65cda service nova] Lock "a53847a9-5dfc-422b-ba06-617dda589042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:04:46 user nova-compute[72504]: DEBUG nova.compute.manager [req-e134f0f0-0195-4b74-84a6-5d3a68e7e584 req-34a49d50-6a19-4a44-9fd8-790816d65cda service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] No waiting events found dispatching network-vif-plugged-48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:04:46 user nova-compute[72504]: WARNING nova.compute.manager [req-e134f0f0-0195-4b74-84a6-5d3a68e7e584 req-34a49d50-6a19-4a44-9fd8-790816d65cda service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Received unexpected event network-vif-plugged-48c8fc49-f988-42f1-8275-836370d6a5a8 for instance with vm_state rescued and task_state unrescuing.
Aug 01 20:04:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Removed pending event for a53847a9-5dfc-422b-ba06-617dda589042 due to event {{(pid=72504) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 20:04:46 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920286.6855967, a53847a9-5dfc-422b-ba06-617dda589042 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:04:46 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a53847a9-5dfc-422b-ba06-617dda589042] VM Resumed (Lifecycle Event)
Aug 01 20:04:46 user nova-compute[72504]: DEBUG nova.compute.manager [None req-cff7d795-3b92-486b-862b-cbcc1c1cafb2 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:04:46 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:04:46 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:04:46 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a53847a9-5dfc-422b-ba06-617dda589042] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 20:04:46 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920286.688994, a53847a9-5dfc-422b-ba06-617dda589042 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:04:46 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a53847a9-5dfc-422b-ba06-617dda589042] VM Started (Lifecycle Event)
Aug 01 20:04:46 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:04:46 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:04:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:51 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:04:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "c27bf963-def8-4221-82f2-af2165b6f1dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "c27bf963-def8-4221-82f2-af2165b6f1dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:13 user nova-compute[72504]: DEBUG nova.compute.manager [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 20:05:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:13 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:05:13 user nova-compute[72504]: INFO nova.compute.claims [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Claim successful on node user
Aug 01 20:05:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:13 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:05:13 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:05:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.569s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:13 user nova-compute[72504]: DEBUG nova.compute.manager [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 20:05:13 user nova-compute[72504]: DEBUG nova.compute.manager [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 20:05:13 user nova-compute[72504]: DEBUG nova.network.neutron [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 20:05:13 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 20:05:13 user nova-compute[72504]: DEBUG nova.compute.manager [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 20:05:13 user nova-compute[72504]: INFO nova.virt.block_device [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Booting with volume snapshot 64f86799-428c-4c7b-bbf8-5c1d18a12585 at /dev/vda
Aug 01 20:05:13 user nova-compute[72504]: DEBUG nova.policy [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f06381c8a6214ddea7f1b36b623ed4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb59fbc2bf9749f3af7d56435cb37066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 20:05:15 user nova-compute[72504]: DEBUG nova.network.neutron [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Successfully created port: cf70ae69-677f-41a6-8eab-637ebe2d51b7 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 20:05:15 user nova-compute[72504]: DEBUG nova.network.neutron [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Successfully updated port: cf70ae69-677f-41a6-8eab-637ebe2d51b7 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 20:05:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "refresh_cache-c27bf963-def8-4221-82f2-af2165b6f1dc" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:05:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquired lock "refresh_cache-c27bf963-def8-4221-82f2-af2165b6f1dc" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:05:15 user nova-compute[72504]: DEBUG nova.network.neutron [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:05:16 user nova-compute[72504]: DEBUG nova.compute.manager [req-fb60677d-06d5-4316-87df-d1ab2379b3d0 req-51e0444b-c34a-498f-b539-93aeb6acb2b0 service nova] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Received event network-changed-cf70ae69-677f-41a6-8eab-637ebe2d51b7 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:05:16 user nova-compute[72504]: DEBUG nova.compute.manager [req-fb60677d-06d5-4316-87df-d1ab2379b3d0 req-51e0444b-c34a-498f-b539-93aeb6acb2b0 service nova] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Refreshing instance network info cache due to event network-changed-cf70ae69-677f-41a6-8eab-637ebe2d51b7. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:05:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-fb60677d-06d5-4316-87df-d1ab2379b3d0 req-51e0444b-c34a-498f-b539-93aeb6acb2b0 service nova] Acquiring lock "refresh_cache-c27bf963-def8-4221-82f2-af2165b6f1dc" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:05:16 user nova-compute[72504]: DEBUG nova.network.neutron [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:05:16 user nova-compute[72504]: DEBUG nova.network.neutron [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Updating instance_info_cache with network_info: [{"id": "cf70ae69-677f-41a6-8eab-637ebe2d51b7", "address": "fa:16:3e:12:f3:17", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf70ae69-67", "ovs_interfaceid": "cf70ae69-677f-41a6-8eab-637ebe2d51b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:05:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Releasing lock "refresh_cache-c27bf963-def8-4221-82f2-af2165b6f1dc" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:05:16 user nova-compute[72504]: DEBUG nova.compute.manager [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Instance network_info: |[{"id": "cf70ae69-677f-41a6-8eab-637ebe2d51b7", "address": "fa:16:3e:12:f3:17", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf70ae69-67", "ovs_interfaceid": "cf70ae69-677f-41a6-8eab-637ebe2d51b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 20:05:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-fb60677d-06d5-4316-87df-d1ab2379b3d0 req-51e0444b-c34a-498f-b539-93aeb6acb2b0 service nova] Acquired lock "refresh_cache-c27bf963-def8-4221-82f2-af2165b6f1dc" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:05:16 user nova-compute[72504]: DEBUG nova.network.neutron [req-fb60677d-06d5-4316-87df-d1ab2379b3d0 req-51e0444b-c34a-498f-b539-93aeb6acb2b0 service nova] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Refreshing network info cache for port cf70ae69-677f-41a6-8eab-637ebe2d51b7 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:05:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:16 user nova-compute[72504]: DEBUG nova.network.neutron [req-fb60677d-06d5-4316-87df-d1ab2379b3d0 req-51e0444b-c34a-498f-b539-93aeb6acb2b0 service nova] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Updated VIF entry in instance network info cache for port cf70ae69-677f-41a6-8eab-637ebe2d51b7. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:05:16 user nova-compute[72504]: DEBUG nova.network.neutron [req-fb60677d-06d5-4316-87df-d1ab2379b3d0 req-51e0444b-c34a-498f-b539-93aeb6acb2b0 service nova] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Updating instance_info_cache with network_info: [{"id": "cf70ae69-677f-41a6-8eab-637ebe2d51b7", "address": "fa:16:3e:12:f3:17", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf70ae69-67", "ovs_interfaceid": "cf70ae69-677f-41a6-8eab-637ebe2d51b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:05:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-fb60677d-06d5-4316-87df-d1ab2379b3d0 req-51e0444b-c34a-498f-b539-93aeb6acb2b0 service nova] Releasing lock "refresh_cache-c27bf963-def8-4221-82f2-af2165b6f1dc" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:05:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:19 user nova-compute[72504]: DEBUG os_brick.utils [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:05:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:19 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[991758ce-c86b-4874-9358-1e4f751e1fc5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:19 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[20521c37-4c5a-4f65-975f-5d396a5dd5ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:19 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8bdfd6-ec95-4df1-9892-37dbda6c1d68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:19 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6798602b-a149-4f4f-a190-58ac16244807]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:05:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:05:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:05:19 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:05:19 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[309e9f07-d543-4fb1-ac6e-68e73e1cd998]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:05:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:05:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:05:19 user nova-compute[72504]: DEBUG os_brick.utils [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:05:19 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Updating existing volume attachment record: ae4a3ab7-7341-49da-aea5-92800ac1f468 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:05:20 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:05:20 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Cleaning up deleted instances {{(pid=72504) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 20:05:20 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] There are 0 instances to clean {{(pid=72504) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 20:05:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:22 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:05:22 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:05:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:23 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:05:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:25 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:05:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:26 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:05:26 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG nova.compute.manager [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:05:27 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Creating image(s)
Aug 01 20:05:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Did not create local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Ensure instance console log exists: /opt/stack/data/nova/instances/c27bf963-def8-4221-82f2-af2165b6f1dc/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Start _get_guest_xml network_info=[{"id": "cf70ae69-677f-41a6-8eab-637ebe2d51b7", "address": "fa:16:3e:12:f3:17", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf70ae69-67", "ovs_interfaceid": "cf70ae69-677f-41a6-8eab-637ebe2d51b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KoBMDAkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c27bf963-def8-4221-82f2-af2165b6f1dc', 'attached_at': '', 'detached_at': '', 'volume_id': '679dd5be-20b4-419c-91e6-253cb82073bf', 'serial': '679dd5be-20b4-419c-91e6-253cb82073bf'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': 'ae4a3ab7-7341-49da-aea5-92800ac1f468', 'volume_type': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:05:27 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:05:27 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:05:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KoBMDAkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:05:27 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:05:27 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:05:27 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:05:27 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:05:27 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3db43db-1dee-4309-837a-112f036d2d37]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:05:27 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacb3613-fc2b-4ac8-8426-b49169fe0f62]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf] added
Aug 01 20:05:27 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7667d5-ea0f-4a7b-a704-57f32215fe6c]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26f6f19-00c4-4f76-9a99-722e75e2a70b]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KoBMDAkx {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KoBMDAkx" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52a8581-1629-430d-8825-a7ff1966dbab]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KoBMDAkx'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa8ea50-b884-4151-841b-f2387bf0df36]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f190abf0-40e7-4247-8f33-0d323fb587fa]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:05:27 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:05:27 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:05:27 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:05:27 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:05:27 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:05:27 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:05:27 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:05:27 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee1356a-2b8c-4302-a376-71f0f21675af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf, portal: 172.16.0.220,3260]
Aug 01 20:05:27 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf, portal: 172.16.0.220,3260] successful.
Aug 01 20:05:27 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[762ebffb-4ca3-4743-b351-74dd0d5e3126]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[600b6ddf-8daf-473c-9e31-e51a981be1ba]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:05:27 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:05:27 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:05:27 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:05:27 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:05:27 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:05:27 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:05:27 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:05:27 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:05:27 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:05:27 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee599408-d5db-466d-9174-bc1c60213af7]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:05:27 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KoBMDAkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:05:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.127s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:05:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26461383033356333', 'path': '/dev/sdf'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:05:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461383033356333', 'path': '/dev/sdf'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:05:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:05:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2082518073',display_name='tempest-TestVolumeBootPattern-server-2082518073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2082518073',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb59fbc2bf9749f3af7d56435cb37066',ramdisk_id='',reservation_id='r-29bb8l4f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-685885098',owner_user_name='tempest-TestVolumeBootPattern-685885098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:05:14Z,user_data=None,user_id='f06381c8a6214ddea7f1b36b623ed4d5',uuid=c27bf963-def8-4221-82f2-af2165b6f1dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf70ae69-677f-41a6-8eab-637ebe2d51b7", "address": "fa:16:3e:12:f3:17", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf70ae69-67", "ovs_interfaceid": "cf70ae69-677f-41a6-8eab-637ebe2d51b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:05:28 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converting VIF {"id": "cf70ae69-677f-41a6-8eab-637ebe2d51b7", "address": "fa:16:3e:12:f3:17", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf70ae69-67", "ovs_interfaceid": "cf70ae69-677f-41a6-8eab-637ebe2d51b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:05:28 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:f3:17,bridge_name='br-int',has_traffic_filtering=True,id=cf70ae69-677f-41a6-8eab-637ebe2d51b7,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf70ae69-67') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:05:28 user nova-compute[72504]: DEBUG nova.objects.instance [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lazy-loading 'pci_devices' on Instance uuid c27bf963-def8-4221-82f2-af2165b6f1dc {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:05:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:05:29 user nova-compute[72504]:   <uuid>c27bf963-def8-4221-82f2-af2165b6f1dc</uuid>
Aug 01 20:05:29 user nova-compute[72504]:   <name>instance-00000021</name>
Aug 01 20:05:29 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:05:29 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:05:29 user nova-compute[72504]:   <metadata>
Aug 01 20:05:29 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:05:29 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:05:29 user nova-compute[72504]:       <nova:name>tempest-TestVolumeBootPattern-server-2082518073</nova:name>
Aug 01 20:05:29 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:05:27</nova:creationTime>
Aug 01 20:05:29 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:05:29 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:05:29 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:05:29 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:05:29 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:05:29 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:05:29 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:05:29 user nova-compute[72504]:       <nova:owner>
Aug 01 20:05:29 user nova-compute[72504]:         <nova:user uuid="f06381c8a6214ddea7f1b36b623ed4d5">tempest-TestVolumeBootPattern-685885098-project-member</nova:user>
Aug 01 20:05:29 user nova-compute[72504]:         <nova:project uuid="eb59fbc2bf9749f3af7d56435cb37066">tempest-TestVolumeBootPattern-685885098</nova:project>
Aug 01 20:05:29 user nova-compute[72504]:       </nova:owner>
Aug 01 20:05:29 user nova-compute[72504]:       <nova:ports>
Aug 01 20:05:29 user nova-compute[72504]:         <nova:port uuid="cf70ae69-677f-41a6-8eab-637ebe2d51b7">
Aug 01 20:05:29 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 20:05:29 user nova-compute[72504]:         </nova:port>
Aug 01 20:05:29 user nova-compute[72504]:       </nova:ports>
Aug 01 20:05:29 user nova-compute[72504]:     </nova:instance>
Aug 01 20:05:29 user nova-compute[72504]:   </metadata>
Aug 01 20:05:29 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:05:29 user nova-compute[72504]:     <system>
Aug 01 20:05:29 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:05:29 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:05:29 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:05:29 user nova-compute[72504]:       <entry name="serial">c27bf963-def8-4221-82f2-af2165b6f1dc</entry>
Aug 01 20:05:29 user nova-compute[72504]:       <entry name="uuid">c27bf963-def8-4221-82f2-af2165b6f1dc</entry>
Aug 01 20:05:29 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:05:29 user nova-compute[72504]:     </system>
Aug 01 20:05:29 user nova-compute[72504]:   </sysinfo>
Aug 01 20:05:29 user nova-compute[72504]:   <os>
Aug 01 20:05:29 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:05:29 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:05:29 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:05:29 user nova-compute[72504]:   </os>
Aug 01 20:05:29 user nova-compute[72504]:   <features>
Aug 01 20:05:29 user nova-compute[72504]:     <acpi/>
Aug 01 20:05:29 user nova-compute[72504]:     <apic/>
Aug 01 20:05:29 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:05:29 user nova-compute[72504]:   </features>
Aug 01 20:05:29 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:05:29 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:05:29 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:05:29 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:05:29 user nova-compute[72504]:   </clock>
Aug 01 20:05:29 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:05:29 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:05:29 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:05:29 user nova-compute[72504]:   </cpu>
Aug 01 20:05:29 user nova-compute[72504]:   <devices>
Aug 01 20:05:29 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 20:05:29 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:05:29 user nova-compute[72504]:       <source dev="/dev/sdf"/>
Aug 01 20:05:29 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:05:29 user nova-compute[72504]:       <serial>679dd5be-20b4-419c-91e6-253cb82073bf</serial>
Aug 01 20:05:29 user nova-compute[72504]:     </disk>
Aug 01 20:05:29 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:05:29 user nova-compute[72504]:       <mac address="fa:16:3e:12:f3:17"/>
Aug 01 20:05:29 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:05:29 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:05:29 user nova-compute[72504]:       <target dev="tapcf70ae69-67"/>
Aug 01 20:05:29 user nova-compute[72504]:     </interface>
Aug 01 20:05:29 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:05:29 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/c27bf963-def8-4221-82f2-af2165b6f1dc/console.log" append="off"/>
Aug 01 20:05:29 user nova-compute[72504]:     </serial>
Aug 01 20:05:29 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:05:29 user nova-compute[72504]:     <video>
Aug 01 20:05:29 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:05:29 user nova-compute[72504]:     </video>
Aug 01 20:05:29 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:05:29 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:05:29 user nova-compute[72504]:     </rng>
Aug 01 20:05:29 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:05:29 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:05:29 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:05:29 user nova-compute[72504]:     </memballoon>
Aug 01 20:05:29 user nova-compute[72504]:   </devices>
Aug 01 20:05:29 user nova-compute[72504]: </domain>
Aug 01 20:05:29 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:05:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2082518073',display_name='tempest-TestVolumeBootPattern-server-2082518073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2082518073',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb59fbc2bf9749f3af7d56435cb37066',ramdisk_id='',reservation_id='r-29bb8l4f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-685885098',owner_user_name='tempest-TestVolumeBootPattern-685885098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:05:14Z,user_data=None,user_id='f06381c8a6214ddea7f1b36b623ed4d5',uuid=c27bf963-def8-4221-82f2-af2165b6f1dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf70ae69-677f-41a6-8eab-637ebe2d51b7", "address": "fa:16:3e:12:f3:17", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf70ae69-67", "ovs_interfaceid": "cf70ae69-677f-41a6-8eab-637ebe2d51b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converting VIF {"id": "cf70ae69-677f-41a6-8eab-637ebe2d51b7", "address": "fa:16:3e:12:f3:17", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf70ae69-67", "ovs_interfaceid": "cf70ae69-677f-41a6-8eab-637ebe2d51b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:f3:17,bridge_name='br-int',has_traffic_filtering=True,id=cf70ae69-677f-41a6-8eab-637ebe2d51b7,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf70ae69-67') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG os_vif [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:f3:17,bridge_name='br-int',has_traffic_filtering=True,id=cf70ae69-677f-41a6-8eab-637ebe2d51b7,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf70ae69-67') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf70ae69-67, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcf70ae69-67, col_values=(('external_ids', {'iface-id': 'cf70ae69-677f-41a6-8eab-637ebe2d51b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:f3:17', 'vm-uuid': 'c27bf963-def8-4221-82f2-af2165b6f1dc'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Acquiring lock "9d650208-b69b-4106-b598-5d24d8ec489a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "9d650208-b69b-4106-b598-5d24d8ec489a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:29 user nova-compute[72504]: INFO os_vif [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:f3:17,bridge_name='br-int',has_traffic_filtering=True,id=cf70ae69-677f-41a6-8eab-637ebe2d51b7,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf70ae69-67')
Aug 01 20:05:29 user nova-compute[72504]: DEBUG nova.compute.manager [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] No VIF found with MAC fa:16:3e:12:f3:17, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:05:29 user nova-compute[72504]: INFO nova.compute.claims [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Claim successful on node user
Aug 01 20:05:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.760s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG nova.compute.manager [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG nova.compute.manager [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG nova.network.neutron [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 20:05:30 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 20:05:30 user nova-compute[72504]: DEBUG nova.compute.manager [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG nova.policy [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e9aad8402924317bb7c92ed6ccfa87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41110ec7bd3e4ba8a6726bfeeef400d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG nova.compute.manager [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:05:30 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Creating image(s)
Aug 01 20:05:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Acquiring lock "/opt/stack/data/nova/instances/9d650208-b69b-4106-b598-5d24d8ec489a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "/opt/stack/data/nova/instances/9d650208-b69b-4106-b598-5d24d8ec489a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "/opt/stack/data/nova/instances/9d650208-b69b-4106-b598-5d24d8ec489a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.172s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.151s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/9d650208-b69b-4106-b598-5d24d8ec489a/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/9d650208-b69b-4106-b598-5d24d8ec489a/disk 1073741824" returned: 0 in 0.065s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.169s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9d650208-b69b-4106-b598-5d24d8ec489a/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d650208-b69b-4106-b598-5d24d8ec489a/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG nova.compute.manager [req-9b876b12-be13-46d0-814d-3e4ce912035e req-31e530e1-34d8-4e73-a6f6-718b54e7afe2 service nova] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Received event network-vif-plugged-cf70ae69-677f-41a6-8eab-637ebe2d51b7 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-9b876b12-be13-46d0-814d-3e4ce912035e req-31e530e1-34d8-4e73-a6f6-718b54e7afe2 service nova] Acquiring lock "c27bf963-def8-4221-82f2-af2165b6f1dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-9b876b12-be13-46d0-814d-3e4ce912035e req-31e530e1-34d8-4e73-a6f6-718b54e7afe2 service nova] Lock "c27bf963-def8-4221-82f2-af2165b6f1dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-9b876b12-be13-46d0-814d-3e4ce912035e req-31e530e1-34d8-4e73-a6f6-718b54e7afe2 service nova] Lock "c27bf963-def8-4221-82f2-af2165b6f1dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG nova.compute.manager [req-9b876b12-be13-46d0-814d-3e4ce912035e req-31e530e1-34d8-4e73-a6f6-718b54e7afe2 service nova] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] No waiting events found dispatching network-vif-plugged-cf70ae69-677f-41a6-8eab-637ebe2d51b7 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:05:30 user nova-compute[72504]: WARNING nova.compute.manager [req-9b876b12-be13-46d0-814d-3e4ce912035e req-31e530e1-34d8-4e73-a6f6-718b54e7afe2 service nova] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Received unexpected event network-vif-plugged-cf70ae69-677f-41a6-8eab-637ebe2d51b7 for instance with vm_state building and task_state spawning.
Aug 01 20:05:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:05:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d650208-b69b-4106-b598-5d24d8ec489a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:31 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Cannot resize image /opt/stack/data/nova/instances/9d650208-b69b-4106-b598-5d24d8ec489a/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 20:05:31 user nova-compute[72504]: DEBUG nova.objects.instance [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lazy-loading 'migration_context' on Instance uuid 9d650208-b69b-4106-b598-5d24d8ec489a {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:05:31 user nova-compute[72504]: DEBUG nova.network.neutron [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Successfully created port: 61bdc55c-47b8-4fb2-8743-a2ff4f546dab {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 20:05:31 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 20:05:31 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Ensure instance console log exists: /opt/stack/data/nova/instances/9d650208-b69b-4106-b598-5d24d8ec489a/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:05:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0163556c-3f0f-4e08-81a1-56f52ae805a8/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0163556c-3f0f-4e08-81a1-56f52ae805a8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0163556c-3f0f-4e08-81a1-56f52ae805a8/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0163556c-3f0f-4e08-81a1-56f52ae805a8/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:32 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920332.782377, c27bf963-def8-4221-82f2-af2165b6f1dc => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:05:32 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] VM Resumed (Lifecycle Event)
Aug 01 20:05:32 user nova-compute[72504]: DEBUG nova.network.neutron [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Successfully updated port: 61bdc55c-47b8-4fb2-8743-a2ff4f546dab {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 20:05:32 user nova-compute[72504]: DEBUG nova.compute.manager [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:05:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:05:32 user nova-compute[72504]: DEBUG nova.compute.manager [req-d66fe258-cff9-46a9-9758-a75581aaa818 req-8994448f-6b3a-4630-8cf6-9d9e77a7b964 service nova] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Received event network-changed-61bdc55c-47b8-4fb2-8743-a2ff4f546dab {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:05:32 user nova-compute[72504]: DEBUG nova.compute.manager [req-d66fe258-cff9-46a9-9758-a75581aaa818 req-8994448f-6b3a-4630-8cf6-9d9e77a7b964 service nova] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Refreshing instance network info cache due to event network-changed-61bdc55c-47b8-4fb2-8743-a2ff4f546dab. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:05:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d66fe258-cff9-46a9-9758-a75581aaa818 req-8994448f-6b3a-4630-8cf6-9d9e77a7b964 service nova] Acquiring lock "refresh_cache-9d650208-b69b-4106-b598-5d24d8ec489a" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:05:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d66fe258-cff9-46a9-9758-a75581aaa818 req-8994448f-6b3a-4630-8cf6-9d9e77a7b964 service nova] Acquired lock "refresh_cache-9d650208-b69b-4106-b598-5d24d8ec489a" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:05:32 user nova-compute[72504]: DEBUG nova.network.neutron [req-d66fe258-cff9-46a9-9758-a75581aaa818 req-8994448f-6b3a-4630-8cf6-9d9e77a7b964 service nova] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Refreshing network info cache for port 61bdc55c-47b8-4fb2-8743-a2ff4f546dab {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:05:32 user nova-compute[72504]: DEBUG nova.compute.manager [req-cf4169d7-1b47-41df-a19b-c1174b0f96a6 req-d454bf51-fc53-462b-b906-6791d0e88b1c service nova] [instance: ce155874-97ba-4266-86e1-3271c9879430] Received event network-changed-506369dd-7925-4369-abe3-640b8268b134 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:05:32 user nova-compute[72504]: DEBUG nova.compute.manager [req-cf4169d7-1b47-41df-a19b-c1174b0f96a6 req-d454bf51-fc53-462b-b906-6791d0e88b1c service nova] [instance: ce155874-97ba-4266-86e1-3271c9879430] Refreshing instance network info cache due to event network-changed-506369dd-7925-4369-abe3-640b8268b134. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:05:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cf4169d7-1b47-41df-a19b-c1174b0f96a6 req-d454bf51-fc53-462b-b906-6791d0e88b1c service nova] Acquiring lock "refresh_cache-ce155874-97ba-4266-86e1-3271c9879430" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:05:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cf4169d7-1b47-41df-a19b-c1174b0f96a6 req-d454bf51-fc53-462b-b906-6791d0e88b1c service nova] Acquired lock "refresh_cache-ce155874-97ba-4266-86e1-3271c9879430" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:05:32 user nova-compute[72504]: DEBUG nova.network.neutron [req-cf4169d7-1b47-41df-a19b-c1174b0f96a6 req-d454bf51-fc53-462b-b906-6791d0e88b1c service nova] [instance: ce155874-97ba-4266-86e1-3271c9879430] Refreshing network info cache for port 506369dd-7925-4369-abe3-640b8268b134 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:05:32 user nova-compute[72504]: DEBUG nova.compute.manager [req-79a854d7-4b9c-4cc2-8e48-3917adfface2 req-097f1296-dcd8-4ea1-81b5-16de43cfda59 service nova] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Received event network-vif-plugged-cf70ae69-677f-41a6-8eab-637ebe2d51b7 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:05:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-79a854d7-4b9c-4cc2-8e48-3917adfface2 req-097f1296-dcd8-4ea1-81b5-16de43cfda59 service nova] Acquiring lock "c27bf963-def8-4221-82f2-af2165b6f1dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-79a854d7-4b9c-4cc2-8e48-3917adfface2 req-097f1296-dcd8-4ea1-81b5-16de43cfda59 service nova] Lock "c27bf963-def8-4221-82f2-af2165b6f1dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-79a854d7-4b9c-4cc2-8e48-3917adfface2 req-097f1296-dcd8-4ea1-81b5-16de43cfda59 service nova] Lock "c27bf963-def8-4221-82f2-af2165b6f1dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:32 user nova-compute[72504]: DEBUG nova.compute.manager [req-79a854d7-4b9c-4cc2-8e48-3917adfface2 req-097f1296-dcd8-4ea1-81b5-16de43cfda59 service nova] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] No waiting events found dispatching network-vif-plugged-cf70ae69-677f-41a6-8eab-637ebe2d51b7 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:05:32 user nova-compute[72504]: WARNING nova.compute.manager [req-79a854d7-4b9c-4cc2-8e48-3917adfface2 req-097f1296-dcd8-4ea1-81b5-16de43cfda59 service nova] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Received unexpected event network-vif-plugged-cf70ae69-677f-41a6-8eab-637ebe2d51b7 for instance with vm_state building and task_state spawning.
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Acquiring lock "refresh_cache-9d650208-b69b-4106-b598-5d24d8ec489a" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Acquiring lock "ce155874-97ba-4266-86e1-3271c9879430" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "ce155874-97ba-4266-86e1-3271c9879430" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:33 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:05:33 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=7043MB free_disk=24.965362548828125GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:33 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Instance spawned successfully.
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.objects.instance [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lazy-loading 'flavor' on Instance uuid ce155874-97ba-4266-86e1-3271c9879430 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "ce155874-97ba-4266-86e1-3271c9879430" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:33 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920332.7828996, c27bf963-def8-4221-82f2-af2165b6f1dc => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:05:33 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] VM Started (Lifecycle Event)
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.network.neutron [req-d66fe258-cff9-46a9-9758-a75581aaa818 req-8994448f-6b3a-4630-8cf6-9d9e77a7b964 service nova] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:05:33 user nova-compute[72504]: INFO nova.compute.manager [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Took 5.60 seconds to spawn the instance on the hypervisor.
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:33 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 7391a8ce-7ce5-47ec-97f6-6159645688ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 128c2981-363c-4ae9-b46d-15b5e5d9cac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 88f95d20-e391-4100-93b2-da29bfcf9704 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 54812de2-bfe3-46f1-a327-8081fbb80bec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance a53847a9-5dfc-422b-ba06-617dda589042 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance e19bf04b-43e0-4153-a6b5-74dbe36fedb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1ac6e0af-4adb-47a7-988e-971aa5efeb2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance ce155874-97ba-4266-86e1-3271c9879430 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 0163556c-3f0f-4e08-81a1-56f52ae805a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 8b163903-b08f-44b6-a5b5-56dc897d5640 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance c27bf963-def8-4221-82f2-af2165b6f1dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 9d650208-b69b-4106-b598-5d24d8ec489a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:05:33 user nova-compute[72504]: INFO nova.compute.manager [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Took 20.21 seconds to build instance.
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Acquiring lock "ce155874-97ba-4266-86e1-3271c9879430" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "ce155874-97ba-4266-86e1-3271c9879430" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:33 user nova-compute[72504]: INFO nova.compute.manager [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Attaching volume 6d0abe72-23d8-43e3-bcd6-db45008ed6d9 to /dev/vdb
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-24710324-23b4-4658-b1fe-f2879e74f1d8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "c27bf963-def8-4221-82f2-af2165b6f1dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.307s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG os_brick.utils [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[230dddff-e00c-440c-a1a3-0aaabb88bf4a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3fcd3e-35c9-46c2-987d-3b172b8219fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.network.neutron [req-d66fe258-cff9-46a9-9758-a75581aaa818 req-8994448f-6b3a-4630-8cf6-9d9e77a7b964 service nova] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fe92e0-8783-48ad-8bab-6c06fc2df60a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1940360-a865-4570-8018-51878b118257]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d66fe258-cff9-46a9-9758-a75581aaa818 req-8994448f-6b3a-4630-8cf6-9d9e77a7b964 service nova] Releasing lock "refresh_cache-9d650208-b69b-4106-b598-5d24d8ec489a" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Acquired lock "refresh_cache-9d650208-b69b-4106-b598-5d24d8ec489a" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.network.neutron [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:05:33 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b309ca7c-cbec-4bdf-82d3-90f0d2a272ad]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG os_brick.utils [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] <== get_connector_properties: return (184ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Updating existing volume attachment record: f65b8a42-55fe-4c07-a9ac-0e9be9055392 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.network.neutron [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.network.neutron [req-cf4169d7-1b47-41df-a19b-c1174b0f96a6 req-d454bf51-fc53-462b-b906-6791d0e88b1c service nova] [instance: ce155874-97ba-4266-86e1-3271c9879430] Updated VIF entry in instance network info cache for port 506369dd-7925-4369-abe3-640b8268b134. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.network.neutron [req-cf4169d7-1b47-41df-a19b-c1174b0f96a6 req-d454bf51-fc53-462b-b906-6791d0e88b1c service nova] [instance: ce155874-97ba-4266-86e1-3271c9879430] Updating instance_info_cache with network_info: [{"id": "506369dd-7925-4369-abe3-640b8268b134", "address": "fa:16:3e:7f:e7:bd", "network": {"id": "ae078c7d-f61f-443f-b40a-d176d82bd28c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1545473901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775eb768511548d4b67c176de13c0965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap506369dd-79", "ovs_interfaceid": "506369dd-7925-4369-abe3-640b8268b134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cf4169d7-1b47-41df-a19b-c1174b0f96a6 req-d454bf51-fc53-462b-b906-6791d0e88b1c service nova] Releasing lock "refresh_cache-ce155874-97ba-4266-86e1-3271c9879430" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.812s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.network.neutron [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Updating instance_info_cache with network_info: [{"id": "61bdc55c-47b8-4fb2-8743-a2ff4f546dab", "address": "fa:16:3e:d3:ae:54", "network": {"id": "d61a75e5-6ec0-491d-be83-e2ccba438d75", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1390479230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41110ec7bd3e4ba8a6726bfeeef400d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bdc55c-47", "ovs_interfaceid": "61bdc55c-47b8-4fb2-8743-a2ff4f546dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Releasing lock "refresh_cache-9d650208-b69b-4106-b598-5d24d8ec489a" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Instance network_info: |[{"id": "61bdc55c-47b8-4fb2-8743-a2ff4f546dab", "address": "fa:16:3e:d3:ae:54", "network": {"id": "d61a75e5-6ec0-491d-be83-e2ccba438d75", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1390479230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41110ec7bd3e4ba8a6726bfeeef400d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bdc55c-47", "ovs_interfaceid": "61bdc55c-47b8-4fb2-8743-a2ff4f546dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Start _get_guest_xml network_info=[{"id": "61bdc55c-47b8-4fb2-8743-a2ff4f546dab", "address": "fa:16:3e:d3:ae:54", "network": {"id": "d61a75e5-6ec0-491d-be83-e2ccba438d75", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1390479230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41110ec7bd3e4ba8a6726bfeeef400d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bdc55c-47", "ovs_interfaceid": "61bdc55c-47b8-4fb2-8743-a2ff4f546dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:05:33 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:05:33 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:05:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2006529165',display_name='tempest-VolumesActionsTest-instance-2006529165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2006529165',id=34,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41110ec7bd3e4ba8a6726bfeeef400d3',ramdisk_id='',reservation_id='r-i4gelesv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-53423842',owner_user_name='tempest-VolumesActionsTest-53423842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:05:30Z,user_data=None,user_id='7e9aad8402924317bb7c92ed6ccfa87c',uuid=9d650208-b69b-4106-b598-5d24d8ec489a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61bdc55c-47b8-4fb2-8743-a2ff4f546dab", "address": "fa:16:3e:d3:ae:54", "network": {"id": "d61a75e5-6ec0-491d-be83-e2ccba438d75", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1390479230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41110ec7bd3e4ba8a6726bfeeef400d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bdc55c-47", "ovs_interfaceid": "61bdc55c-47b8-4fb2-8743-a2ff4f546dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Converting VIF {"id": "61bdc55c-47b8-4fb2-8743-a2ff4f546dab", "address": "fa:16:3e:d3:ae:54", "network": {"id": "d61a75e5-6ec0-491d-be83-e2ccba438d75", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1390479230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41110ec7bd3e4ba8a6726bfeeef400d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bdc55c-47", "ovs_interfaceid": "61bdc55c-47b8-4fb2-8743-a2ff4f546dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ae:54,bridge_name='br-int',has_traffic_filtering=True,id=61bdc55c-47b8-4fb2-8743-a2ff4f546dab,network=Network(d61a75e5-6ec0-491d-be83-e2ccba438d75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61bdc55c-47') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:05:33 user nova-compute[72504]: DEBUG nova.objects.instance [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d650208-b69b-4106-b598-5d24d8ec489a {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:05:34 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:05:34 user nova-compute[72504]:   <uuid>9d650208-b69b-4106-b598-5d24d8ec489a</uuid>
Aug 01 20:05:34 user nova-compute[72504]:   <name>instance-00000022</name>
Aug 01 20:05:34 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:05:34 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:05:34 user nova-compute[72504]:   <metadata>
Aug 01 20:05:34 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:05:34 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:05:34 user nova-compute[72504]:       <nova:name>tempest-VolumesActionsTest-instance-2006529165</nova:name>
Aug 01 20:05:34 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:05:33</nova:creationTime>
Aug 01 20:05:34 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:05:34 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:05:34 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:05:34 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:05:34 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:05:34 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:05:34 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:05:34 user nova-compute[72504]:       <nova:owner>
Aug 01 20:05:34 user nova-compute[72504]:         <nova:user uuid="7e9aad8402924317bb7c92ed6ccfa87c">tempest-VolumesActionsTest-53423842-project-member</nova:user>
Aug 01 20:05:34 user nova-compute[72504]:         <nova:project uuid="41110ec7bd3e4ba8a6726bfeeef400d3">tempest-VolumesActionsTest-53423842</nova:project>
Aug 01 20:05:34 user nova-compute[72504]:       </nova:owner>
Aug 01 20:05:34 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 20:05:34 user nova-compute[72504]:       <nova:ports>
Aug 01 20:05:34 user nova-compute[72504]:         <nova:port uuid="61bdc55c-47b8-4fb2-8743-a2ff4f546dab">
Aug 01 20:05:34 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 20:05:34 user nova-compute[72504]:         </nova:port>
Aug 01 20:05:34 user nova-compute[72504]:       </nova:ports>
Aug 01 20:05:34 user nova-compute[72504]:     </nova:instance>
Aug 01 20:05:34 user nova-compute[72504]:   </metadata>
Aug 01 20:05:34 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:05:34 user nova-compute[72504]:     <system>
Aug 01 20:05:34 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:05:34 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:05:34 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:05:34 user nova-compute[72504]:       <entry name="serial">9d650208-b69b-4106-b598-5d24d8ec489a</entry>
Aug 01 20:05:34 user nova-compute[72504]:       <entry name="uuid">9d650208-b69b-4106-b598-5d24d8ec489a</entry>
Aug 01 20:05:34 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:05:34 user nova-compute[72504]:     </system>
Aug 01 20:05:34 user nova-compute[72504]:   </sysinfo>
Aug 01 20:05:34 user nova-compute[72504]:   <os>
Aug 01 20:05:34 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:05:34 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:05:34 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:05:34 user nova-compute[72504]:   </os>
Aug 01 20:05:34 user nova-compute[72504]:   <features>
Aug 01 20:05:34 user nova-compute[72504]:     <acpi/>
Aug 01 20:05:34 user nova-compute[72504]:     <apic/>
Aug 01 20:05:34 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:05:34 user nova-compute[72504]:   </features>
Aug 01 20:05:34 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:05:34 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:05:34 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:05:34 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:05:34 user nova-compute[72504]:   </clock>
Aug 01 20:05:34 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:05:34 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:05:34 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:05:34 user nova-compute[72504]:   </cpu>
Aug 01 20:05:34 user nova-compute[72504]:   <devices>
Aug 01 20:05:34 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 20:05:34 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 20:05:34 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/9d650208-b69b-4106-b598-5d24d8ec489a/disk"/>
Aug 01 20:05:34 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:05:34 user nova-compute[72504]:     </disk>
Aug 01 20:05:34 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:05:34 user nova-compute[72504]:       <mac address="fa:16:3e:d3:ae:54"/>
Aug 01 20:05:34 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:05:34 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:05:34 user nova-compute[72504]:       <target dev="tap61bdc55c-47"/>
Aug 01 20:05:34 user nova-compute[72504]:     </interface>
Aug 01 20:05:34 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:05:34 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/9d650208-b69b-4106-b598-5d24d8ec489a/console.log" append="off"/>
Aug 01 20:05:34 user nova-compute[72504]:     </serial>
Aug 01 20:05:34 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:05:34 user nova-compute[72504]:     <video>
Aug 01 20:05:34 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:05:34 user nova-compute[72504]:     </video>
Aug 01 20:05:34 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:05:34 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:05:34 user nova-compute[72504]:     </rng>
Aug 01 20:05:34 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:05:34 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:05:34 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:05:34 user nova-compute[72504]:     </memballoon>
Aug 01 20:05:34 user nova-compute[72504]:   </devices>
Aug 01 20:05:34 user nova-compute[72504]: </domain>
Aug 01 20:05:34 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:05:34 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:05:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2006529165',display_name='tempest-VolumesActionsTest-instance-2006529165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2006529165',id=34,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41110ec7bd3e4ba8a6726bfeeef400d3',ramdisk_id='',reservation_id='r-i4gelesv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-53423842',owner_user_name='tempest-VolumesActionsTest-53423842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:05:30Z,user_data=None,user_id='7e9aad8402924317bb7c92ed6ccfa87c',uuid=9d650208-b69b-4106-b598-5d24d8ec489a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61bdc55c-47b8-4fb2-8743-a2ff4f546dab", "address": "fa:16:3e:d3:ae:54", "network": {"id": "d61a75e5-6ec0-491d-be83-e2ccba438d75", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1390479230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41110ec7bd3e4ba8a6726bfeeef400d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bdc55c-47", "ovs_interfaceid": "61bdc55c-47b8-4fb2-8743-a2ff4f546dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:05:34 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Converting VIF {"id": "61bdc55c-47b8-4fb2-8743-a2ff4f546dab", "address": "fa:16:3e:d3:ae:54", "network": {"id": "d61a75e5-6ec0-491d-be83-e2ccba438d75", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1390479230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41110ec7bd3e4ba8a6726bfeeef400d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bdc55c-47", "ovs_interfaceid": "61bdc55c-47b8-4fb2-8743-a2ff4f546dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:05:34 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ae:54,bridge_name='br-int',has_traffic_filtering=True,id=61bdc55c-47b8-4fb2-8743-a2ff4f546dab,network=Network(d61a75e5-6ec0-491d-be83-e2ccba438d75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61bdc55c-47') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:05:34 user nova-compute[72504]: DEBUG os_vif [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ae:54,bridge_name='br-int',has_traffic_filtering=True,id=61bdc55c-47b8-4fb2-8743-a2ff4f546dab,network=Network(d61a75e5-6ec0-491d-be83-e2ccba438d75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61bdc55c-47') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:05:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:05:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:05:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61bdc55c-47, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:05:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap61bdc55c-47, col_values=(('external_ids', {'iface-id': '61bdc55c-47b8-4fb2-8743-a2ff4f546dab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:ae:54', 'vm-uuid': '9d650208-b69b-4106-b598-5d24d8ec489a'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:05:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:05:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:34 user nova-compute[72504]: INFO os_vif [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ae:54,bridge_name='br-int',has_traffic_filtering=True,id=61bdc55c-47b8-4fb2-8743-a2ff4f546dab,network=Network(d61a75e5-6ec0-491d-be83-e2ccba438d75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61bdc55c-47')
Aug 01 20:05:34 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:05:34 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] No VIF found with MAC fa:16:3e:d3:ae:54, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:05:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:35 user nova-compute[72504]: DEBUG nova.compute.manager [req-4c4927dc-f8fa-426a-8189-dd6fcdc10832 req-20fbacd6-74e2-4134-8951-eabc26143836 service nova] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Received event network-vif-plugged-61bdc55c-47b8-4fb2-8743-a2ff4f546dab {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:05:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4c4927dc-f8fa-426a-8189-dd6fcdc10832 req-20fbacd6-74e2-4134-8951-eabc26143836 service nova] Acquiring lock "9d650208-b69b-4106-b598-5d24d8ec489a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4c4927dc-f8fa-426a-8189-dd6fcdc10832 req-20fbacd6-74e2-4134-8951-eabc26143836 service nova] Lock "9d650208-b69b-4106-b598-5d24d8ec489a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4c4927dc-f8fa-426a-8189-dd6fcdc10832 req-20fbacd6-74e2-4134-8951-eabc26143836 service nova] Lock "9d650208-b69b-4106-b598-5d24d8ec489a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:35 user nova-compute[72504]: DEBUG nova.compute.manager [req-4c4927dc-f8fa-426a-8189-dd6fcdc10832 req-20fbacd6-74e2-4134-8951-eabc26143836 service nova] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] No waiting events found dispatching network-vif-plugged-61bdc55c-47b8-4fb2-8743-a2ff4f546dab {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:05:35 user nova-compute[72504]: WARNING nova.compute.manager [req-4c4927dc-f8fa-426a-8189-dd6fcdc10832 req-20fbacd6-74e2-4134-8951-eabc26143836 service nova] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Received unexpected event network-vif-plugged-61bdc55c-47b8-4fb2-8743-a2ff4f546dab for instance with vm_state building and task_state spawning.
Aug 01 20:05:35 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:05:35 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:05:35 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-128c2981-363c-4ae9-b46d-15b5e5d9cac6" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-128c2981-363c-4ae9-b46d-15b5e5d9cac6" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG nova.objects.instance [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lazy-loading 'flavor' on Instance uuid 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:36 user nova-compute[72504]: INFO nova.compute.manager [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Attaching volume 1fb9a2da-5574-4cbd-96ee-1a05541969b6 to /dev/vdb
Aug 01 20:05:36 user nova-compute[72504]: DEBUG os_brick.utils [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1fc532-f562-4954-b17a-70238516a77a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[999bad69-44ca-4a02-9e18-2dfb84e3e2cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[767fd748-187e-4d69-aecb-d7c70b9c7221]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[802cc8c7-4deb-4797-97a8-7a0b0085d9f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:05:36 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:05:36 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[31616752-2611-41ff-84a7-a3b7dfe883fb]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG os_brick.utils [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Updating existing volume attachment record: 99131948-3fa0-4f1f-ab00-8e165bb62168 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Updating instance_info_cache with network_info: [{"id": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "address": "fa:16:3e:c0:3a:dc", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88a4a208-71", "ovs_interfaceid": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-128c2981-363c-4ae9-b46d-15b5e5d9cac6" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:05:36 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:05:37 user nova-compute[72504]: DEBUG nova.compute.manager [req-69626124-e5a1-4f60-8990-8e78f8ad2655 req-72a6aade-f3ff-460d-8caa-20f79e8e5e80 service nova] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Received event network-vif-plugged-61bdc55c-47b8-4fb2-8743-a2ff4f546dab {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:05:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-69626124-e5a1-4f60-8990-8e78f8ad2655 req-72a6aade-f3ff-460d-8caa-20f79e8e5e80 service nova] Acquiring lock "9d650208-b69b-4106-b598-5d24d8ec489a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-69626124-e5a1-4f60-8990-8e78f8ad2655 req-72a6aade-f3ff-460d-8caa-20f79e8e5e80 service nova] Lock "9d650208-b69b-4106-b598-5d24d8ec489a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-69626124-e5a1-4f60-8990-8e78f8ad2655 req-72a6aade-f3ff-460d-8caa-20f79e8e5e80 service nova] Lock "9d650208-b69b-4106-b598-5d24d8ec489a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:37 user nova-compute[72504]: DEBUG nova.compute.manager [req-69626124-e5a1-4f60-8990-8e78f8ad2655 req-72a6aade-f3ff-460d-8caa-20f79e8e5e80 service nova] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] No waiting events found dispatching network-vif-plugged-61bdc55c-47b8-4fb2-8743-a2ff4f546dab {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:05:37 user nova-compute[72504]: WARNING nova.compute.manager [req-69626124-e5a1-4f60-8990-8e78f8ad2655 req-72a6aade-f3ff-460d-8caa-20f79e8e5e80 service nova] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Received unexpected event network-vif-plugged-61bdc55c-47b8-4fb2-8743-a2ff4f546dab for instance with vm_state building and task_state spawning.
Aug 01 20:05:38 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920338.0069416, 9d650208-b69b-4106-b598-5d24d8ec489a => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:05:38 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] VM Resumed (Lifecycle Event)
Aug 01 20:05:38 user nova-compute[72504]: DEBUG nova.compute.manager [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:05:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:05:38 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Instance spawned successfully.
Aug 01 20:05:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 20:05:38 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:05:38 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:05:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:05:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:05:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:05:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:05:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:05:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:05:38 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:05:38 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920338.008755, 9d650208-b69b-4106-b598-5d24d8ec489a => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:05:38 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] VM Started (Lifecycle Event)
Aug 01 20:05:38 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:05:38 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:05:38 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:05:38 user nova-compute[72504]: INFO nova.compute.manager [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Took 7.86 seconds to spawn the instance on the hypervisor.
Aug 01 20:05:38 user nova-compute[72504]: DEBUG nova.compute.manager [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:05:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:38 user nova-compute[72504]: INFO nova.compute.manager [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Took 9.09 seconds to build instance.
Aug 01 20:05:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d9c6b98f-f369-4cae-9bb7-1f33424eea5f tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "9d650208-b69b-4106-b598-5d24d8ec489a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.210s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADWHJNrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:05:43 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:05:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:05:43 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:05:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:05:43 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d667349-c7c8-400a-b512-c2677955c526]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:05:43 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[49619d74-39ec-4a8a-8d12-d47677fbc16a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9] added
Aug 01 20:05:43 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[461de988-cac8-48a1-8dd4-0ddfcfb4d6ab]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea021f3c-c3ad-4ea7-b790-98cc2242c762]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ADWHJNrY {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ADWHJNrY" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df4dedc-47c6-4eff-a082-53dc6e17c723]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ADWHJNrY'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d39b8e-1202-4e7c-9edc-0f2540b422da]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac12e020-6da6-4d6a-801c-6aed5da32726]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:05:43 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:05:43 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:05:43 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:05:43 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:05:43 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:05:43 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:05:43 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:05:43 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:05:43 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:05:43 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb12c4c-c788-421b-aeac-3337510df9b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9, portal: 172.16.0.220,3260]
Aug 01 20:05:43 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9, portal: 172.16.0.220,3260] successful.
Aug 01 20:05:43 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c1ea5b-131a-495e-8601-f2a90c56d28e]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b979e942-936e-453a-8d04-856b27ea23ee]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:05:43 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:05:43 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:05:43 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:05:43 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:05:43 user nova-compute[72504]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)
Aug 01 20:05:43 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:05:43 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:05:43 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:05:43 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:05:43 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:05:43 user nova-compute[72504]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)
Aug 01 20:05:43 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] HCTL ('38', '-', '-', 0) found on session 38 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87f8896-839e-46ec-8497-1458b2028c2f]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Searching for a device in session 38 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:05:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADWHJNrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:05:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:05:44 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '23038383564356565', 'path': '/dev/sdg'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:05:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038383564356565', 'path': '/dev/sdg'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:05:44 user nova-compute[72504]: DEBUG nova.objects.instance [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lazy-loading 'flavor' on Instance uuid ce155874-97ba-4266-86e1-3271c9879430 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:05:44 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 20:05:44 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:05:44 user nova-compute[72504]:   <source dev="/dev/sdg"/>
Aug 01 20:05:44 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:05:44 user nova-compute[72504]:   <serial>6d0abe72-23d8-43e3-bcd6-db45008ed6d9</serial>
Aug 01 20:05:44 user nova-compute[72504]: </disk>
Aug 01 20:05:44 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] No VIF found with MAC fa:16:3e:7f:e7:bd, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5cc73c54-3c5e-4593-ae9b-b306938704ed tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "ce155874-97ba-4266-86e1-3271c9879430" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.973s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJcLDQCn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:05:45 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:05:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:05:45 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:05:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:05:45 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec749a17-e44f-4bbb-a95f-c0abac000898]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:05:45 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0760871b-244c-4244-b6da-a7bc607febf0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6] added
Aug 01 20:05:45 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[28036800-dfd9-4d41-a5e8-a7a27058fdbe]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.091s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c392387d-f3e8-4d0a-9c15-ecdc63ac5e7f]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tJcLDQCn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tJcLDQCn" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a036e8c8-a253-47d5-9511-88c009c4342a]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tJcLDQCn'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[07362a84-a055-4eda-8869-99efe013cf6e]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0014034-a9fa-40ed-a1eb-60b90d2c02a1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:05:45 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:05:45 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:05:45 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:05:45 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:05:45 user nova-compute[72504]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)
Aug 01 20:05:45 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:05:45 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:05:45 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:05:45 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:05:45 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:05:45 user nova-compute[72504]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)
Aug 01 20:05:45 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ffa636-6fad-4c7f-a931-49085ff2d910]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6, portal: 172.16.0.220,3260]
Aug 01 20:05:45 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6, portal: 172.16.0.220,3260] successful.
Aug 01 20:05:45 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb241706-2f22-4363-aa88-1413b5c58426]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9bdaf9-552d-4ca4-aa39-ef6ddcf0c541]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:05:45 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:05:45 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:05:45 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:05:45 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:05:45 user nova-compute[72504]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)
Aug 01 20:05:45 user nova-compute[72504]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6 (non-flash)
Aug 01 20:05:45 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:05:45 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:05:45 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:05:45 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:05:45 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:05:45 user nova-compute[72504]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)
Aug 01 20:05:45 user nova-compute[72504]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6 (non-flash)
Aug 01 20:05:45 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.440s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] HCTL ('39', '-', '-', 0) found on session 39 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae78977-4bf0-4c30-8719-479137192686]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Searching for a device in session 39 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJcLDQCn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b698d253-df43-413a-aed7-3b5f7b61f96c tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Acquiring lock "0163556c-3f0f-4e08-81a1-56f52ae805a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b698d253-df43-413a-aed7-3b5f7b61f96c tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "0163556c-3f0f-4e08-81a1-56f52ae805a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b698d253-df43-413a-aed7-3b5f7b61f96c tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Acquiring lock "0163556c-3f0f-4e08-81a1-56f52ae805a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b698d253-df43-413a-aed7-3b5f7b61f96c tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "0163556c-3f0f-4e08-81a1-56f52ae805a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b698d253-df43-413a-aed7-3b5f7b61f96c tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "0163556c-3f0f-4e08-81a1-56f52ae805a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:45 user nova-compute[72504]: INFO nova.compute.manager [None req-b698d253-df43-413a-aed7-3b5f7b61f96c tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Terminating instance
Aug 01 20:05:45 user nova-compute[72504]: DEBUG nova.compute.manager [None req-b698d253-df43-413a-aed7-3b5f7b61f96c tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72504) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:46 user nova-compute[72504]: DEBUG nova.compute.manager [req-53d2699a-28b0-46e4-b252-a4f8f3b4fd53 req-8e06382b-88c6-4016-96fb-67f219594ebe service nova] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Received event network-vif-unplugged-b21aa368-3683-40c2-b7a8-a604a31a5769 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:05:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-53d2699a-28b0-46e4-b252-a4f8f3b4fd53 req-8e06382b-88c6-4016-96fb-67f219594ebe service nova] Acquiring lock "0163556c-3f0f-4e08-81a1-56f52ae805a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-53d2699a-28b0-46e4-b252-a4f8f3b4fd53 req-8e06382b-88c6-4016-96fb-67f219594ebe service nova] Lock "0163556c-3f0f-4e08-81a1-56f52ae805a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-53d2699a-28b0-46e4-b252-a4f8f3b4fd53 req-8e06382b-88c6-4016-96fb-67f219594ebe service nova] Lock "0163556c-3f0f-4e08-81a1-56f52ae805a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:46 user nova-compute[72504]: DEBUG nova.compute.manager [req-53d2699a-28b0-46e4-b252-a4f8f3b4fd53 req-8e06382b-88c6-4016-96fb-67f219594ebe service nova] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] No waiting events found dispatching network-vif-unplugged-b21aa368-3683-40c2-b7a8-a604a31a5769 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:05:46 user nova-compute[72504]: DEBUG nova.compute.manager [req-53d2699a-28b0-46e4-b252-a4f8f3b4fd53 req-8e06382b-88c6-4016-96fb-67f219594ebe service nova] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Received event network-vif-unplugged-b21aa368-3683-40c2-b7a8-a604a31a5769 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:05:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:46 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Instance destroyed successfully.
Aug 01 20:05:46 user nova-compute[72504]: DEBUG nova.objects.instance [None req-b698d253-df43-413a-aed7-3b5f7b61f96c tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lazy-loading 'resources' on Instance uuid 0163556c-3f0f-4e08-81a1-56f52ae805a8 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:05:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-b698d253-df43-413a-aed7-3b5f7b61f96c tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:03:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-23082982',display_name='tempest-ServersNegativeTestJSON-server-23082982',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-23082982',id=31,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:04:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea0f5bb5775e4071ab28bea2d9dd2512',ramdisk_id='',reservation_id='r-g09ytv5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-865865258',owner_user_name='tempest-ServersNegativeTestJSON-865865258-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:04:04Z,user_data=None,user_id='a04ab5f67aaa4969b3df48d274a86d5e',uuid=0163556c-3f0f-4e08-81a1-56f52ae805a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b21aa368-3683-40c2-b7a8-a604a31a5769", "address": "fa:16:3e:17:52:a8", "network": {"id": "b8489ede-9e34-4dfa-b6d7-d0948a7bad05", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1846924261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea0f5bb5775e4071ab28bea2d9dd2512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21aa368-36", "ovs_interfaceid": "b21aa368-3683-40c2-b7a8-a604a31a5769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:05:46 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-b698d253-df43-413a-aed7-3b5f7b61f96c tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Converting VIF {"id": "b21aa368-3683-40c2-b7a8-a604a31a5769", "address": "fa:16:3e:17:52:a8", "network": {"id": "b8489ede-9e34-4dfa-b6d7-d0948a7bad05", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1846924261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea0f5bb5775e4071ab28bea2d9dd2512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb21aa368-36", "ovs_interfaceid": "b21aa368-3683-40c2-b7a8-a604a31a5769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:05:46 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-b698d253-df43-413a-aed7-3b5f7b61f96c tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:52:a8,bridge_name='br-int',has_traffic_filtering=True,id=b21aa368-3683-40c2-b7a8-a604a31a5769,network=Network(b8489ede-9e34-4dfa-b6d7-d0948a7bad05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb21aa368-36') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:05:46 user nova-compute[72504]: DEBUG os_vif [None req-b698d253-df43-413a-aed7-3b5f7b61f96c tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:52:a8,bridge_name='br-int',has_traffic_filtering=True,id=b21aa368-3683-40c2-b7a8-a604a31a5769,network=Network(b8489ede-9e34-4dfa-b6d7-d0948a7bad05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb21aa368-36') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:05:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb21aa368-36, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:05:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:05:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:46 user nova-compute[72504]: INFO os_vif [None req-b698d253-df43-413a-aed7-3b5f7b61f96c tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:52:a8,bridge_name='br-int',has_traffic_filtering=True,id=b21aa368-3683-40c2-b7a8-a604a31a5769,network=Network(b8489ede-9e34-4dfa-b6d7-d0948a7bad05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb21aa368-36')
Aug 01 20:05:46 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-b698d253-df43-413a-aed7-3b5f7b61f96c tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Deleting instance files /opt/stack/data/nova/instances/0163556c-3f0f-4e08-81a1-56f52ae805a8_del
Aug 01 20:05:46 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-b698d253-df43-413a-aed7-3b5f7b61f96c tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Deletion of /opt/stack/data/nova/instances/0163556c-3f0f-4e08-81a1-56f52ae805a8_del complete
Aug 01 20:05:46 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.487s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:05:46 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] <== connect_volume: return (1488ms) {'type': 'block', 'scsi_wwn': '23963633332646262', 'path': '/dev/sdh'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:05:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963633332646262', 'path': '/dev/sdh'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:05:46 user nova-compute[72504]: INFO nova.compute.manager [None req-b698d253-df43-413a-aed7-3b5f7b61f96c tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 01 20:05:46 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-b698d253-df43-413a-aed7-3b5f7b61f96c tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:05:46 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:05:46 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:05:46 user nova-compute[72504]: DEBUG nova.objects.instance [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lazy-loading 'flavor' on Instance uuid 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:05:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 20:05:46 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:05:46 user nova-compute[72504]:   <source dev="/dev/sdh"/>
Aug 01 20:05:46 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:05:46 user nova-compute[72504]:   <serial>1fb9a2da-5574-4cbd-96ee-1a05541969b6</serial>
Aug 01 20:05:46 user nova-compute[72504]: </disk>
Aug 01 20:05:46 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 20:05:47 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:05:47 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:05:47 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] No VIF found with MAC fa:16:3e:45:db:12, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:05:47 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:05:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cd38d39f-0acf-4080-a2d7-2ba830f688b0 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.022s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:47 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Took 0.70 seconds to deallocate network for instance.
Aug 01 20:05:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b698d253-df43-413a-aed7-3b5f7b61f96c tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b698d253-df43-413a-aed7-3b5f7b61f96c tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:47 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-b698d253-df43-413a-aed7-3b5f7b61f96c tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:05:47 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-b698d253-df43-413a-aed7-3b5f7b61f96c tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:05:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b698d253-df43-413a-aed7-3b5f7b61f96c tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:48 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-b698d253-df43-413a-aed7-3b5f7b61f96c tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Deleted allocations for instance 0163556c-3f0f-4e08-81a1-56f52ae805a8
Aug 01 20:05:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b698d253-df43-413a-aed7-3b5f7b61f96c tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "0163556c-3f0f-4e08-81a1-56f52ae805a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.297s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:48 user nova-compute[72504]: DEBUG nova.compute.manager [req-fdb1cd53-1769-4fcf-8ae0-aca56536a460 req-55701e58-ca65-43bd-8023-b80b3023b03d service nova] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Received event network-vif-plugged-b21aa368-3683-40c2-b7a8-a604a31a5769 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:05:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-fdb1cd53-1769-4fcf-8ae0-aca56536a460 req-55701e58-ca65-43bd-8023-b80b3023b03d service nova] Acquiring lock "0163556c-3f0f-4e08-81a1-56f52ae805a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-fdb1cd53-1769-4fcf-8ae0-aca56536a460 req-55701e58-ca65-43bd-8023-b80b3023b03d service nova] Lock "0163556c-3f0f-4e08-81a1-56f52ae805a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-fdb1cd53-1769-4fcf-8ae0-aca56536a460 req-55701e58-ca65-43bd-8023-b80b3023b03d service nova] Lock "0163556c-3f0f-4e08-81a1-56f52ae805a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:48 user nova-compute[72504]: DEBUG nova.compute.manager [req-fdb1cd53-1769-4fcf-8ae0-aca56536a460 req-55701e58-ca65-43bd-8023-b80b3023b03d service nova] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] No waiting events found dispatching network-vif-plugged-b21aa368-3683-40c2-b7a8-a604a31a5769 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:05:48 user nova-compute[72504]: WARNING nova.compute.manager [req-fdb1cd53-1769-4fcf-8ae0-aca56536a460 req-55701e58-ca65-43bd-8023-b80b3023b03d service nova] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Received unexpected event network-vif-plugged-b21aa368-3683-40c2-b7a8-a604a31a5769 for instance with vm_state deleted and task_state None.
Aug 01 20:05:48 user nova-compute[72504]: DEBUG nova.compute.manager [req-fdb1cd53-1769-4fcf-8ae0-aca56536a460 req-55701e58-ca65-43bd-8023-b80b3023b03d service nova] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Received event network-vif-deleted-b21aa368-3683-40c2-b7a8-a604a31a5769 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:05:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Acquiring lock "ce155874-97ba-4266-86e1-3271c9879430" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "ce155874-97ba-4266-86e1-3271c9879430" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:49 user nova-compute[72504]: DEBUG nova.objects.instance [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lazy-loading 'flavor' on Instance uuid ce155874-97ba-4266-86e1-3271c9879430 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:05:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "ce155874-97ba-4266-86e1-3271c9879430" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Acquiring lock "ce155874-97ba-4266-86e1-3271c9879430" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "ce155874-97ba-4266-86e1-3271c9879430" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:49 user nova-compute[72504]: INFO nova.compute.manager [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Attaching volume a5cdf466-523b-489f-abb3-bf1944a26bb5 to /dev/vdc
Aug 01 20:05:49 user nova-compute[72504]: DEBUG os_brick.utils [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:05:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:49 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce55446e-7d3f-44b1-bb03-12f8122b0ea3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:49 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb637d5-bd4c-44a3-aaaf-5cf35e052f30]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:49 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ec6db2-7c89-4e22-b4bb-cac82d994827]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:49 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc3944f-a05a-460d-a36a-f373f8fe6a20]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:05:49 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:05:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:05:49 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:05:49 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c1d655-0bd3-4ec9-9be5-c2e55628028c]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:49 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:05:49 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:05:49 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:05:49 user nova-compute[72504]: DEBUG os_brick.utils [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:05:49 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Updating existing volume attachment record: f252d2e2-6a20-41bf-834a-72e06a9048f2 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:05:50 user nova-compute[72504]: INFO nova.compute.manager [None req-b6b320cc-ba5f-44c3-bb12-a20b31bfa516 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Unrescuing
Aug 01 20:05:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b6b320cc-ba5f-44c3-bb12-a20b31bfa516 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "refresh_cache-e19bf04b-43e0-4153-a6b5-74dbe36fedb0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:05:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b6b320cc-ba5f-44c3-bb12-a20b31bfa516 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquired lock "refresh_cache-e19bf04b-43e0-4153-a6b5-74dbe36fedb0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:05:50 user nova-compute[72504]: DEBUG nova.network.neutron [None req-b6b320cc-ba5f-44c3-bb12-a20b31bfa516 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:05:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:50 user nova-compute[72504]: INFO nova.compute.manager [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Detaching volume 1fb9a2da-5574-4cbd-96ee-1a05541969b6
Aug 01 20:05:50 user nova-compute[72504]: INFO nova.virt.block_device [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Attempting to driver detach volume 1fb9a2da-5574-4cbd-96ee-1a05541969b6 from mountpoint /dev/vdb
Aug 01 20:05:50 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Attempting to detach device vdb from instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 20:05:50 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:05:50 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:05:50 user nova-compute[72504]:   <source dev="/dev/sdh"/>
Aug 01 20:05:50 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:05:50 user nova-compute[72504]:   <serial>1fb9a2da-5574-4cbd-96ee-1a05541969b6</serial>
Aug 01 20:05:50 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:05:50 user nova-compute[72504]: </disk>
Aug 01 20:05:50 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:05:50 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Successfully detached device vdb from instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 from the persistent domain config.
Aug 01 20:05:50 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 20:05:50 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:05:50 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:05:50 user nova-compute[72504]:   <source dev="/dev/sdh"/>
Aug 01 20:05:50 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:05:50 user nova-compute[72504]:   <serial>1fb9a2da-5574-4cbd-96ee-1a05541969b6</serial>
Aug 01 20:05:50 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:05:50 user nova-compute[72504]: </disk>
Aug 01 20:05:50 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:05:50 user nova-compute[72504]: DEBUG nova.network.neutron [None req-b6b320cc-ba5f-44c3-bb12-a20b31bfa516 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Updating instance_info_cache with network_info: [{"id": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "address": "fa:16:3e:c2:53:7c", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d66fd17-3c", "ovs_interfaceid": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:05:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b6b320cc-ba5f-44c3-bb12-a20b31bfa516 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Releasing lock "refresh_cache-e19bf04b-43e0-4153-a6b5-74dbe36fedb0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:05:50 user nova-compute[72504]: DEBUG nova.objects.instance [None req-b6b320cc-ba5f-44c3-bb12-a20b31bfa516 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'flavor' on Instance uuid e19bf04b-43e0-4153-a6b5-74dbe36fedb0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:05:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:50 user nova-compute[72504]: DEBUG nova.compute.manager [req-a9a5f767-31df-4758-9842-2ced4465966d req-a243af9a-2006-4afd-833a-d077e9f5bbe7 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received event network-vif-unplugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:05:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a9a5f767-31df-4758-9842-2ced4465966d req-a243af9a-2006-4afd-833a-d077e9f5bbe7 service nova] Acquiring lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a9a5f767-31df-4758-9842-2ced4465966d req-a243af9a-2006-4afd-833a-d077e9f5bbe7 service nova] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a9a5f767-31df-4758-9842-2ced4465966d req-a243af9a-2006-4afd-833a-d077e9f5bbe7 service nova] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:50 user nova-compute[72504]: DEBUG nova.compute.manager [req-a9a5f767-31df-4758-9842-2ced4465966d req-a243af9a-2006-4afd-833a-d077e9f5bbe7 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] No waiting events found dispatching network-vif-unplugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:05:50 user nova-compute[72504]: WARNING nova.compute.manager [req-a9a5f767-31df-4758-9842-2ced4465966d req-a243af9a-2006-4afd-833a-d077e9f5bbe7 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received unexpected event network-vif-unplugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc for instance with vm_state rescued and task_state unrescuing.
Aug 01 20:05:51 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690920350.9994102, 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 20:05:51 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Successfully detached device vdb from instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 from the live domain config.
Aug 01 20:05:51 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJcLDQCn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:05:51 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:05:51 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[096194f3-deee-4bf7-93e7-1e9c9329d16f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34700d0-2466-4995-a638-907bb26483e9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:05:51 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:05:51 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:05:51 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:05:51 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:05:51 user nova-compute[72504]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)
Aug 01 20:05:51 user nova-compute[72504]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6 (non-flash)
Aug 01 20:05:51 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:05:51 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:05:51 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:05:51 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:05:51 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:05:51 user nova-compute[72504]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)
Aug 01 20:05:51 user nova-compute[72504]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6 (non-flash)
Aug 01 20:05:51 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff40c196e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6'): ({'sdh'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Removing single pathed devices sdh {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f108f97f-db5c-40ed-829d-2774d9bd8871]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae9d8c3-b40f-4182-8696-1e8997e48b25]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Flushing IO for device /dev/sdh {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[922872d8-56e7-449e-ad3c-47e084c2e0f9]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.039s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88bec92-e4b6-4844-b3f9-43fa219bb253]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] SCSI volumes sdh have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8018bf-72cc-48db-a907-24fd39d63eb7]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fb177e-22f4-4d8d-ad48-31f93eeb65ec]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6, portal: 172.16.0.220,3260]
Aug 01 20:05:51 user nova-compute[72504]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6, portal: 172.16.0.220,3260] successful.
Aug 01 20:05:51 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb9a2da-5574-4cbd-96ee-1a05541969b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48d1e8d-79d9-4d23-b15b-d92a7b9f6b40]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] <== disconnect_volume: return (337ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:05:51 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:05:51 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Instance destroyed successfully.
Aug 01 20:05:51 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:52 user nova-compute[72504]: DEBUG nova.objects.instance [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lazy-loading 'flavor' on Instance uuid 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:05:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8a7f4f5b-76c0-4497-baf2-6fe23b403e37 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.922s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:53 user nova-compute[72504]: DEBUG nova.compute.manager [req-e254bd0f-3148-45e0-b15c-2018421a5366 req-42966098-e313-449f-9bac-c3f98d8114f1 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received event network-vif-plugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:05:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e254bd0f-3148-45e0-b15c-2018421a5366 req-42966098-e313-449f-9bac-c3f98d8114f1 service nova] Acquiring lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e254bd0f-3148-45e0-b15c-2018421a5366 req-42966098-e313-449f-9bac-c3f98d8114f1 service nova] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e254bd0f-3148-45e0-b15c-2018421a5366 req-42966098-e313-449f-9bac-c3f98d8114f1 service nova] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:53 user nova-compute[72504]: DEBUG nova.compute.manager [req-e254bd0f-3148-45e0-b15c-2018421a5366 req-42966098-e313-449f-9bac-c3f98d8114f1 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] No waiting events found dispatching network-vif-plugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:05:53 user nova-compute[72504]: WARNING nova.compute.manager [req-e254bd0f-3148-45e0-b15c-2018421a5366 req-42966098-e313-449f-9bac-c3f98d8114f1 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received unexpected event network-vif-plugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc for instance with vm_state rescued and task_state unrescuing.
Aug 01 20:05:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-819562f0-770f-4447-bc38-874a0a94a6b0 req-c7d12605-5b5e-4d80-8fb9-b4a96834720c service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received event network-vif-plugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:05:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-819562f0-770f-4447-bc38-874a0a94a6b0 req-c7d12605-5b5e-4d80-8fb9-b4a96834720c service nova] Acquiring lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-819562f0-770f-4447-bc38-874a0a94a6b0 req-c7d12605-5b5e-4d80-8fb9-b4a96834720c service nova] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-819562f0-770f-4447-bc38-874a0a94a6b0 req-c7d12605-5b5e-4d80-8fb9-b4a96834720c service nova] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-819562f0-770f-4447-bc38-874a0a94a6b0 req-c7d12605-5b5e-4d80-8fb9-b4a96834720c service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] No waiting events found dispatching network-vif-plugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:05:55 user nova-compute[72504]: WARNING nova.compute.manager [req-819562f0-770f-4447-bc38-874a0a94a6b0 req-c7d12605-5b5e-4d80-8fb9-b4a96834720c service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received unexpected event network-vif-plugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc for instance with vm_state rescued and task_state unrescuing.
Aug 01 20:05:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-819562f0-770f-4447-bc38-874a0a94a6b0 req-c7d12605-5b5e-4d80-8fb9-b4a96834720c service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received event network-vif-plugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:05:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-819562f0-770f-4447-bc38-874a0a94a6b0 req-c7d12605-5b5e-4d80-8fb9-b4a96834720c service nova] Acquiring lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-819562f0-770f-4447-bc38-874a0a94a6b0 req-c7d12605-5b5e-4d80-8fb9-b4a96834720c service nova] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-819562f0-770f-4447-bc38-874a0a94a6b0 req-c7d12605-5b5e-4d80-8fb9-b4a96834720c service nova] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:05:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-819562f0-770f-4447-bc38-874a0a94a6b0 req-c7d12605-5b5e-4d80-8fb9-b4a96834720c service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] No waiting events found dispatching network-vif-plugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:05:55 user nova-compute[72504]: WARNING nova.compute.manager [req-819562f0-770f-4447-bc38-874a0a94a6b0 req-c7d12605-5b5e-4d80-8fb9-b4a96834720c service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received unexpected event network-vif-plugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc for instance with vm_state rescued and task_state unrescuing.
Aug 01 20:05:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Removed pending event for e19bf04b-43e0-4153-a6b5-74dbe36fedb0 due to event {{(pid=72504) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 20:05:55 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920355.0805395, e19bf04b-43e0-4153-a6b5-74dbe36fedb0 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:05:55 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] VM Resumed (Lifecycle Event)
Aug 01 20:05:55 user nova-compute[72504]: DEBUG nova.compute.manager [None req-b6b320cc-ba5f-44c3-bb12-a20b31bfa516 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:05:55 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:05:55 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:05:55 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 20:05:55 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920355.0818815, e19bf04b-43e0-4153-a6b5-74dbe36fedb0 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:05:55 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] VM Started (Lifecycle Event)
Aug 01 20:05:55 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:05:55 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:05:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:05:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZwMKWut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:05:57 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:05:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:05:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:05:57 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:05:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:05:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:05:57 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:05:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:57 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1033e0db-2ae3-4a13-b044-b5899836e260]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:05:57 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-13be958e-5b95-4e5b-a8b7-a5568baa62f3 req-2ba63b16-8f0d-4f2f-a5de-b491c5881496 service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Received event network-changed-3a4ace30-3ca6-4cc9-8125-599cc4097662 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:05:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-13be958e-5b95-4e5b-a8b7-a5568baa62f3 req-2ba63b16-8f0d-4f2f-a5de-b491c5881496 service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Refreshing instance network info cache due to event network-changed-3a4ace30-3ca6-4cc9-8125-599cc4097662. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:05:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-13be958e-5b95-4e5b-a8b7-a5568baa62f3 req-2ba63b16-8f0d-4f2f-a5de-b491c5881496 service nova] Acquiring lock "refresh_cache-88f95d20-e391-4100-93b2-da29bfcf9704" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:05:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-13be958e-5b95-4e5b-a8b7-a5568baa62f3 req-2ba63b16-8f0d-4f2f-a5de-b491c5881496 service nova] Acquired lock "refresh_cache-88f95d20-e391-4100-93b2-da29bfcf9704" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:05:57 user nova-compute[72504]: DEBUG nova.network.neutron [req-13be958e-5b95-4e5b-a8b7-a5568baa62f3 req-2ba63b16-8f0d-4f2f-a5de-b491c5881496 service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Refreshing network info cache for port 3a4ace30-3ca6-4cc9-8125-599cc4097662 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.035s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e86722a-f81c-4ca9-b75f-80b3d5c900a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5] added
Aug 01 20:05:58 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[117d5c6c-d475-4714-9d14-c1a92f1402a4]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce8ec0d-4cc2-4f5d-a192-7ed9e43234eb]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zZwMKWut {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zZwMKWut" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[052ac51f-e03c-4e3a-9cb0-e58be5d7195d]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zZwMKWut'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[982cc667-5abe-40c6-9d7f-8092a6ab5881]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a2f7eb-ba26-47ef-9032-cb315b2be873]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:05:58 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:05:58 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:05:58 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:05:58 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:05:58 user nova-compute[72504]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)
Aug 01 20:05:58 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:05:58 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:05:58 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:05:58 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:05:58 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:05:58 user nova-compute[72504]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)
Aug 01 20:05:58 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d4f795-0a4d-43ba-ac0d-216c65aa5c56]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5, portal: 172.16.0.220,3260]
Aug 01 20:05:58 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5, portal: 172.16.0.220,3260] successful.
Aug 01 20:05:58 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d679034-9fcf-454c-9ca8-2ed71eb44239]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4145bd0-dd86-4301-aa9c-9c0cd2b06c30]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:05:58 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:05:58 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:05:58 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:05:58 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:05:58 user nova-compute[72504]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)
Aug 01 20:05:58 user nova-compute[72504]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5 (non-flash)
Aug 01 20:05:58 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:05:58 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:05:58 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:05:58 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:05:58 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:05:58 user nova-compute[72504]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)
Aug 01 20:05:58 user nova-compute[72504]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5 (non-flash)
Aug 01 20:05:58 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] HCTL ('39', '-', '-', 0) found on session 40 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.033s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b97d49-b6a0-4feb-9ee2-87db4a8ece3f]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Searching for a device in session 40 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZwMKWut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG nova.network.neutron [req-13be958e-5b95-4e5b-a8b7-a5568baa62f3 req-2ba63b16-8f0d-4f2f-a5de-b491c5881496 service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Updated VIF entry in instance network info cache for port 3a4ace30-3ca6-4cc9-8125-599cc4097662. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG nova.network.neutron [req-13be958e-5b95-4e5b-a8b7-a5568baa62f3 req-2ba63b16-8f0d-4f2f-a5de-b491c5881496 service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Updating instance_info_cache with network_info: [{"id": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "address": "fa:16:3e:c3:aa:1c", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a4ace30-3c", "ovs_interfaceid": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:05:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-13be958e-5b95-4e5b-a8b7-a5568baa62f3 req-2ba63b16-8f0d-4f2f-a5de-b491c5881496 service nova] Releasing lock "refresh_cache-88f95d20-e391-4100-93b2-da29bfcf9704" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:05:59 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:05:59 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] <== connect_volume: return (1460ms) {'type': 'block', 'scsi_wwn': '23666313833636636', 'path': '/dev/sdh'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:05:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666313833636636', 'path': '/dev/sdh'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:05:59 user nova-compute[72504]: DEBUG nova.objects.instance [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lazy-loading 'flavor' on Instance uuid ce155874-97ba-4266-86e1-3271c9879430 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:05:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 20:05:59 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:05:59 user nova-compute[72504]:   <source dev="/dev/sdh"/>
Aug 01 20:05:59 user nova-compute[72504]:   <target dev="vdc" bus="virtio"/>
Aug 01 20:05:59 user nova-compute[72504]:   <serial>a5cdf466-523b-489f-abb3-bf1944a26bb5</serial>
Aug 01 20:05:59 user nova-compute[72504]: </disk>
Aug 01 20:05:59 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 20:05:59 user nova-compute[72504]: DEBUG nova.compute.manager [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Stashing vm_state: active {{(pid=72504) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 01 20:05:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:05:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:05:59 user nova-compute[72504]: DEBUG nova.objects.instance [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lazy-loading 'pci_requests' on Instance uuid 8b163903-b08f-44b6-a5b5-56dc897d5640 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:05:59 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:05:59 user nova-compute[72504]: INFO nova.compute.claims [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Claim successful on node user
Aug 01 20:05:59 user nova-compute[72504]: DEBUG nova.objects.instance [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lazy-loading 'resources' on Instance uuid 8b163903-b08f-44b6-a5b5-56dc897d5640 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:05:59 user nova-compute[72504]: DEBUG nova.objects.instance [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b163903-b08f-44b6-a5b5-56dc897d5640 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:05:59 user nova-compute[72504]: INFO nova.compute.resource_tracker [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Updating resource usage from migration f2904cad-c043-4a9f-84ce-1c28320b5d72
Aug 01 20:06:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:06:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:06:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:06:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] No VIF found with MAC fa:16:3e:7f:e7:bd, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:06:00 user nova-compute[72504]: DEBUG nova.compute.manager [req-9f85268b-f5a3-464e-9842-5b737ec990fb req-e68721f2-f67d-42b2-b827-4825bbed4309 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Received event network-changed-aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:06:00 user nova-compute[72504]: DEBUG nova.compute.manager [req-9f85268b-f5a3-464e-9842-5b737ec990fb req-e68721f2-f67d-42b2-b827-4825bbed4309 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Refreshing instance network info cache due to event network-changed-aeea59ba-654d-4640-a3ca-33f8a7f302ff. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:06:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-9f85268b-f5a3-464e-9842-5b737ec990fb req-e68721f2-f67d-42b2-b827-4825bbed4309 service nova] Acquiring lock "refresh_cache-8b163903-b08f-44b6-a5b5-56dc897d5640" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:06:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-9f85268b-f5a3-464e-9842-5b737ec990fb req-e68721f2-f67d-42b2-b827-4825bbed4309 service nova] Acquired lock "refresh_cache-8b163903-b08f-44b6-a5b5-56dc897d5640" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:06:00 user nova-compute[72504]: DEBUG nova.network.neutron [req-9f85268b-f5a3-464e-9842-5b737ec990fb req-e68721f2-f67d-42b2-b827-4825bbed4309 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Refreshing network info cache for port aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:06:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0e018ec5-bf5f-4db2-a09f-3f69a5e4a0d0 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "ce155874-97ba-4266-86e1-3271c9879430" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.919s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:00 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:06:00 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:06:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.910s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:00 user nova-compute[72504]: INFO nova.compute.manager [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Migrating
Aug 01 20:06:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "refresh_cache-8b163903-b08f-44b6-a5b5-56dc897d5640" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:06:00 user nova-compute[72504]: DEBUG nova.network.neutron [req-9f85268b-f5a3-464e-9842-5b737ec990fb req-e68721f2-f67d-42b2-b827-4825bbed4309 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Updated VIF entry in instance network info cache for port aeea59ba-654d-4640-a3ca-33f8a7f302ff. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:06:00 user nova-compute[72504]: DEBUG nova.network.neutron [req-9f85268b-f5a3-464e-9842-5b737ec990fb req-e68721f2-f67d-42b2-b827-4825bbed4309 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Updating instance_info_cache with network_info: [{"id": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "address": "fa:16:3e:ac:33:02", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeea59ba-65", "ovs_interfaceid": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:06:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-9f85268b-f5a3-464e-9842-5b737ec990fb req-e68721f2-f67d-42b2-b827-4825bbed4309 service nova] Releasing lock "refresh_cache-8b163903-b08f-44b6-a5b5-56dc897d5640" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:06:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquired lock "refresh_cache-8b163903-b08f-44b6-a5b5-56dc897d5640" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:06:00 user nova-compute[72504]: DEBUG nova.network.neutron [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:06:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Acquiring lock "ce155874-97ba-4266-86e1-3271c9879430" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "ce155874-97ba-4266-86e1-3271c9879430" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:01 user nova-compute[72504]: INFO nova.compute.manager [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Detaching volume a5cdf466-523b-489f-abb3-bf1944a26bb5
Aug 01 20:06:01 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690920346.6608927, 0163556c-3f0f-4e08-81a1-56f52ae805a8 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:06:01 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] VM Stopped (Lifecycle Event)
Aug 01 20:06:01 user nova-compute[72504]: DEBUG nova.compute.manager [None req-0a1c363d-911d-46aa-a5f7-45450c9f9369 None None] [instance: 0163556c-3f0f-4e08-81a1-56f52ae805a8] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:06:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:01 user nova-compute[72504]: INFO nova.virt.block_device [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Attempting to driver detach volume a5cdf466-523b-489f-abb3-bf1944a26bb5 from mountpoint /dev/vdc
Aug 01 20:06:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Attempting to detach device vdc from instance ce155874-97ba-4266-86e1-3271c9879430 from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 20:06:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:06:01 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:06:01 user nova-compute[72504]:   <source dev="/dev/sdh"/>
Aug 01 20:06:01 user nova-compute[72504]:   <target dev="vdc" bus="virtio"/>
Aug 01 20:06:01 user nova-compute[72504]:   <serial>a5cdf466-523b-489f-abb3-bf1944a26bb5</serial>
Aug 01 20:06:01 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 20:06:01 user nova-compute[72504]: </disk>
Aug 01 20:06:01 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:06:01 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Successfully detached device vdc from instance ce155874-97ba-4266-86e1-3271c9879430 from the persistent domain config.
Aug 01 20:06:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance ce155874-97ba-4266-86e1-3271c9879430 from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 20:06:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:06:01 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:06:01 user nova-compute[72504]:   <source dev="/dev/sdh"/>
Aug 01 20:06:01 user nova-compute[72504]:   <target dev="vdc" bus="virtio"/>
Aug 01 20:06:01 user nova-compute[72504]:   <serial>a5cdf466-523b-489f-abb3-bf1944a26bb5</serial>
Aug 01 20:06:01 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 20:06:01 user nova-compute[72504]: </disk>
Aug 01 20:06:01 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690920362.2715666, ce155874-97ba-4266-86e1-3271c9879430 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance ce155874-97ba-4266-86e1-3271c9879430 {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 20:06:02 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Successfully detached device vdc from instance ce155874-97ba-4266-86e1-3271c9879430 from the live domain config.
Aug 01 20:06:02 user nova-compute[72504]: DEBUG nova.network.neutron [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Updating instance_info_cache with network_info: [{"id": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "address": "fa:16:3e:ac:33:02", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeea59ba-65", "ovs_interfaceid": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZwMKWut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:06:02 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:06:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Releasing lock "refresh_cache-8b163903-b08f-44b6-a5b5-56dc897d5640" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1115ade7-f649-4713-b94b-df3e3e7b78e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3a690a-9b4e-4cab-9f54-1c378eaf5e74]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:06:02 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:06:02 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:06:02 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:06:02 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:06:02 user nova-compute[72504]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)
Aug 01 20:06:02 user nova-compute[72504]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5 (non-flash)
Aug 01 20:06:02 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:06:02 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:06:02 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:06:02 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:06:02 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:06:02 user nova-compute[72504]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)
Aug 01 20:06:02 user nova-compute[72504]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5 (non-flash)
Aug 01 20:06:02 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff4151df910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5'): ({'sdh'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Removing single pathed devices sdh {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b68e1e-352a-443b-926d-0a069bd147b0]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[145a4779-ee89-43d7-b6a6-45eb38744714]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Flushing IO for device /dev/sdh {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc14356b-0c32-464c-b52c-83e62e09d27b]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Starting migrate_disk_and_power_off {{(pid=72504) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.052s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e01d56c-c351-4b47-af29-cd33437f09df]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] SCSI volumes sdh have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c92583-e9c7-4512-b1f6-609df86a879f]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb7b757-328b-4f2d-bb3b-7a5ea25959a9]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5, portal: 172.16.0.220,3260]
Aug 01 20:06:02 user nova-compute[72504]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5, portal: 172.16.0.220,3260] successful.
Aug 01 20:06:02 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cdf466-523b-489f-abb3-bf1944a26bb5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39875b2-6016-4964-81ce-aa9b646ab4a9]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] <== disconnect_volume: return (407ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG nova.compute.manager [req-599e6605-08dd-4f58-ad72-2180cf935fc4 req-9b85c9ef-1296-4076-bbe2-f50066c50b3f service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Received event network-vif-unplugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-599e6605-08dd-4f58-ad72-2180cf935fc4 req-9b85c9ef-1296-4076-bbe2-f50066c50b3f service nova] Acquiring lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-599e6605-08dd-4f58-ad72-2180cf935fc4 req-9b85c9ef-1296-4076-bbe2-f50066c50b3f service nova] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-599e6605-08dd-4f58-ad72-2180cf935fc4 req-9b85c9ef-1296-4076-bbe2-f50066c50b3f service nova] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG nova.compute.manager [req-599e6605-08dd-4f58-ad72-2180cf935fc4 req-9b85c9ef-1296-4076-bbe2-f50066c50b3f service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] No waiting events found dispatching network-vif-unplugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:06:02 user nova-compute[72504]: WARNING nova.compute.manager [req-599e6605-08dd-4f58-ad72-2180cf935fc4 req-9b85c9ef-1296-4076-bbe2-f50066c50b3f service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Received unexpected event network-vif-unplugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff for instance with vm_state active and task_state resize_migrating.
Aug 01 20:06:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:03 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Instance destroyed successfully.
Aug 01 20:06:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:04:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-678696080',display_name='tempest-ServerActionsTestOtherA-server-678696080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-678696080',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLbPu5MF6DPaLmysryryb5dEvmDVe/ZpzyX1JNIgtOIXBuGnF7k0B3yFjfDeyUfOXvFKWH1T1tnnmguBKUJb6gDrcdFY/x4LtLMGVeolXUhKxLNh5O13uubFnujvAs7Sg==',key_name='tempest-keypair-2041585985',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:04:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='816239d15d3341cdaa785fc36c8e7cdb',ramdisk_id='',reservation_id='r-3tk0djaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1009670506',owner_user_name='tempest-ServerActionsTestOtherA-1009670506-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:06:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d76765d1d24342f99ce0d65f416d382b',uuid=8b163903-b08f-44b6-a5b5-56dc897d5640,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "address": "fa:16:3e:ac:33:02", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1806048076-network", "vif_mac": "fa:16:3e:ac:33:02"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeea59ba-65", "ovs_interfaceid": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Converting VIF {"id": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "address": "fa:16:3e:ac:33:02", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1806048076-network", "vif_mac": "fa:16:3e:ac:33:02"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeea59ba-65", "ovs_interfaceid": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:33:02,bridge_name='br-int',has_traffic_filtering=True,id=aeea59ba-654d-4640-a3ca-33f8a7f302ff,network=Network(92749f96-d369-4df5-85ce-252c277e7ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeea59ba-65') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG os_vif [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:33:02,bridge_name='br-int',has_traffic_filtering=True,id=aeea59ba-654d-4640-a3ca-33f8a7f302ff,network=Network(92749f96-d369-4df5-85ce-252c277e7ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeea59ba-65') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaeea59ba-65, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:03 user nova-compute[72504]: INFO os_vif [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:33:02,bridge_name='br-int',has_traffic_filtering=True,id=aeea59ba-654d-4640-a3ca-33f8a7f302ff,network=Network(92749f96-d369-4df5-85ce-252c277e7ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeea59ba-65')
Aug 01 20:06:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrhkdDLS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:06:03 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:06:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d5794b-fb4e-4946-8936-a79296ddf183]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b078dd5-ae37-4abe-988d-39a8a8ae2100]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:06:03 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:06:03 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:06:03 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:06:03 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:06:03 user nova-compute[72504]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)
Aug 01 20:06:03 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:06:03 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:06:03 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:06:03 user nova-compute[72504]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:06:03 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:06:03 user nova-compute[72504]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)
Aug 01 20:06:03 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff41437b370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160'): ({'sde'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Removing single pathed devices sde {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[42218efa-0588-41c2-94b4-0d7c19384644]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d466bca9-20ab-4e61-81f4-4f45c96205bb]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Flushing IO for device /dev/sde {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7619ef38-c306-4366-9fd8-111ba885bdb5]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[33288a1d-9d7a-4d55-8076-ce08b0cb1221]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] SCSI volumes sde have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_276d0970', '/dev/disk/by-id/scsi-1SCST_BIO276d0970-e413d397f956c37d', '/dev/disk/by-id/scsi-26534313364333937') {{(pid=83379) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 20:06:03 user nova-compute[72504]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_276d0970
Aug 01 20:06:03 user nova-compute[72504]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO276d0970-e413d397f956c37d
Aug 01 20:06:03 user nova-compute[72504]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26534313364333937
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[240dd3a5-0764-4eaf-9333-3b3e472d77c2]: (4, None) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abbae3e-98b9-4a9b-a3df-19b8a9a09e66]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a120e5b2-f4f4-4c40-8c87-c7c8a29965fd]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160, portal: 172.16.0.220,3260]
Aug 01 20:06:03 user nova-compute[72504]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160, portal: 172.16.0.220,3260] successful.
Aug 01 20:06:03 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61732ef-971c-40f6-9d90-59f0a1f18a5d]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] <== disconnect_volume: return (372ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG nova.objects.instance [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lazy-loading 'flavor' on Instance uuid ce155874-97ba-4266-86e1-3271c9879430 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:06:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-05b3df01-813e-4c68-84d4-24559e24cd56 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "ce155874-97ba-4266-86e1-3271c9879430" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.135s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:04 user nova-compute[72504]: DEBUG nova.network.neutron [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Port aeea59ba-654d-4640-a3ca-33f8a7f302ff binding to destination host user is already ACTIVE {{(pid=72504) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 01 20:06:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-5d915926-6e8c-4cd9-a15e-2d50d2ea2d49 req-06b2e1d2-6724-4fd1-98b9-3815de5c2056 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Received event network-vif-plugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:06:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5d915926-6e8c-4cd9-a15e-2d50d2ea2d49 req-06b2e1d2-6724-4fd1-98b9-3815de5c2056 service nova] Acquiring lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5d915926-6e8c-4cd9-a15e-2d50d2ea2d49 req-06b2e1d2-6724-4fd1-98b9-3815de5c2056 service nova] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5d915926-6e8c-4cd9-a15e-2d50d2ea2d49 req-06b2e1d2-6724-4fd1-98b9-3815de5c2056 service nova] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-5d915926-6e8c-4cd9-a15e-2d50d2ea2d49 req-06b2e1d2-6724-4fd1-98b9-3815de5c2056 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] No waiting events found dispatching network-vif-plugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:06:04 user nova-compute[72504]: WARNING nova.compute.manager [req-5d915926-6e8c-4cd9-a15e-2d50d2ea2d49 req-06b2e1d2-6724-4fd1-98b9-3815de5c2056 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Received unexpected event network-vif-plugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff for instance with vm_state active and task_state resize_migrated.
Aug 01 20:06:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "refresh_cache-8b163903-b08f-44b6-a5b5-56dc897d5640" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:06:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquired lock "refresh_cache-8b163903-b08f-44b6-a5b5-56dc897d5640" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:06:04 user nova-compute[72504]: DEBUG nova.network.neutron [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:06:05 user nova-compute[72504]: DEBUG nova.network.neutron [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Updating instance_info_cache with network_info: [{"id": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "address": "fa:16:3e:ac:33:02", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeea59ba-65", "ovs_interfaceid": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:06:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Releasing lock "refresh_cache-8b163903-b08f-44b6-a5b5-56dc897d5640" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:06:05 user nova-compute[72504]: DEBUG os_brick.utils [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:06:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:05 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[419e6091-b6e1-478e-901b-8f3138364042]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:05 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8484239-67a0-48ce-93f8-89f483194362]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:05 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7a39fe-7286-4cd3-a060-3c3c300efcdb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:05 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[26252059-667f-4173-8593-adac40ca1f7c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:06:05 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:06:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:06:05 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:06:05 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8e4b39-3490-401c-84d9-5ae6c436b939]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:05 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:06:05 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:06:05 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:06:05 user nova-compute[72504]: DEBUG os_brick.utils [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:06:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Starting finish_migration {{(pid=72504) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Instance directory exists: not creating {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 20:06:13 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Creating image(s)
Aug 01 20:06:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Did not create local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Ensure instance console log exists: /opt/stack/data/nova/instances/8b163903-b08f-44b6-a5b5-56dc897d5640/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Start _get_guest_xml network_info=[{"id": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "address": "fa:16:3e:ac:33:02", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1806048076-network", "vif_mac": "fa:16:3e:ac:33:02"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeea59ba-65", "ovs_interfaceid": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrhkdDLS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '8b163903-b08f-44b6-a5b5-56dc897d5640', 'attached_at': '2023-08-01T20:06:14.000000', 'detached_at': '', 'volume_id': 'f8d42905-453b-4a20-8b79-736283896160', 'serial': 'f8d42905-453b-4a20-8b79-736283896160'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': '80bb0fd2-56b4-4430-bafe-d6bc7facef27', 'volume_type': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:06:13 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:06:13 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:06:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG nova.objects.instance [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8b163903-b08f-44b6-a5b5-56dc897d5640 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrhkdDLS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:06:13 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:06:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:06:13 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:06:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:06:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:06:13 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:06:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1201b201-5eae-4d2c-802c-227bfd2e0e1c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:06:14 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78a0d8d-92fd-4e8e-b1b0-a3e0fbadba8f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160] added
Aug 01 20:06:14 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ece04d7-e7e2-484e-a4ee-1f10c231cd9d]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffdd4f0-772d-4d50-842d-595dd8559ae8]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XrhkdDLS {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XrhkdDLS" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[915baec6-46d9-418a-a19b-9b2c444d1d01]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XrhkdDLS'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78fa0e9-dc3a-4d71-9af1-e80891485e61]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[404ced80-ad80-439d-a86f-da06472d88ca]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:06:14 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:06:14 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:06:14 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:06:14 user nova-compute[72504]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)
Aug 01 20:06:14 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:06:14 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:06:14 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:06:14 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:06:14 user nova-compute[72504]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)
Aug 01 20:06:14 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b15898b-6b92-4fc1-b2a5-acf2198192a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160, portal: 172.16.0.220,3260]
Aug 01 20:06:14 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160, portal: 172.16.0.220,3260] successful.
Aug 01 20:06:14 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef160fc-f591-4d57-8461-7d0a0b26a9af]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[977040b5-4464-47a6-a123-9e71f4d4de8a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:06:14 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:06:14 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:06:14 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:06:14 user nova-compute[72504]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)
Aug 01 20:06:14 user nova-compute[72504]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:06:14 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:06:14 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:06:14 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:06:14 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:06:14 user nova-compute[72504]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)
Aug 01 20:06:14 user nova-compute[72504]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:06:14 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8491fd-d293-4bdb-ae33-d75eec9641dd]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:14 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: None {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:06:15 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:06:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrhkdDLS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:06:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:06:15 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26534313364333937', 'path': '/dev/sde'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:06:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534313364333937', 'path': '/dev/sde'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:06:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:04:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-678696080',display_name='tempest-ServerActionsTestOtherA-server-678696080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-678696080',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLbPu5MF6DPaLmysryryb5dEvmDVe/ZpzyX1JNIgtOIXBuGnF7k0B3yFjfDeyUfOXvFKWH1T1tnnmguBKUJb6gDrcdFY/x4LtLMGVeolXUhKxLNh5O13uubFnujvAs7Sg==',key_name='tempest-keypair-2041585985',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:04:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='816239d15d3341cdaa785fc36c8e7cdb',ramdisk_id='',reservation_id='r-3tk0djaw',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1009670506',owner_user_name='tempest-ServerActionsTestOtherA-1009670506-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:06:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d76765d1d24342f99ce0d65f416d382b',uuid=8b163903-b08f-44b6-a5b5-56dc897d5640,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "address": "fa:16:3e:ac:33:02", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1806048076-network", "vif_mac": "fa:16:3e:ac:33:02"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeea59ba-65", "ovs_interfaceid": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:06:15 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Converting VIF {"id": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "address": "fa:16:3e:ac:33:02", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1806048076-network", "vif_mac": "fa:16:3e:ac:33:02"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeea59ba-65", "ovs_interfaceid": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:06:15 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:33:02,bridge_name='br-int',has_traffic_filtering=True,id=aeea59ba-654d-4640-a3ca-33f8a7f302ff,network=Network(92749f96-d369-4df5-85ce-252c277e7ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeea59ba-65') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:06:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:06:15 user nova-compute[72504]:   <uuid>8b163903-b08f-44b6-a5b5-56dc897d5640</uuid>
Aug 01 20:06:15 user nova-compute[72504]:   <name>instance-00000020</name>
Aug 01 20:06:15 user nova-compute[72504]:   <memory>2097152</memory>
Aug 01 20:06:15 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:06:15 user nova-compute[72504]:   <metadata>
Aug 01 20:06:15 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:06:15 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:06:15 user nova-compute[72504]:       <nova:name>tempest-ServerActionsTestOtherA-server-678696080</nova:name>
Aug 01 20:06:15 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:06:13</nova:creationTime>
Aug 01 20:06:15 user nova-compute[72504]:       <nova:flavor name="m1.small">
Aug 01 20:06:15 user nova-compute[72504]:         <nova:memory>2048</nova:memory>
Aug 01 20:06:15 user nova-compute[72504]:         <nova:disk>20</nova:disk>
Aug 01 20:06:15 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:06:15 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:06:15 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:06:15 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:06:15 user nova-compute[72504]:       <nova:owner>
Aug 01 20:06:15 user nova-compute[72504]:         <nova:user uuid="d76765d1d24342f99ce0d65f416d382b">tempest-ServerActionsTestOtherA-1009670506-project-member</nova:user>
Aug 01 20:06:15 user nova-compute[72504]:         <nova:project uuid="816239d15d3341cdaa785fc36c8e7cdb">tempest-ServerActionsTestOtherA-1009670506</nova:project>
Aug 01 20:06:15 user nova-compute[72504]:       </nova:owner>
Aug 01 20:06:15 user nova-compute[72504]:       <nova:ports>
Aug 01 20:06:15 user nova-compute[72504]:         <nova:port uuid="aeea59ba-654d-4640-a3ca-33f8a7f302ff">
Aug 01 20:06:15 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 20:06:15 user nova-compute[72504]:         </nova:port>
Aug 01 20:06:15 user nova-compute[72504]:       </nova:ports>
Aug 01 20:06:15 user nova-compute[72504]:     </nova:instance>
Aug 01 20:06:15 user nova-compute[72504]:   </metadata>
Aug 01 20:06:15 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:06:15 user nova-compute[72504]:     <system>
Aug 01 20:06:15 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:06:15 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:06:15 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:06:15 user nova-compute[72504]:       <entry name="serial">8b163903-b08f-44b6-a5b5-56dc897d5640</entry>
Aug 01 20:06:15 user nova-compute[72504]:       <entry name="uuid">8b163903-b08f-44b6-a5b5-56dc897d5640</entry>
Aug 01 20:06:15 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:06:15 user nova-compute[72504]:     </system>
Aug 01 20:06:15 user nova-compute[72504]:   </sysinfo>
Aug 01 20:06:15 user nova-compute[72504]:   <os>
Aug 01 20:06:15 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:06:15 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:06:15 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:06:15 user nova-compute[72504]:   </os>
Aug 01 20:06:15 user nova-compute[72504]:   <features>
Aug 01 20:06:15 user nova-compute[72504]:     <acpi/>
Aug 01 20:06:15 user nova-compute[72504]:     <apic/>
Aug 01 20:06:15 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:06:15 user nova-compute[72504]:   </features>
Aug 01 20:06:15 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:06:15 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:06:15 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:06:15 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:06:15 user nova-compute[72504]:   </clock>
Aug 01 20:06:15 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:06:15 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:06:15 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:06:15 user nova-compute[72504]:   </cpu>
Aug 01 20:06:15 user nova-compute[72504]:   <devices>
Aug 01 20:06:15 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 20:06:15 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:06:15 user nova-compute[72504]:       <source dev="/dev/sde"/>
Aug 01 20:06:15 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:06:15 user nova-compute[72504]:       <serial>f8d42905-453b-4a20-8b79-736283896160</serial>
Aug 01 20:06:15 user nova-compute[72504]:     </disk>
Aug 01 20:06:15 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:06:15 user nova-compute[72504]:       <mac address="fa:16:3e:ac:33:02"/>
Aug 01 20:06:15 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:06:15 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:06:15 user nova-compute[72504]:       <target dev="tapaeea59ba-65"/>
Aug 01 20:06:15 user nova-compute[72504]:     </interface>
Aug 01 20:06:15 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:06:15 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/8b163903-b08f-44b6-a5b5-56dc897d5640/console.log" append="off"/>
Aug 01 20:06:15 user nova-compute[72504]:     </serial>
Aug 01 20:06:15 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:06:15 user nova-compute[72504]:     <video>
Aug 01 20:06:15 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:06:15 user nova-compute[72504]:     </video>
Aug 01 20:06:15 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:06:15 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:06:15 user nova-compute[72504]:     </rng>
Aug 01 20:06:15 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:06:15 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:06:15 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:06:15 user nova-compute[72504]:     </memballoon>
Aug 01 20:06:15 user nova-compute[72504]:   </devices>
Aug 01 20:06:15 user nova-compute[72504]: </domain>
Aug 01 20:06:15 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:06:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:04:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-678696080',display_name='tempest-ServerActionsTestOtherA-server-678696080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-678696080',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLbPu5MF6DPaLmysryryb5dEvmDVe/ZpzyX1JNIgtOIXBuGnF7k0B3yFjfDeyUfOXvFKWH1T1tnnmguBKUJb6gDrcdFY/x4LtLMGVeolXUhKxLNh5O13uubFnujvAs7Sg==',key_name='tempest-keypair-2041585985',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:04:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='816239d15d3341cdaa785fc36c8e7cdb',ramdisk_id='',reservation_id='r-3tk0djaw',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1009670506',owner_user_name='tempest-ServerActionsTestOtherA-1009670506-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:06:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d76765d1d24342f99ce0d65f416d382b',uuid=8b163903-b08f-44b6-a5b5-56dc897d5640,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "address": "fa:16:3e:ac:33:02", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1806048076-network", "vif_mac": "fa:16:3e:ac:33:02"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeea59ba-65", "ovs_interfaceid": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:06:15 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Converting VIF {"id": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "address": "fa:16:3e:ac:33:02", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1806048076-network", "vif_mac": "fa:16:3e:ac:33:02"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeea59ba-65", "ovs_interfaceid": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:06:15 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:33:02,bridge_name='br-int',has_traffic_filtering=True,id=aeea59ba-654d-4640-a3ca-33f8a7f302ff,network=Network(92749f96-d369-4df5-85ce-252c277e7ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeea59ba-65') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:06:15 user nova-compute[72504]: DEBUG os_vif [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:33:02,bridge_name='br-int',has_traffic_filtering=True,id=aeea59ba-654d-4640-a3ca-33f8a7f302ff,network=Network(92749f96-d369-4df5-85ce-252c277e7ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeea59ba-65') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:06:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:06:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:06:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaeea59ba-65, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:06:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaeea59ba-65, col_values=(('external_ids', {'iface-id': 'aeea59ba-654d-4640-a3ca-33f8a7f302ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:33:02', 'vm-uuid': '8b163903-b08f-44b6-a5b5-56dc897d5640'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:06:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:06:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:15 user nova-compute[72504]: INFO os_vif [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:33:02,bridge_name='br-int',has_traffic_filtering=True,id=aeea59ba-654d-4640-a3ca-33f8a7f302ff,network=Network(92749f96-d369-4df5-85ce-252c277e7ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeea59ba-65')
Aug 01 20:06:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:06:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] No VIF found with MAC fa:16:3e:ac:33:02, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:06:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:17 user nova-compute[72504]: DEBUG nova.compute.manager [req-3e2d93d8-65af-45cc-b4fc-97c34a8885a1 req-fdc3e2a2-a235-4404-9e4d-d330d5d85d88 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Received event network-vif-plugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:06:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3e2d93d8-65af-45cc-b4fc-97c34a8885a1 req-fdc3e2a2-a235-4404-9e4d-d330d5d85d88 service nova] Acquiring lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3e2d93d8-65af-45cc-b4fc-97c34a8885a1 req-fdc3e2a2-a235-4404-9e4d-d330d5d85d88 service nova] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3e2d93d8-65af-45cc-b4fc-97c34a8885a1 req-fdc3e2a2-a235-4404-9e4d-d330d5d85d88 service nova] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:17 user nova-compute[72504]: DEBUG nova.compute.manager [req-3e2d93d8-65af-45cc-b4fc-97c34a8885a1 req-fdc3e2a2-a235-4404-9e4d-d330d5d85d88 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] No waiting events found dispatching network-vif-plugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:06:17 user nova-compute[72504]: WARNING nova.compute.manager [req-3e2d93d8-65af-45cc-b4fc-97c34a8885a1 req-fdc3e2a2-a235-4404-9e4d-d330d5d85d88 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Received unexpected event network-vif-plugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff for instance with vm_state active and task_state resize_finish.
Aug 01 20:06:18 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690920363.2284396, 8b163903-b08f-44b6-a5b5-56dc897d5640 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:06:18 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] VM Stopped (Lifecycle Event)
Aug 01 20:06:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-32648e22-11f7-4958-b5f8-06895111ec23 None None] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:06:18 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920378.857974, 8b163903-b08f-44b6-a5b5-56dc897d5640 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:06:18 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] VM Resumed (Lifecycle Event)
Aug 01 20:06:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:06:18 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Instance running successfully.
Aug 01 20:06:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Failed to set time: agent not configured {{(pid=72504) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 01 20:06:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9dade16b-b320-460a-b240-b0495a5b83e2 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] finish_migration finished successfully. {{(pid=72504) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 01 20:06:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:06:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:06:18 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 20:06:18 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920378.8619044, 8b163903-b08f-44b6-a5b5-56dc897d5640 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:06:18 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] VM Started (Lifecycle Event)
Aug 01 20:06:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:06:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:06:18 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 20:06:19 user nova-compute[72504]: DEBUG nova.compute.manager [req-e390ba64-aeb8-4ed0-9b6a-934a3203d1c5 req-e559bf37-ff78-4940-98ce-d87fc85982e8 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Received event network-vif-plugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:06:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e390ba64-aeb8-4ed0-9b6a-934a3203d1c5 req-e559bf37-ff78-4940-98ce-d87fc85982e8 service nova] Acquiring lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e390ba64-aeb8-4ed0-9b6a-934a3203d1c5 req-e559bf37-ff78-4940-98ce-d87fc85982e8 service nova] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e390ba64-aeb8-4ed0-9b6a-934a3203d1c5 req-e559bf37-ff78-4940-98ce-d87fc85982e8 service nova] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:19 user nova-compute[72504]: DEBUG nova.compute.manager [req-e390ba64-aeb8-4ed0-9b6a-934a3203d1c5 req-e559bf37-ff78-4940-98ce-d87fc85982e8 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] No waiting events found dispatching network-vif-plugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:06:19 user nova-compute[72504]: WARNING nova.compute.manager [req-e390ba64-aeb8-4ed0-9b6a-934a3203d1c5 req-e559bf37-ff78-4940-98ce-d87fc85982e8 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Received unexpected event network-vif-plugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff for instance with vm_state resized and task_state None.
Aug 01 20:06:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:22 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:06:22 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:06:22 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid 7391a8ce-7ce5-47ec-97f6-6159645688ea {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid 128c2981-363c-4ae9-b46d-15b5e5d9cac6 {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid 88f95d20-e391-4100-93b2-da29bfcf9704 {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid 54812de2-bfe3-46f1-a327-8081fbb80bec {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid a53847a9-5dfc-422b-ba06-617dda589042 {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid e19bf04b-43e0-4153-a6b5-74dbe36fedb0 {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid 1ac6e0af-4adb-47a7-988e-971aa5efeb2c {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid ce155874-97ba-4266-86e1-3271c9879430 {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid 8b163903-b08f-44b6-a5b5-56dc897d5640 {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid c27bf963-def8-4221-82f2-af2165b6f1dc {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid 9d650208-b69b-4106-b598-5d24d8ec489a {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "39b3076d-ce59-4e7c-976f-9355bf2f6ff4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "39b3076d-ce59-4e7c-976f-9355bf2f6ff4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "7391a8ce-7ce5-47ec-97f6-6159645688ea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "88f95d20-e391-4100-93b2-da29bfcf9704" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "88f95d20-e391-4100-93b2-da29bfcf9704" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "54812de2-bfe3-46f1-a327-8081fbb80bec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "54812de2-bfe3-46f1-a327-8081fbb80bec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "a53847a9-5dfc-422b-ba06-617dda589042" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "a53847a9-5dfc-422b-ba06-617dda589042" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "1ac6e0af-4adb-47a7-988e-971aa5efeb2c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "1ac6e0af-4adb-47a7-988e-971aa5efeb2c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "ce155874-97ba-4266-86e1-3271c9879430" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "ce155874-97ba-4266-86e1-3271c9879430" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "8b163903-b08f-44b6-a5b5-56dc897d5640" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "c27bf963-def8-4221-82f2-af2165b6f1dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "c27bf963-def8-4221-82f2-af2165b6f1dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "9d650208-b69b-4106-b598-5d24d8ec489a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "9d650208-b69b-4106-b598-5d24d8ec489a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "39b3076d-ce59-4e7c-976f-9355bf2f6ff4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "88f95d20-e391-4100-93b2-da29bfcf9704" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "54812de2-bfe3-46f1-a327-8081fbb80bec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "a53847a9-5dfc-422b-ba06-617dda589042" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "1ac6e0af-4adb-47a7-988e-971aa5efeb2c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "c27bf963-def8-4221-82f2-af2165b6f1dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "ce155874-97ba-4266-86e1-3271c9879430" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "9d650208-b69b-4106-b598-5d24d8ec489a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:24 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:06:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:26 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:06:26 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:06:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:28 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:06:29 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:06:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:29 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:06:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:06:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d650208-b69b-4106-b598-5d24d8ec489a/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d650208-b69b-4106-b598-5d24d8ec489a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d650208-b69b-4106-b598-5d24d8ec489a/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d650208-b69b-4106-b598-5d24d8ec489a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:31 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:06:31 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:06:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:31 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:06:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "a53847a9-5dfc-422b-ba06-617dda589042" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "a53847a9-5dfc-422b-ba06-617dda589042" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "a53847a9-5dfc-422b-ba06-617dda589042-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "a53847a9-5dfc-422b-ba06-617dda589042-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "a53847a9-5dfc-422b-ba06-617dda589042-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:32 user nova-compute[72504]: INFO nova.compute.manager [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Terminating instance
Aug 01 20:06:32 user nova-compute[72504]: DEBUG nova.compute.manager [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG nova.compute.manager [req-4ba306b7-c5be-45a8-99dc-b9a6b211ee9d req-502a8883-4c4e-40d6-bd3d-cb9a01c0c69e service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Received event network-vif-unplugged-48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4ba306b7-c5be-45a8-99dc-b9a6b211ee9d req-502a8883-4c4e-40d6-bd3d-cb9a01c0c69e service nova] Acquiring lock "a53847a9-5dfc-422b-ba06-617dda589042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4ba306b7-c5be-45a8-99dc-b9a6b211ee9d req-502a8883-4c4e-40d6-bd3d-cb9a01c0c69e service nova] Lock "a53847a9-5dfc-422b-ba06-617dda589042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4ba306b7-c5be-45a8-99dc-b9a6b211ee9d req-502a8883-4c4e-40d6-bd3d-cb9a01c0c69e service nova] Lock "a53847a9-5dfc-422b-ba06-617dda589042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG nova.compute.manager [req-4ba306b7-c5be-45a8-99dc-b9a6b211ee9d req-502a8883-4c4e-40d6-bd3d-cb9a01c0c69e service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] No waiting events found dispatching network-vif-unplugged-48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG nova.compute.manager [req-4ba306b7-c5be-45a8-99dc-b9a6b211ee9d req-502a8883-4c4e-40d6-bd3d-cb9a01c0c69e service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Received event network-vif-unplugged-48c8fc49-f988-42f1-8275-836370d6a5a8 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:32 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Instance destroyed successfully.
Aug 01 20:06:32 user nova-compute[72504]: DEBUG nova.objects.instance [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lazy-loading 'resources' on Instance uuid a53847a9-5dfc-422b-ba06-617dda589042 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:00:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1477817368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1477817368',id=27,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:02:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b82898c99bce4f04afda7e9ff6e4d5db',ramdisk_id='',reservation_id='r-0ous9rfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-519115368',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:04:47Z,user_data=None,user_id='01263cb2c1874026be1c735abc966b45',uuid=a53847a9-5dfc-422b-ba06-617dda589042,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48c8fc49-f988-42f1-8275-836370d6a5a8", "address": "fa:16:3e:c4:fb:c8", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c8fc49-f9", "ovs_interfaceid": "48c8fc49-f988-42f1-8275-836370d6a5a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Converting VIF {"id": "48c8fc49-f988-42f1-8275-836370d6a5a8", "address": "fa:16:3e:c4:fb:c8", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c8fc49-f9", "ovs_interfaceid": "48c8fc49-f988-42f1-8275-836370d6a5a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:fb:c8,bridge_name='br-int',has_traffic_filtering=True,id=48c8fc49-f988-42f1-8275-836370d6a5a8,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c8fc49-f9') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG os_vif [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:fb:c8,bridge_name='br-int',has_traffic_filtering=True,id=48c8fc49-f988-42f1-8275-836370d6a5a8,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c8fc49-f9') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48c8fc49-f9, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:32 user nova-compute[72504]: INFO os_vif [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:fb:c8,bridge_name='br-int',has_traffic_filtering=True,id=48c8fc49-f988-42f1-8275-836370d6a5a8,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c8fc49-f9')
Aug 01 20:06:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iLjMVGKq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:06:33 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:06:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1856f5-44b5-4b6b-84e7-708fe254b408]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4058e406-efee-4aea-8fb7-23a1b08d5f24]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:06:33 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:06:33 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:06:33 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:06:33 user nova-compute[72504]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)
Aug 01 20:06:33 user nova-compute[72504]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:06:33 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:06:33 user nova-compute[72504]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 (non-flash)
Aug 01 20:06:33 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:06:33 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:06:33 user nova-compute[72504]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)
Aug 01 20:06:33 user nova-compute[72504]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:06:33 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3f472c820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1'): ({'sdd'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Removing single pathed devices sdd {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[32727688-a4f2-41d0-9c28-ef2ce11b1181]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b15fbda-1bfd-4c92-a8d9-36f282054eaf]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Flushing IO for device /dev/sdd {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebf327f-8c08-4db5-8815-5b7664cbe3ae]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[825b8563-d918-42d5-8902-ce15473c8018]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] SCSI volumes sdd have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad5df32-9d96-4493-8b9b-b7576bcbf5cd]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63e9647-30db-4632-b8cd-c8d312ddad76]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1, portal: 172.16.0.220,3260]
Aug 01 20:06:33 user nova-compute[72504]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1, portal: 172.16.0.220,3260] successful.
Aug 01 20:06:33 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37f13f6-502e-4e2e-a386-9a7d3ec020f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ed402e-bf96-4c72-837b-8f0d336bef34]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] <== disconnect_volume: return (395ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:06:33 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Deleting instance files /opt/stack/data/nova/instances/a53847a9-5dfc-422b-ba06-617dda589042_del
Aug 01 20:06:33 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Deletion of /opt/stack/data/nova/instances/a53847a9-5dfc-422b-ba06-617dda589042_del complete
Aug 01 20:06:33 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:06:33 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:06:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=6998MB free_disk=24.95168685913086GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:33 user nova-compute[72504]: INFO nova.compute.manager [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Took 1.66 seconds to destroy the instance on the hypervisor.
Aug 01 20:06:33 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: a53847a9-5dfc-422b-ba06-617dda589042] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:06:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Applying migration context for instance 8b163903-b08f-44b6-a5b5-56dc897d5640 as it has an incoming, in-progress migration f2904cad-c043-4a9f-84ce-1c28320b5d72. Migration status is finished {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 20:06:33 user nova-compute[72504]: INFO nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Updating resource usage from migration f2904cad-c043-4a9f-84ce-1c28320b5d72
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 7391a8ce-7ce5-47ec-97f6-6159645688ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 128c2981-363c-4ae9-b46d-15b5e5d9cac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 88f95d20-e391-4100-93b2-da29bfcf9704 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 54812de2-bfe3-46f1-a327-8081fbb80bec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance a53847a9-5dfc-422b-ba06-617dda589042 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance e19bf04b-43e0-4153-a6b5-74dbe36fedb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1ac6e0af-4adb-47a7-988e-971aa5efeb2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance ce155874-97ba-4266-86e1-3271c9879430 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance c27bf963-def8-4221-82f2-af2165b6f1dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 9d650208-b69b-4106-b598-5d24d8ec489a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Migration f2904cad-c043-4a9f-84ce-1c28320b5d72 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 8b163903-b08f-44b6-a5b5-56dc897d5640 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Refreshing inventories for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Updating ProviderTree inventory for provider b951a798-e88c-472c-8347-2c5f6a05d47c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Updating inventory in ProviderTree for provider b951a798-e88c-472c-8347-2c5f6a05d47c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Refreshing aggregate associations for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c, aggregates: None {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Refreshing trait associations for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c, traits: HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:06:34 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Took 0.59 seconds to deallocate network for instance.
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.compute.manager [req-e224c6e6-5413-4ff1-9ce8-fbd71bc840ad req-e9d56025-1495-4eec-bd91-c900ef41537a service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Received event network-vif-deleted-48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.compute.manager [req-04da1621-cb36-4cc2-aab0-7019e4617bf3 req-e9169fc6-f45c-4329-91f9-203e954b5fcc service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Received event network-vif-plugged-48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-04da1621-cb36-4cc2-aab0-7019e4617bf3 req-e9169fc6-f45c-4329-91f9-203e954b5fcc service nova] Acquiring lock "a53847a9-5dfc-422b-ba06-617dda589042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-04da1621-cb36-4cc2-aab0-7019e4617bf3 req-e9169fc6-f45c-4329-91f9-203e954b5fcc service nova] Lock "a53847a9-5dfc-422b-ba06-617dda589042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-04da1621-cb36-4cc2-aab0-7019e4617bf3 req-e9169fc6-f45c-4329-91f9-203e954b5fcc service nova] Lock "a53847a9-5dfc-422b-ba06-617dda589042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.compute.manager [req-04da1621-cb36-4cc2-aab0-7019e4617bf3 req-e9169fc6-f45c-4329-91f9-203e954b5fcc service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] No waiting events found dispatching network-vif-plugged-48c8fc49-f988-42f1-8275-836370d6a5a8 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:06:34 user nova-compute[72504]: WARNING nova.compute.manager [req-04da1621-cb36-4cc2-aab0-7019e4617bf3 req-e9169fc6-f45c-4329-91f9-203e954b5fcc service nova] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Received unexpected event network-vif-plugged-48c8fc49-f988-42f1-8275-836370d6a5a8 for instance with vm_state active and task_state deleting.
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:06:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.745s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:35 user nova-compute[72504]: INFO nova.compute.manager [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Took 0.72 seconds to detach 1 volumes for instance.
Aug 01 20:06:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:35 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:06:35 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:06:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.486s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:35 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Deleted allocations for instance a53847a9-5dfc-422b-ba06-617dda589042
Aug 01 20:06:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-684c4ccb-06f3-4a73-97ac-ce1029fab39e tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "a53847a9-5dfc-422b-ba06-617dda589042" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.648s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:36 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:06:36 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:06:36 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:06:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-88f95d20-e391-4100-93b2-da29bfcf9704" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:06:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-88f95d20-e391-4100-93b2-da29bfcf9704" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:06:36 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:06:37 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Updating instance_info_cache with network_info: [{"id": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "address": "fa:16:3e:c3:aa:1c", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a4ace30-3c", "ovs_interfaceid": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:06:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-88f95d20-e391-4100-93b2-da29bfcf9704" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:06:37 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:06:37 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:06:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:47 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690920392.942549, a53847a9-5dfc-422b-ba06-617dda589042 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:06:47 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: a53847a9-5dfc-422b-ba06-617dda589042] VM Stopped (Lifecycle Event)
Aug 01 20:06:47 user nova-compute[72504]: DEBUG nova.compute.manager [None req-86e6b98a-ba47-4d1f-9efe-a0730bf43ed3 None None] [instance: a53847a9-5dfc-422b-ba06-617dda589042] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:06:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Acquiring lock "ce155874-97ba-4266-86e1-3271c9879430" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:06:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "ce155874-97ba-4266-86e1-3271c9879430" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:06:52 user nova-compute[72504]: INFO nova.compute.manager [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Detaching volume 6d0abe72-23d8-43e3-bcd6-db45008ed6d9
Aug 01 20:06:52 user nova-compute[72504]: INFO nova.virt.block_device [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Attempting to driver detach volume 6d0abe72-23d8-43e3-bcd6-db45008ed6d9 from mountpoint /dev/vdb
Aug 01 20:06:52 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Attempting to detach device vdb from instance ce155874-97ba-4266-86e1-3271c9879430 from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 20:06:52 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:06:52 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:06:52 user nova-compute[72504]:   <source dev="/dev/sdg"/>
Aug 01 20:06:52 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:06:52 user nova-compute[72504]:   <serial>6d0abe72-23d8-43e3-bcd6-db45008ed6d9</serial>
Aug 01 20:06:52 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:06:52 user nova-compute[72504]: </disk>
Aug 01 20:06:52 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:06:52 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Successfully detached device vdb from instance ce155874-97ba-4266-86e1-3271c9879430 from the persistent domain config.
Aug 01 20:06:52 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ce155874-97ba-4266-86e1-3271c9879430 from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 20:06:52 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:06:52 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:06:52 user nova-compute[72504]:   <source dev="/dev/sdg"/>
Aug 01 20:06:52 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:06:52 user nova-compute[72504]:   <serial>6d0abe72-23d8-43e3-bcd6-db45008ed6d9</serial>
Aug 01 20:06:52 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:06:52 user nova-compute[72504]: </disk>
Aug 01 20:06:52 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:06:52 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690920412.8895512, ce155874-97ba-4266-86e1-3271c9879430 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 20:06:52 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ce155874-97ba-4266-86e1-3271c9879430 {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 20:06:52 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Successfully detached device vdb from instance ce155874-97ba-4266-86e1-3271c9879430 from the live domain config.
Aug 01 20:06:52 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:06:52 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADWHJNrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:06:52 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:06:52 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:06:52 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:06:52 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:06:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:52 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb46a1d-3064-4a5d-9196-b06bf466b2e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:52 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b9f293-4559-4fdb-9d9b-254e145db943]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:52 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:06:52 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:06:52 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:06:52 user nova-compute[72504]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)
Aug 01 20:06:52 user nova-compute[72504]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:06:52 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:06:52 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:06:52 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:06:52 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:06:52 user nova-compute[72504]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 (non-flash)
Aug 01 20:06:52 user nova-compute[72504]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:06:52 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:06:52 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff40c1951b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9'): ({'sdg'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:06:52 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Removing single pathed devices sdg {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:06:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:52 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03cb289-b244-44b2-8891-a9302f1eb5b5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9866378a-ef70-4c66-82c0-7ba0ef23c90c]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Flushing IO for device /dev/sdg {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a27d955-733e-4994-8ea0-7f0fc098c034]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.054s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c45f21-619d-409d-b588-78ca00d0abee]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] SCSI volumes sdg have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[924f8283-578c-4622-9974-e417becf3783]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66bcfee-d854-418d-b054-93874b63ee93]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9, portal: 172.16.0.220,3260]
Aug 01 20:06:53 user nova-compute[72504]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9, portal: 172.16.0.220,3260] successful.
Aug 01 20:06:53 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d0abe72-23d8-43e3-bcd6-db45008ed6d9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5503d56f-b8b8-4b7d-a408-70891ca13d4b]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] <== disconnect_volume: return (310ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG nova.objects.instance [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lazy-loading 'flavor' on Instance uuid ce155874-97ba-4266-86e1-3271c9879430 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:06:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9f34bad3-e2e8-4d52-b6f1-002d082dbd28 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "ce155874-97ba-4266-86e1-3271c9879430" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.669s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:06:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:07:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "c27bf963-def8-4221-82f2-af2165b6f1dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "c27bf963-def8-4221-82f2-af2165b6f1dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "c27bf963-def8-4221-82f2-af2165b6f1dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "c27bf963-def8-4221-82f2-af2165b6f1dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "c27bf963-def8-4221-82f2-af2165b6f1dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:03 user nova-compute[72504]: INFO nova.compute.manager [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Terminating instance
Aug 01 20:07:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:07:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-183484cb-7297-4cc7-b51e-de9cf1f6b2b4 req-d701627b-7922-49ce-84b7-cf29544e5e0d service nova] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Received event network-vif-unplugged-cf70ae69-677f-41a6-8eab-637ebe2d51b7 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-183484cb-7297-4cc7-b51e-de9cf1f6b2b4 req-d701627b-7922-49ce-84b7-cf29544e5e0d service nova] Acquiring lock "c27bf963-def8-4221-82f2-af2165b6f1dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-183484cb-7297-4cc7-b51e-de9cf1f6b2b4 req-d701627b-7922-49ce-84b7-cf29544e5e0d service nova] Lock "c27bf963-def8-4221-82f2-af2165b6f1dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-183484cb-7297-4cc7-b51e-de9cf1f6b2b4 req-d701627b-7922-49ce-84b7-cf29544e5e0d service nova] Lock "c27bf963-def8-4221-82f2-af2165b6f1dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-183484cb-7297-4cc7-b51e-de9cf1f6b2b4 req-d701627b-7922-49ce-84b7-cf29544e5e0d service nova] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] No waiting events found dispatching network-vif-unplugged-cf70ae69-677f-41a6-8eab-637ebe2d51b7 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-183484cb-7297-4cc7-b51e-de9cf1f6b2b4 req-d701627b-7922-49ce-84b7-cf29544e5e0d service nova] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Received event network-vif-unplugged-cf70ae69-677f-41a6-8eab-637ebe2d51b7 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:07:04 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Instance destroyed successfully.
Aug 01 20:07:04 user nova-compute[72504]: DEBUG nova.objects.instance [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lazy-loading 'resources' on Instance uuid c27bf963-def8-4221-82f2-af2165b6f1dc {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:05:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2082518073',display_name='tempest-TestVolumeBootPattern-server-2082518073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2082518073',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:05:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb59fbc2bf9749f3af7d56435cb37066',ramdisk_id='',reservation_id='r-29bb8l4f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-685885098',owner_user_name='tempest-TestVolumeBootPattern-685885098-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:05:33Z,user_data=None,user_id='f06381c8a6214ddea7f1b36b623ed4d5',uuid=c27bf963-def8-4221-82f2-af2165b6f1dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf70ae69-677f-41a6-8eab-637ebe2d51b7", "address": "fa:16:3e:12:f3:17", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf70ae69-67", "ovs_interfaceid": "cf70ae69-677f-41a6-8eab-637ebe2d51b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converting VIF {"id": "cf70ae69-677f-41a6-8eab-637ebe2d51b7", "address": "fa:16:3e:12:f3:17", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf70ae69-67", "ovs_interfaceid": "cf70ae69-677f-41a6-8eab-637ebe2d51b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:f3:17,bridge_name='br-int',has_traffic_filtering=True,id=cf70ae69-677f-41a6-8eab-637ebe2d51b7,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf70ae69-67') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG os_vif [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:f3:17,bridge_name='br-int',has_traffic_filtering=True,id=cf70ae69-677f-41a6-8eab-637ebe2d51b7,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf70ae69-67') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf70ae69-67, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:07:04 user nova-compute[72504]: INFO os_vif [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:f3:17,bridge_name='br-int',has_traffic_filtering=True,id=cf70ae69-677f-41a6-8eab-637ebe2d51b7,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf70ae69-67')
Aug 01 20:07:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KoBMDAkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:07:04 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:07:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c23d24-b9b8-4aec-9d57-26c08d37d50e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6b993b-a872-468c-ae3c-316095ce936a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:07:04 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:07:04 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:07:04 user nova-compute[72504]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:07:04 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:07:04 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:07:04 user nova-compute[72504]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf (non-flash)
Aug 01 20:07:04 user nova-compute[72504]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:07:04 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3f45f64d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf'): ({'sdf'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Removing single pathed devices sdf {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad552d7-e1fd-4627-927b-e32898ec2e17]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2d6de3-0e0c-4eb0-a7d4-f381ddc8f450]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Flushing IO for device /dev/sdf {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5651035b-a0b0-4a42-a2f5-7aa48f520d3e]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb90617-ce6c-4432-9910-f90670efb1f1]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] SCSI volumes sdf have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOcd22446d-da8035c36551cd6b', '/dev/disk/by-id/scsi-26461383033356333', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_cd22446d') {{(pid=83379) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5b0c2c-c317-4a35-b1d3-f2e2a04b5084]: (4, None) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee7e08f-6b48-456c-bcdf-53799f984ccb]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94b22e3-3cb1-4650-9ab6-6080feaa715b]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf, portal: 172.16.0.220,3260]
Aug 01 20:07:04 user nova-compute[72504]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf, portal: 172.16.0.220,3260] successful.
Aug 01 20:07:04 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:679dd5be-20b4-419c-91e6-253cb82073bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e389f75-f2ee-4552-a45c-4cc4e1dda8cb]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] <== disconnect_volume: return (312ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:07:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:07:04 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Deleting instance files /opt/stack/data/nova/instances/c27bf963-def8-4221-82f2-af2165b6f1dc_del
Aug 01 20:07:04 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Deletion of /opt/stack/data/nova/instances/c27bf963-def8-4221-82f2-af2165b6f1dc_del complete
Aug 01 20:07:05 user nova-compute[72504]: INFO nova.compute.manager [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 01 20:07:05 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:07:05 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:07:05 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:07:05 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:07:05 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Took 0.58 seconds to deallocate network for instance.
Aug 01 20:07:05 user nova-compute[72504]: DEBUG nova.compute.manager [req-5cd38548-2b3a-48cd-9d28-df4c557d428a req-fc7149bf-e2ea-4c1a-a503-50b887b9d624 service nova] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Received event network-vif-deleted-cf70ae69-677f-41a6-8eab-637ebe2d51b7 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:07:05 user nova-compute[72504]: INFO nova.compute.manager [req-5cd38548-2b3a-48cd-9d28-df4c557d428a req-fc7149bf-e2ea-4c1a-a503-50b887b9d624 service nova] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Neutron deleted interface cf70ae69-677f-41a6-8eab-637ebe2d51b7; detaching it from the instance and deleting it from the info cache
Aug 01 20:07:05 user nova-compute[72504]: DEBUG nova.network.neutron [req-5cd38548-2b3a-48cd-9d28-df4c557d428a req-fc7149bf-e2ea-4c1a-a503-50b887b9d624 service nova] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:07:05 user nova-compute[72504]: DEBUG nova.compute.manager [req-5cd38548-2b3a-48cd-9d28-df4c557d428a req-fc7149bf-e2ea-4c1a-a503-50b887b9d624 service nova] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Detach interface failed, port_id=cf70ae69-677f-41a6-8eab-637ebe2d51b7, reason: Instance c27bf963-def8-4221-82f2-af2165b6f1dc could not be found. {{(pid=72504) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 20:07:06 user nova-compute[72504]: DEBUG nova.compute.manager [req-c72e9630-d5b1-46c5-aa23-3b972310bc39 req-13be139f-234b-40c9-8a40-5b9958344803 service nova] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Received event network-vif-plugged-cf70ae69-677f-41a6-8eab-637ebe2d51b7 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:07:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c72e9630-d5b1-46c5-aa23-3b972310bc39 req-13be139f-234b-40c9-8a40-5b9958344803 service nova] Acquiring lock "c27bf963-def8-4221-82f2-af2165b6f1dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c72e9630-d5b1-46c5-aa23-3b972310bc39 req-13be139f-234b-40c9-8a40-5b9958344803 service nova] Lock "c27bf963-def8-4221-82f2-af2165b6f1dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c72e9630-d5b1-46c5-aa23-3b972310bc39 req-13be139f-234b-40c9-8a40-5b9958344803 service nova] Lock "c27bf963-def8-4221-82f2-af2165b6f1dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:06 user nova-compute[72504]: DEBUG nova.compute.manager [req-c72e9630-d5b1-46c5-aa23-3b972310bc39 req-13be139f-234b-40c9-8a40-5b9958344803 service nova] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] No waiting events found dispatching network-vif-plugged-cf70ae69-677f-41a6-8eab-637ebe2d51b7 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:07:06 user nova-compute[72504]: WARNING nova.compute.manager [req-c72e9630-d5b1-46c5-aa23-3b972310bc39 req-13be139f-234b-40c9-8a40-5b9958344803 service nova] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Received unexpected event network-vif-plugged-cf70ae69-677f-41a6-8eab-637ebe2d51b7 for instance with vm_state active and task_state deleting.
Aug 01 20:07:06 user nova-compute[72504]: INFO nova.compute.manager [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Took 0.74 seconds to detach 1 volumes for instance.
Aug 01 20:07:06 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Deleting volume: 679dd5be-20b4-419c-91e6-253cb82073bf {{(pid=72504) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 20:07:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:06 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:07:06 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:07:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:06 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Deleted allocations for instance c27bf963-def8-4221-82f2-af2165b6f1dc
Aug 01 20:07:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3af70009-aaf9-4be2-bffb-d043482316da tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "c27bf963-def8-4221-82f2-af2165b6f1dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.220s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b6efcbab-f7fc-4448-bc20-af110541b969 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b6efcbab-f7fc-4448-bc20-af110541b969 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b6efcbab-f7fc-4448-bc20-af110541b969 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b6efcbab-f7fc-4448-bc20-af110541b969 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b6efcbab-f7fc-4448-bc20-af110541b969 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:10 user nova-compute[72504]: INFO nova.compute.manager [None req-b6efcbab-f7fc-4448-bc20-af110541b969 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Terminating instance
Aug 01 20:07:10 user nova-compute[72504]: DEBUG nova.compute.manager [None req-b6efcbab-f7fc-4448-bc20-af110541b969 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:07:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:11 user nova-compute[72504]: DEBUG nova.compute.manager [req-f3a7a011-738b-40bc-8e2a-8a218de94412 req-eecb99c1-ced4-4002-ac4a-c2c7fbbcc60c service nova] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Received event network-vif-unplugged-8fc6472d-34da-4e77-ba88-4dfdbbb615eb {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:07:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f3a7a011-738b-40bc-8e2a-8a218de94412 req-eecb99c1-ced4-4002-ac4a-c2c7fbbcc60c service nova] Acquiring lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f3a7a011-738b-40bc-8e2a-8a218de94412 req-eecb99c1-ced4-4002-ac4a-c2c7fbbcc60c service nova] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f3a7a011-738b-40bc-8e2a-8a218de94412 req-eecb99c1-ced4-4002-ac4a-c2c7fbbcc60c service nova] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:11 user nova-compute[72504]: DEBUG nova.compute.manager [req-f3a7a011-738b-40bc-8e2a-8a218de94412 req-eecb99c1-ced4-4002-ac4a-c2c7fbbcc60c service nova] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] No waiting events found dispatching network-vif-unplugged-8fc6472d-34da-4e77-ba88-4dfdbbb615eb {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:07:11 user nova-compute[72504]: DEBUG nova.compute.manager [req-f3a7a011-738b-40bc-8e2a-8a218de94412 req-eecb99c1-ced4-4002-ac4a-c2c7fbbcc60c service nova] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Received event network-vif-unplugged-8fc6472d-34da-4e77-ba88-4dfdbbb615eb for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:07:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:11 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Instance destroyed successfully.
Aug 01 20:07:11 user nova-compute[72504]: DEBUG nova.objects.instance [None req-b6efcbab-f7fc-4448-bc20-af110541b969 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lazy-loading 'resources' on Instance uuid 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:07:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-b6efcbab-f7fc-4448-bc20-af110541b969 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:59:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1895266006',display_name='tempest-SnapshotDataIntegrityTests-server-1895266006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1895266006',id=25,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHySzzh9R1gNmrFqQoD/6/gOMe1VTQ/KzeLm9cN9WsHLGFKfHlmNQiqy+ENcRW8PuGf1YYSasO4j6t7iu86thBLAv05OSw3O9UJo2d2mDNbqLHbbQagYw9O1usKCtUbqmA==',key_name='tempest-keypair-65374877',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:00:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e853806cb434f6ba589f1c92227fdc7',ramdisk_id='',reservation_id='r-cd9vl3pk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1989743910',owner_user_name='tempest-SnapshotDataIntegrityTests-1989743910-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:00:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fde834d9da4a4ee99d5238b6d63cc8fc',uuid=87d57e7a-e0d8-4f4d-8ad9-de46259a2161,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fc6472d-34da-4e77-ba88-4dfdbbb615eb", "address": "fa:16:3e:45:db:12", "network": {"id": "1f06e326-e832-4d23-8b67-ab7568720b59", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1277548875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e853806cb434f6ba589f1c92227fdc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fc6472d-34", "ovs_interfaceid": "8fc6472d-34da-4e77-ba88-4dfdbbb615eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:07:11 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-b6efcbab-f7fc-4448-bc20-af110541b969 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Converting VIF {"id": "8fc6472d-34da-4e77-ba88-4dfdbbb615eb", "address": "fa:16:3e:45:db:12", "network": {"id": "1f06e326-e832-4d23-8b67-ab7568720b59", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1277548875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e853806cb434f6ba589f1c92227fdc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fc6472d-34", "ovs_interfaceid": "8fc6472d-34da-4e77-ba88-4dfdbbb615eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:07:11 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-b6efcbab-f7fc-4448-bc20-af110541b969 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:db:12,bridge_name='br-int',has_traffic_filtering=True,id=8fc6472d-34da-4e77-ba88-4dfdbbb615eb,network=Network(1f06e326-e832-4d23-8b67-ab7568720b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fc6472d-34') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:07:11 user nova-compute[72504]: DEBUG os_vif [None req-b6efcbab-f7fc-4448-bc20-af110541b969 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:db:12,bridge_name='br-int',has_traffic_filtering=True,id=8fc6472d-34da-4e77-ba88-4dfdbbb615eb,network=Network(1f06e326-e832-4d23-8b67-ab7568720b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fc6472d-34') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:07:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fc6472d-34, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:07:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:07:11 user nova-compute[72504]: INFO os_vif [None req-b6efcbab-f7fc-4448-bc20-af110541b969 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:db:12,bridge_name='br-int',has_traffic_filtering=True,id=8fc6472d-34da-4e77-ba88-4dfdbbb615eb,network=Network(1f06e326-e832-4d23-8b67-ab7568720b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fc6472d-34')
Aug 01 20:07:11 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-b6efcbab-f7fc-4448-bc20-af110541b969 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Deleting instance files /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161_del
Aug 01 20:07:11 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-b6efcbab-f7fc-4448-bc20-af110541b969 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Deletion of /opt/stack/data/nova/instances/87d57e7a-e0d8-4f4d-8ad9-de46259a2161_del complete
Aug 01 20:07:11 user nova-compute[72504]: INFO nova.compute.manager [None req-b6efcbab-f7fc-4448-bc20-af110541b969 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 01 20:07:11 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-b6efcbab-f7fc-4448-bc20-af110541b969 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:07:11 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:07:11 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:07:12 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:07:12 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Took 0.82 seconds to deallocate network for instance.
Aug 01 20:07:12 user nova-compute[72504]: DEBUG nova.compute.manager [req-d47fb57c-21cc-4614-84b4-07ecc7c2df00 req-431602f6-0b6e-4838-afe9-9ce1d763a994 service nova] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Received event network-vif-deleted-8fc6472d-34da-4e77-ba88-4dfdbbb615eb {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:07:12 user nova-compute[72504]: INFO nova.compute.manager [req-d47fb57c-21cc-4614-84b4-07ecc7c2df00 req-431602f6-0b6e-4838-afe9-9ce1d763a994 service nova] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Neutron deleted interface 8fc6472d-34da-4e77-ba88-4dfdbbb615eb; detaching it from the instance and deleting it from the info cache
Aug 01 20:07:12 user nova-compute[72504]: DEBUG nova.network.neutron [req-d47fb57c-21cc-4614-84b4-07ecc7c2df00 req-431602f6-0b6e-4838-afe9-9ce1d763a994 service nova] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:07:12 user nova-compute[72504]: DEBUG nova.compute.manager [req-d47fb57c-21cc-4614-84b4-07ecc7c2df00 req-431602f6-0b6e-4838-afe9-9ce1d763a994 service nova] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Detach interface failed, port_id=8fc6472d-34da-4e77-ba88-4dfdbbb615eb, reason: Instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 could not be found. {{(pid=72504) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 20:07:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b6efcbab-f7fc-4448-bc20-af110541b969 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b6efcbab-f7fc-4448-bc20-af110541b969 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:12 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-b6efcbab-f7fc-4448-bc20-af110541b969 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:07:13 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-b6efcbab-f7fc-4448-bc20-af110541b969 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:07:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b6efcbab-f7fc-4448-bc20-af110541b969 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:13 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-b6efcbab-f7fc-4448-bc20-af110541b969 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Deleted allocations for instance 87d57e7a-e0d8-4f4d-8ad9-de46259a2161
Aug 01 20:07:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b6efcbab-f7fc-4448-bc20-af110541b969 tempest-SnapshotDataIntegrityTests-1989743910 tempest-SnapshotDataIntegrityTests-1989743910-project-member] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.190s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:13 user nova-compute[72504]: DEBUG nova.compute.manager [req-53fd401c-7bad-46af-ac52-cd19dd919930 req-d3f158f4-2ac3-40cd-bf90-ebf92f0afdfc service nova] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Received event network-vif-plugged-8fc6472d-34da-4e77-ba88-4dfdbbb615eb {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:07:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-53fd401c-7bad-46af-ac52-cd19dd919930 req-d3f158f4-2ac3-40cd-bf90-ebf92f0afdfc service nova] Acquiring lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-53fd401c-7bad-46af-ac52-cd19dd919930 req-d3f158f4-2ac3-40cd-bf90-ebf92f0afdfc service nova] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-53fd401c-7bad-46af-ac52-cd19dd919930 req-d3f158f4-2ac3-40cd-bf90-ebf92f0afdfc service nova] Lock "87d57e7a-e0d8-4f4d-8ad9-de46259a2161-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:13 user nova-compute[72504]: DEBUG nova.compute.manager [req-53fd401c-7bad-46af-ac52-cd19dd919930 req-d3f158f4-2ac3-40cd-bf90-ebf92f0afdfc service nova] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] No waiting events found dispatching network-vif-plugged-8fc6472d-34da-4e77-ba88-4dfdbbb615eb {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:07:13 user nova-compute[72504]: WARNING nova.compute.manager [req-53fd401c-7bad-46af-ac52-cd19dd919930 req-d3f158f4-2ac3-40cd-bf90-ebf92f0afdfc service nova] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Received unexpected event network-vif-plugged-8fc6472d-34da-4e77-ba88-4dfdbbb615eb for instance with vm_state deleted and task_state None.
Aug 01 20:07:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a682e377-ba3b-4d4d-9f98-18a6a8b12d14 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Acquiring lock "9d650208-b69b-4106-b598-5d24d8ec489a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a682e377-ba3b-4d4d-9f98-18a6a8b12d14 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "9d650208-b69b-4106-b598-5d24d8ec489a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a682e377-ba3b-4d4d-9f98-18a6a8b12d14 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Acquiring lock "9d650208-b69b-4106-b598-5d24d8ec489a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a682e377-ba3b-4d4d-9f98-18a6a8b12d14 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "9d650208-b69b-4106-b598-5d24d8ec489a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a682e377-ba3b-4d4d-9f98-18a6a8b12d14 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "9d650208-b69b-4106-b598-5d24d8ec489a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:19 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690920424.6225102, c27bf963-def8-4221-82f2-af2165b6f1dc => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:07:19 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] VM Stopped (Lifecycle Event)
Aug 01 20:07:19 user nova-compute[72504]: INFO nova.compute.manager [None req-a682e377-ba3b-4d4d-9f98-18a6a8b12d14 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Terminating instance
Aug 01 20:07:19 user nova-compute[72504]: DEBUG nova.compute.manager [None req-a682e377-ba3b-4d4d-9f98-18a6a8b12d14 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:07:19 user nova-compute[72504]: DEBUG nova.compute.manager [None req-0a110825-1b97-40ee-94d6-b466bdef3346 None None] [instance: c27bf963-def8-4221-82f2-af2165b6f1dc] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:07:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:19 user nova-compute[72504]: DEBUG nova.compute.manager [req-b044a47e-e157-4952-be0a-47203b81c0c2 req-3cbcafdf-216a-4d95-a20d-c9a509a30252 service nova] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Received event network-vif-unplugged-61bdc55c-47b8-4fb2-8743-a2ff4f546dab {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:07:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b044a47e-e157-4952-be0a-47203b81c0c2 req-3cbcafdf-216a-4d95-a20d-c9a509a30252 service nova] Acquiring lock "9d650208-b69b-4106-b598-5d24d8ec489a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b044a47e-e157-4952-be0a-47203b81c0c2 req-3cbcafdf-216a-4d95-a20d-c9a509a30252 service nova] Lock "9d650208-b69b-4106-b598-5d24d8ec489a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b044a47e-e157-4952-be0a-47203b81c0c2 req-3cbcafdf-216a-4d95-a20d-c9a509a30252 service nova] Lock "9d650208-b69b-4106-b598-5d24d8ec489a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:19 user nova-compute[72504]: DEBUG nova.compute.manager [req-b044a47e-e157-4952-be0a-47203b81c0c2 req-3cbcafdf-216a-4d95-a20d-c9a509a30252 service nova] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] No waiting events found dispatching network-vif-unplugged-61bdc55c-47b8-4fb2-8743-a2ff4f546dab {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:07:19 user nova-compute[72504]: DEBUG nova.compute.manager [req-b044a47e-e157-4952-be0a-47203b81c0c2 req-3cbcafdf-216a-4d95-a20d-c9a509a30252 service nova] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Received event network-vif-unplugged-61bdc55c-47b8-4fb2-8743-a2ff4f546dab for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:07:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:20 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Instance destroyed successfully.
Aug 01 20:07:20 user nova-compute[72504]: DEBUG nova.objects.instance [None req-a682e377-ba3b-4d4d-9f98-18a6a8b12d14 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lazy-loading 'resources' on Instance uuid 9d650208-b69b-4106-b598-5d24d8ec489a {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:07:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-a682e377-ba3b-4d4d-9f98-18a6a8b12d14 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:05:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2006529165',display_name='tempest-VolumesActionsTest-instance-2006529165',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2006529165',id=34,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:05:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41110ec7bd3e4ba8a6726bfeeef400d3',ramdisk_id='',reservation_id='r-i4gelesv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-53423842',owner_user_name='tempest-VolumesActionsTest-53423842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:05:38Z,user_data=None,user_id='7e9aad8402924317bb7c92ed6ccfa87c',uuid=9d650208-b69b-4106-b598-5d24d8ec489a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61bdc55c-47b8-4fb2-8743-a2ff4f546dab", "address": "fa:16:3e:d3:ae:54", "network": {"id": "d61a75e5-6ec0-491d-be83-e2ccba438d75", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1390479230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41110ec7bd3e4ba8a6726bfeeef400d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bdc55c-47", "ovs_interfaceid": "61bdc55c-47b8-4fb2-8743-a2ff4f546dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:07:20 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-a682e377-ba3b-4d4d-9f98-18a6a8b12d14 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Converting VIF {"id": "61bdc55c-47b8-4fb2-8743-a2ff4f546dab", "address": "fa:16:3e:d3:ae:54", "network": {"id": "d61a75e5-6ec0-491d-be83-e2ccba438d75", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1390479230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41110ec7bd3e4ba8a6726bfeeef400d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bdc55c-47", "ovs_interfaceid": "61bdc55c-47b8-4fb2-8743-a2ff4f546dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:07:20 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-a682e377-ba3b-4d4d-9f98-18a6a8b12d14 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ae:54,bridge_name='br-int',has_traffic_filtering=True,id=61bdc55c-47b8-4fb2-8743-a2ff4f546dab,network=Network(d61a75e5-6ec0-491d-be83-e2ccba438d75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61bdc55c-47') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:07:20 user nova-compute[72504]: DEBUG os_vif [None req-a682e377-ba3b-4d4d-9f98-18a6a8b12d14 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ae:54,bridge_name='br-int',has_traffic_filtering=True,id=61bdc55c-47b8-4fb2-8743-a2ff4f546dab,network=Network(d61a75e5-6ec0-491d-be83-e2ccba438d75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61bdc55c-47') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:07:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61bdc55c-47, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:07:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:20 user nova-compute[72504]: INFO os_vif [None req-a682e377-ba3b-4d4d-9f98-18a6a8b12d14 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ae:54,bridge_name='br-int',has_traffic_filtering=True,id=61bdc55c-47b8-4fb2-8743-a2ff4f546dab,network=Network(d61a75e5-6ec0-491d-be83-e2ccba438d75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61bdc55c-47')
Aug 01 20:07:20 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-a682e377-ba3b-4d4d-9f98-18a6a8b12d14 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Deleting instance files /opt/stack/data/nova/instances/9d650208-b69b-4106-b598-5d24d8ec489a_del
Aug 01 20:07:20 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-a682e377-ba3b-4d4d-9f98-18a6a8b12d14 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Deletion of /opt/stack/data/nova/instances/9d650208-b69b-4106-b598-5d24d8ec489a_del complete
Aug 01 20:07:20 user nova-compute[72504]: INFO nova.compute.manager [None req-a682e377-ba3b-4d4d-9f98-18a6a8b12d14 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Took 0.64 seconds to destroy the instance on the hypervisor.
Aug 01 20:07:20 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-a682e377-ba3b-4d4d-9f98-18a6a8b12d14 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:07:20 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:07:20 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:07:20 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:07:20 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Took 0.64 seconds to deallocate network for instance.
Aug 01 20:07:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a682e377-ba3b-4d4d-9f98-18a6a8b12d14 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a682e377-ba3b-4d4d-9f98-18a6a8b12d14 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:21 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-a682e377-ba3b-4d4d-9f98-18a6a8b12d14 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:07:21 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-a682e377-ba3b-4d4d-9f98-18a6a8b12d14 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:07:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a682e377-ba3b-4d4d-9f98-18a6a8b12d14 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:21 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-a682e377-ba3b-4d4d-9f98-18a6a8b12d14 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Deleted allocations for instance 9d650208-b69b-4106-b598-5d24d8ec489a
Aug 01 20:07:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a682e377-ba3b-4d4d-9f98-18a6a8b12d14 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "9d650208-b69b-4106-b598-5d24d8ec489a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.831s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:21 user nova-compute[72504]: DEBUG nova.compute.manager [req-b633c68e-2ae3-4bb9-a313-d1e97d2db192 req-89aa3623-84d6-4caf-a087-a97a42ea1649 service nova] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Received event network-vif-plugged-61bdc55c-47b8-4fb2-8743-a2ff4f546dab {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:07:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b633c68e-2ae3-4bb9-a313-d1e97d2db192 req-89aa3623-84d6-4caf-a087-a97a42ea1649 service nova] Acquiring lock "9d650208-b69b-4106-b598-5d24d8ec489a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b633c68e-2ae3-4bb9-a313-d1e97d2db192 req-89aa3623-84d6-4caf-a087-a97a42ea1649 service nova] Lock "9d650208-b69b-4106-b598-5d24d8ec489a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b633c68e-2ae3-4bb9-a313-d1e97d2db192 req-89aa3623-84d6-4caf-a087-a97a42ea1649 service nova] Lock "9d650208-b69b-4106-b598-5d24d8ec489a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:21 user nova-compute[72504]: DEBUG nova.compute.manager [req-b633c68e-2ae3-4bb9-a313-d1e97d2db192 req-89aa3623-84d6-4caf-a087-a97a42ea1649 service nova] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] No waiting events found dispatching network-vif-plugged-61bdc55c-47b8-4fb2-8743-a2ff4f546dab {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:07:21 user nova-compute[72504]: WARNING nova.compute.manager [req-b633c68e-2ae3-4bb9-a313-d1e97d2db192 req-89aa3623-84d6-4caf-a087-a97a42ea1649 service nova] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Received unexpected event network-vif-plugged-61bdc55c-47b8-4fb2-8743-a2ff4f546dab for instance with vm_state deleted and task_state None.
Aug 01 20:07:21 user nova-compute[72504]: DEBUG nova.compute.manager [req-b633c68e-2ae3-4bb9-a313-d1e97d2db192 req-89aa3623-84d6-4caf-a087-a97a42ea1649 service nova] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Received event network-vif-deleted-61bdc55c-47b8-4fb2-8743-a2ff4f546dab {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:07:22 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:07:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d8aaec68-b97b-4692-ba6c-c4f60676c5f7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "54812de2-bfe3-46f1-a327-8081fbb80bec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d8aaec68-b97b-4692-ba6c-c4f60676c5f7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "54812de2-bfe3-46f1-a327-8081fbb80bec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d8aaec68-b97b-4692-ba6c-c4f60676c5f7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "54812de2-bfe3-46f1-a327-8081fbb80bec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d8aaec68-b97b-4692-ba6c-c4f60676c5f7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "54812de2-bfe3-46f1-a327-8081fbb80bec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d8aaec68-b97b-4692-ba6c-c4f60676c5f7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "54812de2-bfe3-46f1-a327-8081fbb80bec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:22 user nova-compute[72504]: INFO nova.compute.manager [None req-d8aaec68-b97b-4692-ba6c-c4f60676c5f7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Terminating instance
Aug 01 20:07:22 user nova-compute[72504]: DEBUG nova.compute.manager [None req-d8aaec68-b97b-4692-ba6c-c4f60676c5f7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:07:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:23 user nova-compute[72504]: DEBUG nova.compute.manager [req-f5eeddb4-deec-4242-bed2-3e44340c163c req-41a66523-4f0a-4a20-9861-d2dea3d783d0 service nova] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Received event network-vif-unplugged-2fd02224-faef-4646-ab99-a0871db9b1c2 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:07:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f5eeddb4-deec-4242-bed2-3e44340c163c req-41a66523-4f0a-4a20-9861-d2dea3d783d0 service nova] Acquiring lock "54812de2-bfe3-46f1-a327-8081fbb80bec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f5eeddb4-deec-4242-bed2-3e44340c163c req-41a66523-4f0a-4a20-9861-d2dea3d783d0 service nova] Lock "54812de2-bfe3-46f1-a327-8081fbb80bec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f5eeddb4-deec-4242-bed2-3e44340c163c req-41a66523-4f0a-4a20-9861-d2dea3d783d0 service nova] Lock "54812de2-bfe3-46f1-a327-8081fbb80bec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:23 user nova-compute[72504]: DEBUG nova.compute.manager [req-f5eeddb4-deec-4242-bed2-3e44340c163c req-41a66523-4f0a-4a20-9861-d2dea3d783d0 service nova] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] No waiting events found dispatching network-vif-unplugged-2fd02224-faef-4646-ab99-a0871db9b1c2 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:07:23 user nova-compute[72504]: DEBUG nova.compute.manager [req-f5eeddb4-deec-4242-bed2-3e44340c163c req-41a66523-4f0a-4a20-9861-d2dea3d783d0 service nova] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Received event network-vif-unplugged-2fd02224-faef-4646-ab99-a0871db9b1c2 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:07:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:23 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Instance destroyed successfully.
Aug 01 20:07:23 user nova-compute[72504]: DEBUG nova.objects.instance [None req-d8aaec68-b97b-4692-ba6c-c4f60676c5f7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lazy-loading 'resources' on Instance uuid 54812de2-bfe3-46f1-a327-8081fbb80bec {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:07:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-d8aaec68-b97b-4692-ba6c-c4f60676c5f7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:58:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1282436828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1282436828',id=24,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:58:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b82898c99bce4f04afda7e9ff6e4d5db',ramdisk_id='',reservation_id='r-mkrj904w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-519115368',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:59:58Z,user_data=None,user_id='01263cb2c1874026be1c735abc966b45',uuid=54812de2-bfe3-46f1-a327-8081fbb80bec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2fd02224-faef-4646-ab99-a0871db9b1c2", "address": "fa:16:3e:a7:6e:3a", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fd02224-fa", "ovs_interfaceid": "2fd02224-faef-4646-ab99-a0871db9b1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:07:23 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-d8aaec68-b97b-4692-ba6c-c4f60676c5f7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Converting VIF {"id": "2fd02224-faef-4646-ab99-a0871db9b1c2", "address": "fa:16:3e:a7:6e:3a", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fd02224-fa", "ovs_interfaceid": "2fd02224-faef-4646-ab99-a0871db9b1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:07:23 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-d8aaec68-b97b-4692-ba6c-c4f60676c5f7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:6e:3a,bridge_name='br-int',has_traffic_filtering=True,id=2fd02224-faef-4646-ab99-a0871db9b1c2,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fd02224-fa') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:07:23 user nova-compute[72504]: DEBUG os_vif [None req-d8aaec68-b97b-4692-ba6c-c4f60676c5f7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:6e:3a,bridge_name='br-int',has_traffic_filtering=True,id=2fd02224-faef-4646-ab99-a0871db9b1c2,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fd02224-fa') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:07:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2fd02224-fa, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:07:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:23 user nova-compute[72504]: INFO os_vif [None req-d8aaec68-b97b-4692-ba6c-c4f60676c5f7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:6e:3a,bridge_name='br-int',has_traffic_filtering=True,id=2fd02224-faef-4646-ab99-a0871db9b1c2,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fd02224-fa')
Aug 01 20:07:23 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-d8aaec68-b97b-4692-ba6c-c4f60676c5f7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Deleting instance files /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec_del
Aug 01 20:07:23 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-d8aaec68-b97b-4692-ba6c-c4f60676c5f7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Deletion of /opt/stack/data/nova/instances/54812de2-bfe3-46f1-a327-8081fbb80bec_del complete
Aug 01 20:07:23 user nova-compute[72504]: INFO nova.compute.manager [None req-d8aaec68-b97b-4692-ba6c-c4f60676c5f7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Took 0.66 seconds to destroy the instance on the hypervisor.
Aug 01 20:07:23 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-d8aaec68-b97b-4692-ba6c-c4f60676c5f7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:07:23 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:07:23 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:07:24 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:07:24 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Took 0.50 seconds to deallocate network for instance.
Aug 01 20:07:24 user nova-compute[72504]: DEBUG nova.compute.manager [req-0f027f9c-b85d-42ad-82dc-f910561bb5a6 req-335f5284-1cd2-45c3-a6b8-40df2af534a3 service nova] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Received event network-vif-deleted-2fd02224-faef-4646-ab99-a0871db9b1c2 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:07:24 user nova-compute[72504]: INFO nova.compute.manager [req-0f027f9c-b85d-42ad-82dc-f910561bb5a6 req-335f5284-1cd2-45c3-a6b8-40df2af534a3 service nova] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Neutron deleted interface 2fd02224-faef-4646-ab99-a0871db9b1c2; detaching it from the instance and deleting it from the info cache
Aug 01 20:07:24 user nova-compute[72504]: DEBUG nova.network.neutron [req-0f027f9c-b85d-42ad-82dc-f910561bb5a6 req-335f5284-1cd2-45c3-a6b8-40df2af534a3 service nova] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:07:24 user nova-compute[72504]: DEBUG nova.compute.manager [req-0f027f9c-b85d-42ad-82dc-f910561bb5a6 req-335f5284-1cd2-45c3-a6b8-40df2af534a3 service nova] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Detach interface failed, port_id=2fd02224-faef-4646-ab99-a0871db9b1c2, reason: Instance 54812de2-bfe3-46f1-a327-8081fbb80bec could not be found. {{(pid=72504) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 20:07:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d8aaec68-b97b-4692-ba6c-c4f60676c5f7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d8aaec68-b97b-4692-ba6c-c4f60676c5f7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:24 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-d8aaec68-b97b-4692-ba6c-c4f60676c5f7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:07:24 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-d8aaec68-b97b-4692-ba6c-c4f60676c5f7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:07:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d8aaec68-b97b-4692-ba6c-c4f60676c5f7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:24 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-d8aaec68-b97b-4692-ba6c-c4f60676c5f7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Deleted allocations for instance 54812de2-bfe3-46f1-a327-8081fbb80bec
Aug 01 20:07:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-d8aaec68-b97b-4692-ba6c-c4f60676c5f7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "54812de2-bfe3-46f1-a327-8081fbb80bec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.742s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:24 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:07:25 user nova-compute[72504]: DEBUG nova.compute.manager [req-532f0086-606e-452b-af11-77c71a959858 req-d5e2fc06-6851-47d1-9525-b7affc9be40b service nova] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Received event network-vif-plugged-2fd02224-faef-4646-ab99-a0871db9b1c2 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:07:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-532f0086-606e-452b-af11-77c71a959858 req-d5e2fc06-6851-47d1-9525-b7affc9be40b service nova] Acquiring lock "54812de2-bfe3-46f1-a327-8081fbb80bec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-532f0086-606e-452b-af11-77c71a959858 req-d5e2fc06-6851-47d1-9525-b7affc9be40b service nova] Lock "54812de2-bfe3-46f1-a327-8081fbb80bec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-532f0086-606e-452b-af11-77c71a959858 req-d5e2fc06-6851-47d1-9525-b7affc9be40b service nova] Lock "54812de2-bfe3-46f1-a327-8081fbb80bec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:25 user nova-compute[72504]: DEBUG nova.compute.manager [req-532f0086-606e-452b-af11-77c71a959858 req-d5e2fc06-6851-47d1-9525-b7affc9be40b service nova] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] No waiting events found dispatching network-vif-plugged-2fd02224-faef-4646-ab99-a0871db9b1c2 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:07:25 user nova-compute[72504]: WARNING nova.compute.manager [req-532f0086-606e-452b-af11-77c71a959858 req-d5e2fc06-6851-47d1-9525-b7affc9be40b service nova] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Received unexpected event network-vif-plugged-2fd02224-faef-4646-ab99-a0871db9b1c2 for instance with vm_state deleted and task_state None.
Aug 01 20:07:26 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690920431.7297375, 87d57e7a-e0d8-4f4d-8ad9-de46259a2161 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:07:26 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] VM Stopped (Lifecycle Event)
Aug 01 20:07:26 user nova-compute[72504]: DEBUG nova.compute.manager [None req-9f0e6f9e-6108-4e97-9b12-fce12a7f6beb None None] [instance: 87d57e7a-e0d8-4f4d-8ad9-de46259a2161] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:07:26 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:07:27 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:07:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:28 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:07:28 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:07:28 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:07:29 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:07:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:29 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:07:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:07:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:07:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:07:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:32 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:07:32 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:07:32 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=7690MB free_disk=25.130794525146484GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:07:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:32 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Applying migration context for instance 8b163903-b08f-44b6-a5b5-56dc897d5640 as it has an incoming, in-progress migration f2904cad-c043-4a9f-84ce-1c28320b5d72. Migration status is finished {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 20:07:32 user nova-compute[72504]: INFO nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Updating resource usage from migration f2904cad-c043-4a9f-84ce-1c28320b5d72
Aug 01 20:07:32 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:07:32 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 7391a8ce-7ce5-47ec-97f6-6159645688ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:07:32 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:07:32 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 128c2981-363c-4ae9-b46d-15b5e5d9cac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:07:32 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 88f95d20-e391-4100-93b2-da29bfcf9704 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:07:32 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance e19bf04b-43e0-4153-a6b5-74dbe36fedb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:07:32 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1ac6e0af-4adb-47a7-988e-971aa5efeb2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:07:32 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance ce155874-97ba-4266-86e1-3271c9879430 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:07:32 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Migration f2904cad-c043-4a9f-84ce-1c28320b5d72 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 20:07:32 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 8b163903-b08f-44b6-a5b5-56dc897d5640 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:07:32 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:07:32 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:07:33 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:07:33 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:07:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:07:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.484s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:35 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690920440.177151, 9d650208-b69b-4106-b598-5d24d8ec489a => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:07:35 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] VM Stopped (Lifecycle Event)
Aug 01 20:07:35 user nova-compute[72504]: DEBUG nova.compute.manager [None req-27a51a94-fd5e-435a-a397-2f38861ade21 None None] [instance: 9d650208-b69b-4106-b598-5d24d8ec489a] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:07:35 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:07:35 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:07:35 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:07:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-e19bf04b-43e0-4153-a6b5-74dbe36fedb0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:07:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-e19bf04b-43e0-4153-a6b5-74dbe36fedb0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:07:35 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:07:36 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Updating instance_info_cache with network_info: [{"id": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "address": "fa:16:3e:c2:53:7c", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d66fd17-3c", "ovs_interfaceid": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:07:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-e19bf04b-43e0-4153-a6b5-74dbe36fedb0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:07:36 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:07:36 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:07:38 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690920443.497336, 54812de2-bfe3-46f1-a327-8081fbb80bec => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:07:38 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] VM Stopped (Lifecycle Event)
Aug 01 20:07:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:38 user nova-compute[72504]: DEBUG nova.compute.manager [None req-6b2ab6ab-f561-4e74-a788-9e2b7ea33e75 None None] [instance: 54812de2-bfe3-46f1-a327-8081fbb80bec] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:07:42 user nova-compute[72504]: DEBUG nova.compute.manager [req-eabdbd88-957b-4a42-a706-efb550651aab req-026da895-14a5-4d78-a41f-7edb858ab71d service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received event network-changed-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:07:42 user nova-compute[72504]: DEBUG nova.compute.manager [req-eabdbd88-957b-4a42-a706-efb550651aab req-026da895-14a5-4d78-a41f-7edb858ab71d service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Refreshing instance network info cache due to event network-changed-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:07:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-eabdbd88-957b-4a42-a706-efb550651aab req-026da895-14a5-4d78-a41f-7edb858ab71d service nova] Acquiring lock "refresh_cache-e19bf04b-43e0-4153-a6b5-74dbe36fedb0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:07:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-eabdbd88-957b-4a42-a706-efb550651aab req-026da895-14a5-4d78-a41f-7edb858ab71d service nova] Acquired lock "refresh_cache-e19bf04b-43e0-4153-a6b5-74dbe36fedb0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:07:42 user nova-compute[72504]: DEBUG nova.network.neutron [req-eabdbd88-957b-4a42-a706-efb550651aab req-026da895-14a5-4d78-a41f-7edb858ab71d service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Refreshing network info cache for port 6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:07:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:42 user nova-compute[72504]: INFO nova.compute.manager [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Detaching volume 27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0
Aug 01 20:07:42 user nova-compute[72504]: DEBUG nova.network.neutron [req-eabdbd88-957b-4a42-a706-efb550651aab req-026da895-14a5-4d78-a41f-7edb858ab71d service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Updated VIF entry in instance network info cache for port 6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:07:42 user nova-compute[72504]: DEBUG nova.network.neutron [req-eabdbd88-957b-4a42-a706-efb550651aab req-026da895-14a5-4d78-a41f-7edb858ab71d service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Updating instance_info_cache with network_info: [{"id": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "address": "fa:16:3e:c2:53:7c", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d66fd17-3c", "ovs_interfaceid": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:07:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-eabdbd88-957b-4a42-a706-efb550651aab req-026da895-14a5-4d78-a41f-7edb858ab71d service nova] Releasing lock "refresh_cache-e19bf04b-43e0-4153-a6b5-74dbe36fedb0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:07:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a8ac80c8-bdff-4bb3-83f8-df7454c09999 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Acquiring lock "ce155874-97ba-4266-86e1-3271c9879430" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a8ac80c8-bdff-4bb3-83f8-df7454c09999 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "ce155874-97ba-4266-86e1-3271c9879430" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a8ac80c8-bdff-4bb3-83f8-df7454c09999 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Acquiring lock "ce155874-97ba-4266-86e1-3271c9879430-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a8ac80c8-bdff-4bb3-83f8-df7454c09999 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "ce155874-97ba-4266-86e1-3271c9879430-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a8ac80c8-bdff-4bb3-83f8-df7454c09999 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "ce155874-97ba-4266-86e1-3271c9879430-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:42 user nova-compute[72504]: INFO nova.compute.manager [None req-a8ac80c8-bdff-4bb3-83f8-df7454c09999 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Terminating instance
Aug 01 20:07:42 user nova-compute[72504]: DEBUG nova.compute.manager [None req-a8ac80c8-bdff-4bb3-83f8-df7454c09999 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:07:42 user nova-compute[72504]: INFO nova.virt.block_device [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Attempting to driver detach volume 27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 from mountpoint /dev/vdb
Aug 01 20:07:42 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Attempting to detach device vdb from instance e19bf04b-43e0-4153-a6b5-74dbe36fedb0 from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 20:07:42 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:07:42 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:07:42 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 20:07:42 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:07:42 user nova-compute[72504]:   <serial>27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0</serial>
Aug 01 20:07:42 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:07:42 user nova-compute[72504]: </disk>
Aug 01 20:07:42 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:07:42 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Successfully detached device vdb from instance e19bf04b-43e0-4153-a6b5-74dbe36fedb0 from the persistent domain config.
Aug 01 20:07:42 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e19bf04b-43e0-4153-a6b5-74dbe36fedb0 from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 20:07:42 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:07:42 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:07:42 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 20:07:42 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:07:42 user nova-compute[72504]:   <serial>27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0</serial>
Aug 01 20:07:42 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:07:42 user nova-compute[72504]: </disk>
Aug 01 20:07:42 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:07:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:42 user nova-compute[72504]: DEBUG nova.compute.manager [req-c1651d7c-6782-4d9d-88f6-41908ec84612 req-37df0f15-0151-4901-bccb-c4907aa5f083 service nova] [instance: ce155874-97ba-4266-86e1-3271c9879430] Received event network-vif-unplugged-506369dd-7925-4369-abe3-640b8268b134 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:07:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c1651d7c-6782-4d9d-88f6-41908ec84612 req-37df0f15-0151-4901-bccb-c4907aa5f083 service nova] Acquiring lock "ce155874-97ba-4266-86e1-3271c9879430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c1651d7c-6782-4d9d-88f6-41908ec84612 req-37df0f15-0151-4901-bccb-c4907aa5f083 service nova] Lock "ce155874-97ba-4266-86e1-3271c9879430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c1651d7c-6782-4d9d-88f6-41908ec84612 req-37df0f15-0151-4901-bccb-c4907aa5f083 service nova] Lock "ce155874-97ba-4266-86e1-3271c9879430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:42 user nova-compute[72504]: DEBUG nova.compute.manager [req-c1651d7c-6782-4d9d-88f6-41908ec84612 req-37df0f15-0151-4901-bccb-c4907aa5f083 service nova] [instance: ce155874-97ba-4266-86e1-3271c9879430] No waiting events found dispatching network-vif-unplugged-506369dd-7925-4369-abe3-640b8268b134 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG nova.compute.manager [req-c1651d7c-6782-4d9d-88f6-41908ec84612 req-37df0f15-0151-4901-bccb-c4907aa5f083 service nova] [instance: ce155874-97ba-4266-86e1-3271c9879430] Received event network-vif-unplugged-506369dd-7925-4369-abe3-640b8268b134 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690920463.2180474, e19bf04b-43e0-4153-a6b5-74dbe36fedb0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e19bf04b-43e0-4153-a6b5-74dbe36fedb0 {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 20:07:43 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Successfully detached device vdb from instance e19bf04b-43e0-4153-a6b5-74dbe36fedb0 from the live domain config.
Aug 01 20:07:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUObLgAs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:07:43 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:07:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f210cc0-76c7-4e54-86ec-c0938604e900]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b518c35-8558-433b-b454-9726a5f20a00]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:07:43 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:07:43 user nova-compute[72504]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:07:43 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:07:43 user nova-compute[72504]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 (non-flash)
Aug 01 20:07:43 user nova-compute[72504]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:07:43 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff40c12b130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0'): ({'sdc'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Removing single pathed devices sdc {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00675ed-950c-41e8-967d-59e082a2c74a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f10f97-a3b2-4f80-9e1c-aab37a034241]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Flushing IO for device /dev/sdc {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6941f114-3521-4174-9066-2149876c9066]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d5e9ca-42c7-4e0e-97d8-2608b272798b]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38aaa40-656f-4115-8685-4f5771f09bc2]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3008772f-4c36-4727-8412-602f6eefbdd4]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0, portal: 172.16.0.220,3260]
Aug 01 20:07:43 user nova-compute[72504]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0, portal: 172.16.0.220,3260] successful.
Aug 01 20:07:43 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd1e7e-26a3-4eb5-8ffc-7ce55a0300f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d64012c-e05e-46b4-a76c-5699a3fb78ee]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] <== disconnect_volume: return (295ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:43 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: ce155874-97ba-4266-86e1-3271c9879430] Instance destroyed successfully.
Aug 01 20:07:43 user nova-compute[72504]: DEBUG nova.objects.instance [None req-a8ac80c8-bdff-4bb3-83f8-df7454c09999 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lazy-loading 'resources' on Instance uuid ce155874-97ba-4266-86e1-3271c9879430 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-a8ac80c8-bdff-4bb3-83f8-df7454c09999 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:03:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-894837217',display_name='tempest-TestServerVolumeAttachmentScenario-server-894837217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-894837217',id=30,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKOH706o8umkzoFopoT9Vgi6dJSYrEzc7KzHgd7IIPOJTpILOgdtyuhhU0gby0WZMfK/sXgtkFwbvwL8gfM9HC+lnFt1wKjrVtdPgTRzZDTVJYMSbNoNNnH8EHlgevW+g==',key_name='tempest-keypair-1825939942',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:03:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='775eb768511548d4b67c176de13c0965',ramdisk_id='',reservation_id='r-zbr3san6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1531898548',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1531898548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:03:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b77d4b9227844b3180c2f68ff394358d',uuid=ce155874-97ba-4266-86e1-3271c9879430,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "506369dd-7925-4369-abe3-640b8268b134", "address": "fa:16:3e:7f:e7:bd", "network": {"id": "ae078c7d-f61f-443f-b40a-d176d82bd28c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1545473901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775eb768511548d4b67c176de13c0965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap506369dd-79", "ovs_interfaceid": "506369dd-7925-4369-abe3-640b8268b134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-a8ac80c8-bdff-4bb3-83f8-df7454c09999 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Converting VIF {"id": "506369dd-7925-4369-abe3-640b8268b134", "address": "fa:16:3e:7f:e7:bd", "network": {"id": "ae078c7d-f61f-443f-b40a-d176d82bd28c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1545473901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775eb768511548d4b67c176de13c0965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap506369dd-79", "ovs_interfaceid": "506369dd-7925-4369-abe3-640b8268b134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-a8ac80c8-bdff-4bb3-83f8-df7454c09999 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:e7:bd,bridge_name='br-int',has_traffic_filtering=True,id=506369dd-7925-4369-abe3-640b8268b134,network=Network(ae078c7d-f61f-443f-b40a-d176d82bd28c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap506369dd-79') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG os_vif [None req-a8ac80c8-bdff-4bb3-83f8-df7454c09999 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:e7:bd,bridge_name='br-int',has_traffic_filtering=True,id=506369dd-7925-4369-abe3-640b8268b134,network=Network(ae078c7d-f61f-443f-b40a-d176d82bd28c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap506369dd-79') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap506369dd-79, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:43 user nova-compute[72504]: INFO os_vif [None req-a8ac80c8-bdff-4bb3-83f8-df7454c09999 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:e7:bd,bridge_name='br-int',has_traffic_filtering=True,id=506369dd-7925-4369-abe3-640b8268b134,network=Network(ae078c7d-f61f-443f-b40a-d176d82bd28c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap506369dd-79')
Aug 01 20:07:43 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-a8ac80c8-bdff-4bb3-83f8-df7454c09999 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Deleting instance files /opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430_del
Aug 01 20:07:43 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-a8ac80c8-bdff-4bb3-83f8-df7454c09999 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Deletion of /opt/stack/data/nova/instances/ce155874-97ba-4266-86e1-3271c9879430_del complete
Aug 01 20:07:43 user nova-compute[72504]: INFO nova.compute.manager [None req-a8ac80c8-bdff-4bb3-83f8-df7454c09999 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] [instance: ce155874-97ba-4266-86e1-3271c9879430] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 01 20:07:43 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-a8ac80c8-bdff-4bb3-83f8-df7454c09999 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: ce155874-97ba-4266-86e1-3271c9879430] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:07:43 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: ce155874-97ba-4266-86e1-3271c9879430] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:07:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-630b2e53-38fd-4a50-b945-e14953b066c5 req-47074dcd-1c91-49db-9403-42912e13857f service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received event network-changed-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:07:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-630b2e53-38fd-4a50-b945-e14953b066c5 req-47074dcd-1c91-49db-9403-42912e13857f service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Refreshing instance network info cache due to event network-changed-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:07:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-630b2e53-38fd-4a50-b945-e14953b066c5 req-47074dcd-1c91-49db-9403-42912e13857f service nova] Acquiring lock "refresh_cache-e19bf04b-43e0-4153-a6b5-74dbe36fedb0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:07:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-630b2e53-38fd-4a50-b945-e14953b066c5 req-47074dcd-1c91-49db-9403-42912e13857f service nova] Acquired lock "refresh_cache-e19bf04b-43e0-4153-a6b5-74dbe36fedb0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:07:44 user nova-compute[72504]: DEBUG nova.network.neutron [req-630b2e53-38fd-4a50-b945-e14953b066c5 req-47074dcd-1c91-49db-9403-42912e13857f service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Refreshing network info cache for port 6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:07:44 user nova-compute[72504]: DEBUG nova.objects.instance [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'flavor' on Instance uuid e19bf04b-43e0-4153-a6b5-74dbe36fedb0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:07:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-766db261-fd35-4915-ad1c-cab37a1a1fa9 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.648s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:44 user nova-compute[72504]: DEBUG nova.network.neutron [req-630b2e53-38fd-4a50-b945-e14953b066c5 req-47074dcd-1c91-49db-9403-42912e13857f service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Updated VIF entry in instance network info cache for port 6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:07:44 user nova-compute[72504]: DEBUG nova.network.neutron [req-630b2e53-38fd-4a50-b945-e14953b066c5 req-47074dcd-1c91-49db-9403-42912e13857f service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Updating instance_info_cache with network_info: [{"id": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "address": "fa:16:3e:c2:53:7c", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d66fd17-3c", "ovs_interfaceid": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:07:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-630b2e53-38fd-4a50-b945-e14953b066c5 req-47074dcd-1c91-49db-9403-42912e13857f service nova] Releasing lock "refresh_cache-e19bf04b-43e0-4153-a6b5-74dbe36fedb0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:07:44 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: ce155874-97ba-4266-86e1-3271c9879430] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:07:44 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: ce155874-97ba-4266-86e1-3271c9879430] Took 1.23 seconds to deallocate network for instance.
Aug 01 20:07:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a8ac80c8-bdff-4bb3-83f8-df7454c09999 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a8ac80c8-bdff-4bb3-83f8-df7454c09999 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:45 user nova-compute[72504]: DEBUG nova.compute.manager [req-07fcf549-c793-471d-9a95-17304bbd3054 req-3dd29c85-74fb-4222-9223-fc217bc9a057 service nova] [instance: ce155874-97ba-4266-86e1-3271c9879430] Received event network-vif-plugged-506369dd-7925-4369-abe3-640b8268b134 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:07:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-07fcf549-c793-471d-9a95-17304bbd3054 req-3dd29c85-74fb-4222-9223-fc217bc9a057 service nova] Acquiring lock "ce155874-97ba-4266-86e1-3271c9879430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-07fcf549-c793-471d-9a95-17304bbd3054 req-3dd29c85-74fb-4222-9223-fc217bc9a057 service nova] Lock "ce155874-97ba-4266-86e1-3271c9879430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-07fcf549-c793-471d-9a95-17304bbd3054 req-3dd29c85-74fb-4222-9223-fc217bc9a057 service nova] Lock "ce155874-97ba-4266-86e1-3271c9879430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:45 user nova-compute[72504]: DEBUG nova.compute.manager [req-07fcf549-c793-471d-9a95-17304bbd3054 req-3dd29c85-74fb-4222-9223-fc217bc9a057 service nova] [instance: ce155874-97ba-4266-86e1-3271c9879430] No waiting events found dispatching network-vif-plugged-506369dd-7925-4369-abe3-640b8268b134 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:07:45 user nova-compute[72504]: WARNING nova.compute.manager [req-07fcf549-c793-471d-9a95-17304bbd3054 req-3dd29c85-74fb-4222-9223-fc217bc9a057 service nova] [instance: ce155874-97ba-4266-86e1-3271c9879430] Received unexpected event network-vif-plugged-506369dd-7925-4369-abe3-640b8268b134 for instance with vm_state deleted and task_state None.
Aug 01 20:07:45 user nova-compute[72504]: DEBUG nova.compute.manager [req-07fcf549-c793-471d-9a95-17304bbd3054 req-3dd29c85-74fb-4222-9223-fc217bc9a057 service nova] [instance: ce155874-97ba-4266-86e1-3271c9879430] Received event network-vif-deleted-506369dd-7925-4369-abe3-640b8268b134 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:07:45 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-a8ac80c8-bdff-4bb3-83f8-df7454c09999 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:07:45 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-a8ac80c8-bdff-4bb3-83f8-df7454c09999 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:07:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a8ac80c8-bdff-4bb3-83f8-df7454c09999 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:45 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-a8ac80c8-bdff-4bb3-83f8-df7454c09999 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Deleted allocations for instance ce155874-97ba-4266-86e1-3271c9879430
Aug 01 20:07:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a8ac80c8-bdff-4bb3-83f8-df7454c09999 tempest-TestServerVolumeAttachmentScenario-1531898548 tempest-TestServerVolumeAttachmentScenario-1531898548-project-member] Lock "ce155874-97ba-4266-86e1-3271c9879430" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.656s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b7103833-748b-4d56-85ac-11daa7874d9c tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "8b163903-b08f-44b6-a5b5-56dc897d5640" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b7103833-748b-4d56-85ac-11daa7874d9c tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:49 user nova-compute[72504]: DEBUG nova.compute.manager [None req-b7103833-748b-4d56-85ac-11daa7874d9c tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Going to confirm migration 2 {{(pid=72504) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 01 20:07:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b7103833-748b-4d56-85ac-11daa7874d9c tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "refresh_cache-8b163903-b08f-44b6-a5b5-56dc897d5640" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:07:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b7103833-748b-4d56-85ac-11daa7874d9c tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquired lock "refresh_cache-8b163903-b08f-44b6-a5b5-56dc897d5640" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:07:49 user nova-compute[72504]: DEBUG nova.network.neutron [None req-b7103833-748b-4d56-85ac-11daa7874d9c tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:07:49 user nova-compute[72504]: DEBUG nova.objects.instance [None req-b7103833-748b-4d56-85ac-11daa7874d9c tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lazy-loading 'info_cache' on Instance uuid 8b163903-b08f-44b6-a5b5-56dc897d5640 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:07:49 user nova-compute[72504]: DEBUG nova.network.neutron [None req-b7103833-748b-4d56-85ac-11daa7874d9c tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Updating instance_info_cache with network_info: [{"id": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "address": "fa:16:3e:ac:33:02", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeea59ba-65", "ovs_interfaceid": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:07:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b7103833-748b-4d56-85ac-11daa7874d9c tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Releasing lock "refresh_cache-8b163903-b08f-44b6-a5b5-56dc897d5640" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:07:49 user nova-compute[72504]: DEBUG nova.objects.instance [None req-b7103833-748b-4d56-85ac-11daa7874d9c tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lazy-loading 'migration_context' on Instance uuid 8b163903-b08f-44b6-a5b5-56dc897d5640 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:07:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b7103833-748b-4d56-85ac-11daa7874d9c tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:07:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b7103833-748b-4d56-85ac-11daa7874d9c tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:07:50 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-b7103833-748b-4d56-85ac-11daa7874d9c tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:07:50 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-b7103833-748b-4d56-85ac-11daa7874d9c tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:07:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b7103833-748b-4d56-85ac-11daa7874d9c tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.312s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:50 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-b7103833-748b-4d56-85ac-11daa7874d9c tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Deleted allocation for migration f2904cad-c043-4a9f-84ce-1c28320b5d72
Aug 01 20:07:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b7103833-748b-4d56-85ac-11daa7874d9c tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.272s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:07:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:07:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:07:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:07:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:07:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:07:58 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690920463.5760698, ce155874-97ba-4266-86e1-3271c9879430 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:07:58 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: ce155874-97ba-4266-86e1-3271c9879430] VM Stopped (Lifecycle Event)
Aug 01 20:07:58 user nova-compute[72504]: DEBUG nova.compute.manager [None req-553e5ac9-8094-44ae-abba-674cbf681586 None None] [instance: ce155874-97ba-4266-86e1-3271c9879430] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:07:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:08:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Acquiring lock "8921bc74-c5a3-46f4-acdf-8a248d9173b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:08:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "8921bc74-c5a3-46f4-acdf-8a248d9173b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:08:11 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 20:08:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:08:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:08:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:08:11 user nova-compute[72504]: INFO nova.compute.claims [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Claim successful on node user
Aug 01 20:08:12 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:08:12 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:08:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:08:12 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 20:08:12 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 20:08:12 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 20:08:12 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 20:08:12 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 20:08:12 user nova-compute[72504]: DEBUG nova.policy [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e9aad8402924317bb7c92ed6ccfa87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41110ec7bd3e4ba8a6726bfeeef400d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 20:08:12 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 20:08:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:08:12 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Creating image(s)
Aug 01 20:08:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Acquiring lock "/opt/stack/data/nova/instances/8921bc74-c5a3-46f4-acdf-8a248d9173b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:08:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "/opt/stack/data/nova/instances/8921bc74-c5a3-46f4-acdf-8a248d9173b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:08:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "/opt/stack/data/nova/instances/8921bc74-c5a3-46f4-acdf-8a248d9173b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:08:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.151s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:08:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:08:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.143s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/8921bc74-c5a3-46f4-acdf-8a248d9173b7/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/8921bc74-c5a3-46f4-acdf-8a248d9173b7/disk 1073741824" returned: 0 in 0.060s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "612e4609-6881-4373-9da0-ee5d762f7126" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:08:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "612e4609-6881-4373-9da0-ee5d762f7126" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:08:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:08:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:12 user nova-compute[72504]: DEBUG nova.compute.manager [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Successfully created port: 76ce7613-6b10-4d90-b9ba-b6f676b8a4a6 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.386s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8921bc74-c5a3-46f4-acdf-8a248d9173b7/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8921bc74-c5a3-46f4-acdf-8a248d9173b7/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:08:13 user nova-compute[72504]: INFO nova.compute.claims [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Claim successful on node user
Aug 01 20:08:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8921bc74-c5a3-46f4-acdf-8a248d9173b7/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Cannot resize image /opt/stack/data/nova/instances/8921bc74-c5a3-46f4-acdf-8a248d9173b7/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lazy-loading 'migration_context' on Instance uuid 8921bc74-c5a3-46f4-acdf-8a248d9173b7 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Ensure instance console log exists: /opt/stack/data/nova/instances/8921bc74-c5a3-46f4-acdf-8a248d9173b7/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "7391a8ce-7ce5-47ec-97f6-6159645688ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:08:13 user nova-compute[72504]: INFO nova.compute.manager [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Terminating instance
Aug 01 20:08:13 user nova-compute[72504]: DEBUG nova.compute.manager [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.578s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG nova.compute.manager [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG nova.compute.manager [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG nova.network.neutron [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 20:08:13 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 20:08:13 user nova-compute[72504]: DEBUG nova.compute.manager [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 20:08:13 user nova-compute[72504]: INFO nova.virt.block_device [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Booting with volume 7500d458-7e1b-43b3-a8a9-93d89adbbc1b at /dev/vda
Aug 01 20:08:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG nova.policy [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f06381c8a6214ddea7f1b36b623ed4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb59fbc2bf9749f3af7d56435cb37066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Successfully updated port: 76ce7613-6b10-4d90-b9ba-b6f676b8a4a6 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Acquiring lock "refresh_cache-8921bc74-c5a3-46f4-acdf-8a248d9173b7" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Acquired lock "refresh_cache-8921bc74-c5a3-46f4-acdf-8a248d9173b7" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG nova.compute.manager [req-38193358-ff39-4f42-b061-12d1d4a18cdb req-8ca1b556-b80a-4b16-816a-175b340a40fa service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Received event network-vif-unplugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-38193358-ff39-4f42-b061-12d1d4a18cdb req-8ca1b556-b80a-4b16-816a-175b340a40fa service nova] Acquiring lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-38193358-ff39-4f42-b061-12d1d4a18cdb req-8ca1b556-b80a-4b16-816a-175b340a40fa service nova] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-38193358-ff39-4f42-b061-12d1d4a18cdb req-8ca1b556-b80a-4b16-816a-175b340a40fa service nova] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG nova.compute.manager [req-38193358-ff39-4f42-b061-12d1d4a18cdb req-8ca1b556-b80a-4b16-816a-175b340a40fa service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] No waiting events found dispatching network-vif-unplugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG nova.compute.manager [req-38193358-ff39-4f42-b061-12d1d4a18cdb req-8ca1b556-b80a-4b16-816a-175b340a40fa service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Received event network-vif-unplugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG nova.compute.manager [req-6c99b568-1ea7-4c91-8531-28c1ff0972c5 req-32ef6002-1ee3-4416-adb0-4ac2d2061c3a service nova] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Received event network-changed-76ce7613-6b10-4d90-b9ba-b6f676b8a4a6 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG nova.compute.manager [req-6c99b568-1ea7-4c91-8531-28c1ff0972c5 req-32ef6002-1ee3-4416-adb0-4ac2d2061c3a service nova] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Refreshing instance network info cache due to event network-changed-76ce7613-6b10-4d90-b9ba-b6f676b8a4a6. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:08:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6c99b568-1ea7-4c91-8531-28c1ff0972c5 req-32ef6002-1ee3-4416-adb0-4ac2d2061c3a service nova] Acquiring lock "refresh_cache-8921bc74-c5a3-46f4-acdf-8a248d9173b7" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG os_brick.utils [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2f4faf-b5b7-43b9-8fe0-e9b1efb8d0ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d731ee6b-b752-42ef-9a07-1af0dd06a29d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84cf997-c29a-4fdb-b41b-67d9f167435a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cc032c-16eb-4d13-8bee-8443d18aea10]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:08:14 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89153b4-48d5-4032-998c-b8f1795337ef]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG os_brick.utils [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Updating existing volume attachment record: 6ab421f2-06c4-4ab4-98e0-c8e07604101b {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:08:14 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Instance destroyed successfully.
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.objects.instance [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lazy-loading 'resources' on Instance uuid 7391a8ce-7ce5-47ec-97f6-6159645688ea {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:52:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1918672849',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1918672849',id=12,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:54:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b82898c99bce4f04afda7e9ff6e4d5db',ramdisk_id='',reservation_id='r-l7bz59oe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-519115368',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:56:14Z,user_data=None,user_id='01263cb2c1874026be1c735abc966b45',uuid=7391a8ce-7ce5-47ec-97f6-6159645688ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "address": "fa:16:3e:08:82:e6", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd06cd7-81", "ovs_interfaceid": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Converting VIF {"id": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "address": "fa:16:3e:08:82:e6", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd06cd7-81", "ovs_interfaceid": "2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:82:e6,bridge_name='br-int',has_traffic_filtering=True,id=2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bd06cd7-81') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG os_vif [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:82:e6,bridge_name='br-int',has_traffic_filtering=True,id=2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bd06cd7-81') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2bd06cd7-81, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:08:14 user nova-compute[72504]: INFO os_vif [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:82:e6,bridge_name='br-int',has_traffic_filtering=True,id=2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bd06cd7-81')
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcdXAqpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:08:14 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:08:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e1ed78-3200-49a5-b6ee-951e173a5f5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef01715-79a1-41fb-b48a-7a05bfdc59f4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:08:14 user nova-compute[72504]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:08:14 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 (non-flash)
Aug 01 20:08:14 user nova-compute[72504]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:08:14 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff41aa2c280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9'): ({'sdb'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Removing single pathed devices sdb {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Updating instance_info_cache with network_info: [{"id": "76ce7613-6b10-4d90-b9ba-b6f676b8a4a6", "address": "fa:16:3e:23:23:ba", "network": {"id": "d61a75e5-6ec0-491d-be83-e2ccba438d75", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1390479230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41110ec7bd3e4ba8a6726bfeeef400d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ce7613-6b", "ovs_interfaceid": "76ce7613-6b10-4d90-b9ba-b6f676b8a4a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e056b42-67fe-4321-af7f-2eaf6939b92e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Releasing lock "refresh_cache-8921bc74-c5a3-46f4-acdf-8a248d9173b7" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Instance network_info: |[{"id": "76ce7613-6b10-4d90-b9ba-b6f676b8a4a6", "address": "fa:16:3e:23:23:ba", "network": {"id": "d61a75e5-6ec0-491d-be83-e2ccba438d75", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1390479230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41110ec7bd3e4ba8a6726bfeeef400d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ce7613-6b", "ovs_interfaceid": "76ce7613-6b10-4d90-b9ba-b6f676b8a4a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6c99b568-1ea7-4c91-8531-28c1ff0972c5 req-32ef6002-1ee3-4416-adb0-4ac2d2061c3a service nova] Acquired lock "refresh_cache-8921bc74-c5a3-46f4-acdf-8a248d9173b7" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.network.neutron [req-6c99b568-1ea7-4c91-8531-28c1ff0972c5 req-32ef6002-1ee3-4416-adb0-4ac2d2061c3a service nova] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Refreshing network info cache for port 76ce7613-6b10-4d90-b9ba-b6f676b8a4a6 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Start _get_guest_xml network_info=[{"id": "76ce7613-6b10-4d90-b9ba-b6f676b8a4a6", "address": "fa:16:3e:23:23:ba", "network": {"id": "d61a75e5-6ec0-491d-be83-e2ccba438d75", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1390479230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41110ec7bd3e4ba8a6726bfeeef400d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ce7613-6b", "ovs_interfaceid": "76ce7613-6b10-4d90-b9ba-b6f676b8a4a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca0b3a0-6c61-4bb2-bc25-179d34ce5ff1]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Flushing IO for device /dev/sdb {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:08:14 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:08:14 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:08:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-597306872',display_name='tempest-VolumesActionsTest-instance-597306872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-597306872',id=35,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41110ec7bd3e4ba8a6726bfeeef400d3',ramdisk_id='',reservation_id='r-oilclz8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-53423842',owner_user_name='tempest-VolumesActionsTest-53423842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:08:12Z,user_data=None,user_id='7e9aad8402924317bb7c92ed6ccfa87c',uuid=8921bc74-c5a3-46f4-acdf-8a248d9173b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76ce7613-6b10-4d90-b9ba-b6f676b8a4a6", "address": "fa:16:3e:23:23:ba", "network": {"id": "d61a75e5-6ec0-491d-be83-e2ccba438d75", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1390479230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41110ec7bd3e4ba8a6726bfeeef400d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ce7613-6b", "ovs_interfaceid": "76ce7613-6b10-4d90-b9ba-b6f676b8a4a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Converting VIF {"id": "76ce7613-6b10-4d90-b9ba-b6f676b8a4a6", "address": "fa:16:3e:23:23:ba", "network": {"id": "d61a75e5-6ec0-491d-be83-e2ccba438d75", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1390479230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41110ec7bd3e4ba8a6726bfeeef400d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ce7613-6b", "ovs_interfaceid": "76ce7613-6b10-4d90-b9ba-b6f676b8a4a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:23:ba,bridge_name='br-int',has_traffic_filtering=True,id=76ce7613-6b10-4d90-b9ba-b6f676b8a4a6,network=Network(d61a75e5-6ec0-491d-be83-e2ccba438d75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ce7613-6b') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lazy-loading 'pci_devices' on Instance uuid 8921bc74-c5a3-46f4-acdf-8a248d9173b7 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d097cfa8-bb77-44d3-96ba-cc5164070fcc]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:08:14 user nova-compute[72504]:   <uuid>8921bc74-c5a3-46f4-acdf-8a248d9173b7</uuid>
Aug 01 20:08:14 user nova-compute[72504]:   <name>instance-00000023</name>
Aug 01 20:08:14 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:08:14 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:08:14 user nova-compute[72504]:   <metadata>
Aug 01 20:08:14 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:08:14 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:08:14 user nova-compute[72504]:       <nova:name>tempest-VolumesActionsTest-instance-597306872</nova:name>
Aug 01 20:08:14 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:08:14</nova:creationTime>
Aug 01 20:08:14 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:08:14 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:08:14 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:08:14 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:08:14 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:08:14 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:08:14 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:08:14 user nova-compute[72504]:       <nova:owner>
Aug 01 20:08:14 user nova-compute[72504]:         <nova:user uuid="7e9aad8402924317bb7c92ed6ccfa87c">tempest-VolumesActionsTest-53423842-project-member</nova:user>
Aug 01 20:08:14 user nova-compute[72504]:         <nova:project uuid="41110ec7bd3e4ba8a6726bfeeef400d3">tempest-VolumesActionsTest-53423842</nova:project>
Aug 01 20:08:14 user nova-compute[72504]:       </nova:owner>
Aug 01 20:08:14 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 20:08:14 user nova-compute[72504]:       <nova:ports>
Aug 01 20:08:14 user nova-compute[72504]:         <nova:port uuid="76ce7613-6b10-4d90-b9ba-b6f676b8a4a6">
Aug 01 20:08:14 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 20:08:14 user nova-compute[72504]:         </nova:port>
Aug 01 20:08:14 user nova-compute[72504]:       </nova:ports>
Aug 01 20:08:14 user nova-compute[72504]:     </nova:instance>
Aug 01 20:08:14 user nova-compute[72504]:   </metadata>
Aug 01 20:08:14 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:08:14 user nova-compute[72504]:     <system>
Aug 01 20:08:14 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:08:14 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:08:14 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:08:14 user nova-compute[72504]:       <entry name="serial">8921bc74-c5a3-46f4-acdf-8a248d9173b7</entry>
Aug 01 20:08:14 user nova-compute[72504]:       <entry name="uuid">8921bc74-c5a3-46f4-acdf-8a248d9173b7</entry>
Aug 01 20:08:14 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:08:14 user nova-compute[72504]:     </system>
Aug 01 20:08:14 user nova-compute[72504]:   </sysinfo>
Aug 01 20:08:14 user nova-compute[72504]:   <os>
Aug 01 20:08:14 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:08:14 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:08:14 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:08:14 user nova-compute[72504]:   </os>
Aug 01 20:08:14 user nova-compute[72504]:   <features>
Aug 01 20:08:14 user nova-compute[72504]:     <acpi/>
Aug 01 20:08:14 user nova-compute[72504]:     <apic/>
Aug 01 20:08:14 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:08:14 user nova-compute[72504]:   </features>
Aug 01 20:08:14 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:08:14 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:08:14 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:08:14 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:08:14 user nova-compute[72504]:   </clock>
Aug 01 20:08:14 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:08:14 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:08:14 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:08:14 user nova-compute[72504]:   </cpu>
Aug 01 20:08:14 user nova-compute[72504]:   <devices>
Aug 01 20:08:14 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 20:08:14 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 20:08:14 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/8921bc74-c5a3-46f4-acdf-8a248d9173b7/disk"/>
Aug 01 20:08:14 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:08:14 user nova-compute[72504]:     </disk>
Aug 01 20:08:14 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:08:14 user nova-compute[72504]:       <mac address="fa:16:3e:23:23:ba"/>
Aug 01 20:08:14 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:08:14 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:08:14 user nova-compute[72504]:       <target dev="tap76ce7613-6b"/>
Aug 01 20:08:14 user nova-compute[72504]:     </interface>
Aug 01 20:08:14 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:08:14 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/8921bc74-c5a3-46f4-acdf-8a248d9173b7/console.log" append="off"/>
Aug 01 20:08:14 user nova-compute[72504]:     </serial>
Aug 01 20:08:14 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:08:14 user nova-compute[72504]:     <video>
Aug 01 20:08:14 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:08:14 user nova-compute[72504]:     </video>
Aug 01 20:08:14 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:08:14 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:08:14 user nova-compute[72504]:     </rng>
Aug 01 20:08:14 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:08:14 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:08:14 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:08:14 user nova-compute[72504]:     </memballoon>
Aug 01 20:08:14 user nova-compute[72504]:   </devices>
Aug 01 20:08:14 user nova-compute[72504]: </domain>
Aug 01 20:08:14 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:08:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-597306872',display_name='tempest-VolumesActionsTest-instance-597306872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-597306872',id=35,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41110ec7bd3e4ba8a6726bfeeef400d3',ramdisk_id='',reservation_id='r-oilclz8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-53423842',owner_user_name='tempest-VolumesActionsTest-53423842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:08:12Z,user_data=None,user_id='7e9aad8402924317bb7c92ed6ccfa87c',uuid=8921bc74-c5a3-46f4-acdf-8a248d9173b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76ce7613-6b10-4d90-b9ba-b6f676b8a4a6", "address": "fa:16:3e:23:23:ba", "network": {"id": "d61a75e5-6ec0-491d-be83-e2ccba438d75", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1390479230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41110ec7bd3e4ba8a6726bfeeef400d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ce7613-6b", "ovs_interfaceid": "76ce7613-6b10-4d90-b9ba-b6f676b8a4a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Converting VIF {"id": "76ce7613-6b10-4d90-b9ba-b6f676b8a4a6", "address": "fa:16:3e:23:23:ba", "network": {"id": "d61a75e5-6ec0-491d-be83-e2ccba438d75", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1390479230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41110ec7bd3e4ba8a6726bfeeef400d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ce7613-6b", "ovs_interfaceid": "76ce7613-6b10-4d90-b9ba-b6f676b8a4a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:23:ba,bridge_name='br-int',has_traffic_filtering=True,id=76ce7613-6b10-4d90-b9ba-b6f676b8a4a6,network=Network(d61a75e5-6ec0-491d-be83-e2ccba438d75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ce7613-6b') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG os_vif [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:23:ba,bridge_name='br-int',has_traffic_filtering=True,id=76ce7613-6b10-4d90-b9ba-b6f676b8a4a6,network=Network(d61a75e5-6ec0-491d-be83-e2ccba438d75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ce7613-6b') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76ce7613-6b, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap76ce7613-6b, col_values=(('external_ids', {'iface-id': '76ce7613-6b10-4d90-b9ba-b6f676b8a4a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:23:ba', 'vm-uuid': '8921bc74-c5a3-46f4-acdf-8a248d9173b7'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:14 user nova-compute[72504]: INFO os_vif [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:23:ba,bridge_name='br-int',has_traffic_filtering=True,id=76ce7613-6b10-4d90-b9ba-b6f676b8a4a6,network=Network(d61a75e5-6ec0-491d-be83-e2ccba438d75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ce7613-6b')
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ff6eb4-e12f-4d8f-a3bd-8129eb402f35]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.network.neutron [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Successfully created port: 1d876bbd-c0b1-4c03-b47a-c413c6b9147c {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[329d76ff-8924-411e-a8ff-ca74eb902cd0]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] No VIF found with MAC fa:16:3e:23:23:ba, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[622ed5fd-84b9-4bd8-824f-c4a9d1b66429]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9, portal: 172.16.0.220,3260]
Aug 01 20:08:14 user nova-compute[72504]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9, portal: 172.16.0.220,3260] successful.
Aug 01 20:08:14 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4682cd-8a63-4b10-9857-1ea601c38ba9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f6b45b-d5db-4594-a5f0-04538de70486]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] <== disconnect_volume: return (355ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:08:14 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Deleting instance files /opt/stack/data/nova/instances/7391a8ce-7ce5-47ec-97f6-6159645688ea_del
Aug 01 20:08:14 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Deletion of /opt/stack/data/nova/instances/7391a8ce-7ce5-47ec-97f6-6159645688ea_del complete
Aug 01 20:08:14 user nova-compute[72504]: INFO nova.compute.manager [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 01 20:08:14 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:08:14 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:08:15 user nova-compute[72504]: DEBUG nova.network.neutron [req-6c99b568-1ea7-4c91-8531-28c1ff0972c5 req-32ef6002-1ee3-4416-adb0-4ac2d2061c3a service nova] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Updated VIF entry in instance network info cache for port 76ce7613-6b10-4d90-b9ba-b6f676b8a4a6. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:08:15 user nova-compute[72504]: DEBUG nova.network.neutron [req-6c99b568-1ea7-4c91-8531-28c1ff0972c5 req-32ef6002-1ee3-4416-adb0-4ac2d2061c3a service nova] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Updating instance_info_cache with network_info: [{"id": "76ce7613-6b10-4d90-b9ba-b6f676b8a4a6", "address": "fa:16:3e:23:23:ba", "network": {"id": "d61a75e5-6ec0-491d-be83-e2ccba438d75", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1390479230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41110ec7bd3e4ba8a6726bfeeef400d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ce7613-6b", "ovs_interfaceid": "76ce7613-6b10-4d90-b9ba-b6f676b8a4a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:08:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6c99b568-1ea7-4c91-8531-28c1ff0972c5 req-32ef6002-1ee3-4416-adb0-4ac2d2061c3a service nova] Releasing lock "refresh_cache-8921bc74-c5a3-46f4-acdf-8a248d9173b7" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:08:15 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:08:15 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Took 0.43 seconds to deallocate network for instance.
Aug 01 20:08:15 user nova-compute[72504]: DEBUG nova.network.neutron [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Successfully updated port: 1d876bbd-c0b1-4c03-b47a-c413c6b9147c {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 20:08:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "refresh_cache-612e4609-6881-4373-9da0-ee5d762f7126" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:08:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquired lock "refresh_cache-612e4609-6881-4373-9da0-ee5d762f7126" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:08:15 user nova-compute[72504]: DEBUG nova.network.neutron [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:08:15 user nova-compute[72504]: DEBUG nova.compute.manager [req-618e5f8b-35f5-4c7c-ae91-4f8374defd02 req-47e5a036-6c07-4913-9b6d-fadf8dc4c40b service nova] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Received event network-changed-1d876bbd-c0b1-4c03-b47a-c413c6b9147c {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:08:15 user nova-compute[72504]: DEBUG nova.compute.manager [req-618e5f8b-35f5-4c7c-ae91-4f8374defd02 req-47e5a036-6c07-4913-9b6d-fadf8dc4c40b service nova] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Refreshing instance network info cache due to event network-changed-1d876bbd-c0b1-4c03-b47a-c413c6b9147c. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:08:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-618e5f8b-35f5-4c7c-ae91-4f8374defd02 req-47e5a036-6c07-4913-9b6d-fadf8dc4c40b service nova] Acquiring lock "refresh_cache-612e4609-6881-4373-9da0-ee5d762f7126" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:08:15 user nova-compute[72504]: DEBUG nova.network.neutron [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:08:15 user nova-compute[72504]: DEBUG nova.network.neutron [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Updating instance_info_cache with network_info: [{"id": "1d876bbd-c0b1-4c03-b47a-c413c6b9147c", "address": "fa:16:3e:19:90:9c", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d876bbd-c0", "ovs_interfaceid": "1d876bbd-c0b1-4c03-b47a-c413c6b9147c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:08:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Releasing lock "refresh_cache-612e4609-6881-4373-9da0-ee5d762f7126" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:08:15 user nova-compute[72504]: DEBUG nova.compute.manager [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Instance network_info: |[{"id": "1d876bbd-c0b1-4c03-b47a-c413c6b9147c", "address": "fa:16:3e:19:90:9c", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d876bbd-c0", "ovs_interfaceid": "1d876bbd-c0b1-4c03-b47a-c413c6b9147c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 20:08:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-618e5f8b-35f5-4c7c-ae91-4f8374defd02 req-47e5a036-6c07-4913-9b6d-fadf8dc4c40b service nova] Acquired lock "refresh_cache-612e4609-6881-4373-9da0-ee5d762f7126" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:08:15 user nova-compute[72504]: DEBUG nova.network.neutron [req-618e5f8b-35f5-4c7c-ae91-4f8374defd02 req-47e5a036-6c07-4913-9b6d-fadf8dc4c40b service nova] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Refreshing network info cache for port 1d876bbd-c0b1-4c03-b47a-c413c6b9147c {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:08:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:16 user nova-compute[72504]: DEBUG nova.compute.manager [req-7cd64717-3d42-4413-9392-93bd4d7a2938 req-130ebbbb-11dd-43b5-aefa-0d5316f47047 service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Received event network-vif-plugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:08:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7cd64717-3d42-4413-9392-93bd4d7a2938 req-130ebbbb-11dd-43b5-aefa-0d5316f47047 service nova] Acquiring lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:08:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7cd64717-3d42-4413-9392-93bd4d7a2938 req-130ebbbb-11dd-43b5-aefa-0d5316f47047 service nova] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:08:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7cd64717-3d42-4413-9392-93bd4d7a2938 req-130ebbbb-11dd-43b5-aefa-0d5316f47047 service nova] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:08:16 user nova-compute[72504]: DEBUG nova.compute.manager [req-7cd64717-3d42-4413-9392-93bd4d7a2938 req-130ebbbb-11dd-43b5-aefa-0d5316f47047 service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] No waiting events found dispatching network-vif-plugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:08:16 user nova-compute[72504]: WARNING nova.compute.manager [req-7cd64717-3d42-4413-9392-93bd4d7a2938 req-130ebbbb-11dd-43b5-aefa-0d5316f47047 service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Received unexpected event network-vif-plugged-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 for instance with vm_state active and task_state deleting.
Aug 01 20:08:16 user nova-compute[72504]: DEBUG nova.compute.manager [req-7cd64717-3d42-4413-9392-93bd4d7a2938 req-130ebbbb-11dd-43b5-aefa-0d5316f47047 service nova] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Received event network-vif-deleted-2bd06cd7-8195-4dad-8ef1-2bb7c8e4df66 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:08:16 user nova-compute[72504]: INFO nova.compute.manager [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Took 0.77 seconds to detach 1 volumes for instance.
Aug 01 20:08:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:08:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:08:16 user nova-compute[72504]: DEBUG nova.network.neutron [req-618e5f8b-35f5-4c7c-ae91-4f8374defd02 req-47e5a036-6c07-4913-9b6d-fadf8dc4c40b service nova] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Updated VIF entry in instance network info cache for port 1d876bbd-c0b1-4c03-b47a-c413c6b9147c. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:08:16 user nova-compute[72504]: DEBUG nova.network.neutron [req-618e5f8b-35f5-4c7c-ae91-4f8374defd02 req-47e5a036-6c07-4913-9b6d-fadf8dc4c40b service nova] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Updating instance_info_cache with network_info: [{"id": "1d876bbd-c0b1-4c03-b47a-c413c6b9147c", "address": "fa:16:3e:19:90:9c", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d876bbd-c0", "ovs_interfaceid": "1d876bbd-c0b1-4c03-b47a-c413c6b9147c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:08:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-618e5f8b-35f5-4c7c-ae91-4f8374defd02 req-47e5a036-6c07-4913-9b6d-fadf8dc4c40b service nova] Releasing lock "refresh_cache-612e4609-6881-4373-9da0-ee5d762f7126" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:08:16 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:08:16 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:08:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:08:16 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Deleted allocations for instance 7391a8ce-7ce5-47ec-97f6-6159645688ea
Aug 01 20:08:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ca267dac-d273-4b93-8d06-b8f17b5d9ef7 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "7391a8ce-7ce5-47ec-97f6-6159645688ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.101s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:08:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:18 user nova-compute[72504]: DEBUG nova.compute.manager [req-e8b79f87-b8ae-4f91-9a26-5d33231774d0 req-503c9b17-3f5b-4eda-bf14-ef2ada37afd5 service nova] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Received event network-vif-plugged-76ce7613-6b10-4d90-b9ba-b6f676b8a4a6 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:08:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e8b79f87-b8ae-4f91-9a26-5d33231774d0 req-503c9b17-3f5b-4eda-bf14-ef2ada37afd5 service nova] Acquiring lock "8921bc74-c5a3-46f4-acdf-8a248d9173b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:08:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e8b79f87-b8ae-4f91-9a26-5d33231774d0 req-503c9b17-3f5b-4eda-bf14-ef2ada37afd5 service nova] Lock "8921bc74-c5a3-46f4-acdf-8a248d9173b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:08:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e8b79f87-b8ae-4f91-9a26-5d33231774d0 req-503c9b17-3f5b-4eda-bf14-ef2ada37afd5 service nova] Lock "8921bc74-c5a3-46f4-acdf-8a248d9173b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:08:18 user nova-compute[72504]: DEBUG nova.compute.manager [req-e8b79f87-b8ae-4f91-9a26-5d33231774d0 req-503c9b17-3f5b-4eda-bf14-ef2ada37afd5 service nova] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] No waiting events found dispatching network-vif-plugged-76ce7613-6b10-4d90-b9ba-b6f676b8a4a6 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:08:18 user nova-compute[72504]: WARNING nova.compute.manager [req-e8b79f87-b8ae-4f91-9a26-5d33231774d0 req-503c9b17-3f5b-4eda-bf14-ef2ada37afd5 service nova] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Received unexpected event network-vif-plugged-76ce7613-6b10-4d90-b9ba-b6f676b8a4a6 for instance with vm_state building and task_state spawning.
Aug 01 20:08:18 user nova-compute[72504]: DEBUG nova.compute.manager [req-e8b79f87-b8ae-4f91-9a26-5d33231774d0 req-503c9b17-3f5b-4eda-bf14-ef2ada37afd5 service nova] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Received event network-vif-plugged-76ce7613-6b10-4d90-b9ba-b6f676b8a4a6 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:08:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e8b79f87-b8ae-4f91-9a26-5d33231774d0 req-503c9b17-3f5b-4eda-bf14-ef2ada37afd5 service nova] Acquiring lock "8921bc74-c5a3-46f4-acdf-8a248d9173b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:08:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e8b79f87-b8ae-4f91-9a26-5d33231774d0 req-503c9b17-3f5b-4eda-bf14-ef2ada37afd5 service nova] Lock "8921bc74-c5a3-46f4-acdf-8a248d9173b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:08:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e8b79f87-b8ae-4f91-9a26-5d33231774d0 req-503c9b17-3f5b-4eda-bf14-ef2ada37afd5 service nova] Lock "8921bc74-c5a3-46f4-acdf-8a248d9173b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:08:18 user nova-compute[72504]: DEBUG nova.compute.manager [req-e8b79f87-b8ae-4f91-9a26-5d33231774d0 req-503c9b17-3f5b-4eda-bf14-ef2ada37afd5 service nova] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] No waiting events found dispatching network-vif-plugged-76ce7613-6b10-4d90-b9ba-b6f676b8a4a6 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:08:18 user nova-compute[72504]: WARNING nova.compute.manager [req-e8b79f87-b8ae-4f91-9a26-5d33231774d0 req-503c9b17-3f5b-4eda-bf14-ef2ada37afd5 service nova] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Received unexpected event network-vif-plugged-76ce7613-6b10-4d90-b9ba-b6f676b8a4a6 for instance with vm_state building and task_state spawning.
Aug 01 20:08:18 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920498.101903, 8921bc74-c5a3-46f4-acdf-8a248d9173b7 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:08:18 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] VM Resumed (Lifecycle Event)
Aug 01 20:08:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:08:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:08:18 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Instance spawned successfully.
Aug 01 20:08:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 20:08:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:08:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:08:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:08:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:08:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:08:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:08:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:08:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:08:18 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:08:18 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920498.104963, 8921bc74-c5a3-46f4-acdf-8a248d9173b7 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:08:18 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] VM Started (Lifecycle Event)
Aug 01 20:08:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:08:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:08:18 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:08:18 user nova-compute[72504]: INFO nova.compute.manager [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Took 5.89 seconds to spawn the instance on the hypervisor.
Aug 01 20:08:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:08:18 user nova-compute[72504]: INFO nova.compute.manager [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Took 6.58 seconds to build instance.
Aug 01 20:08:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e5286903-591b-4b7d-9596-894b0f82fba1 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "8921bc74-c5a3-46f4-acdf-8a248d9173b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.678s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:08:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG nova.compute.manager [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:08:21 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Creating image(s)
Aug 01 20:08:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Did not create local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Ensure instance console log exists: /opt/stack/data/nova/instances/612e4609-6881-4373-9da0-ee5d762f7126/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Start _get_guest_xml network_info=[{"id": "1d876bbd-c0b1-4c03-b47a-c413c6b9147c", "address": "fa:16:3e:19:90:9c", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d876bbd-c0", "ovs_interfaceid": "1d876bbd-c0b1-4c03-b47a-c413c6b9147c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsjEPdOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '612e4609-6881-4373-9da0-ee5d762f7126', 'attached_at': '', 'detached_at': '', 'volume_id': '7500d458-7e1b-43b3-a8a9-93d89adbbc1b', 'serial': '7500d458-7e1b-43b3-a8a9-93d89adbbc1b'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': '6ab421f2-06c4-4ab4-98e0-c8e07604101b', 'volume_type': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:08:21 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:08:21 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:08:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsjEPdOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:08:21 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:08:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:08:21 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:08:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:08:21 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:08:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[140772a5-3217-49d7-ae85-10156d630c12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:08:21 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd486cc-86b7-463d-8132-f4756c03c284]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:08:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b] added
Aug 01 20:08:21 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3dbf23-6e7a-4c3e-94b9-e8e44ba498b4]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d25bf91-87bd-498f-a382-39d73a87a1e4]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bsjEPdOm {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bsjEPdOm" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e28584f-f79d-4967-b2af-bcf588bd3bcc]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bsjEPdOm'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6c79ae-1084-4e6d-8dd3-a8992f1fe72c]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbade97d-ea5c-49a1-a07b-454fa12b2348]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:08:22 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:08:22 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e097d68-8562-46ca-838e-2cc90c819cb9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b, portal: 172.16.0.220,3260]
Aug 01 20:08:22 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b, portal: 172.16.0.220,3260] successful.
Aug 01 20:08:22 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d363a2-116c-44d4-8301-f5260309129e]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0be6ad-034a-4d2b-9163-5c6d8f7b1fd9]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:08:22 user nova-compute[72504]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b (non-flash)
Aug 01 20:08:22 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:08:22 user nova-compute[72504]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b (non-flash)
Aug 01 20:08:22 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a29468-53f4-434f-b389-f91833b938b8]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:08:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsjEPdOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:08:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:08:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23139333730383030', 'path': '/dev/sdb'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:08:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139333730383030', 'path': '/dev/sdb'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:08:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:08:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-245398826',display_name='tempest-TestVolumeBootPattern-volume-backed-server-245398826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-245398826',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcXkKRIpyBHclSozhB5zfhurVAHAgD2lmjYT+Hj6mcbjAufUPXFqJvxWKb93NkDo5lGDRNkfZ7O4MVjLeMYtHH708iSsKPmUfVW+FbAfcnw2cAvhBzV8T38XKDl5vEx6w==',key_name='tempest-keypair-1801534996',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb59fbc2bf9749f3af7d56435cb37066',ramdisk_id='',reservation_id='r-4csin909',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-685885098',owner_user_name='tempest-TestVolumeBootPattern-685885098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:08:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f06381c8a6214ddea7f1b36b623ed4d5',uuid=612e4609-6881-4373-9da0-ee5d762f7126,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d876bbd-c0b1-4c03-b47a-c413c6b9147c", "address": "fa:16:3e:19:90:9c", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d876bbd-c0", "ovs_interfaceid": "1d876bbd-c0b1-4c03-b47a-c413c6b9147c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:08:23 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converting VIF {"id": "1d876bbd-c0b1-4c03-b47a-c413c6b9147c", "address": "fa:16:3e:19:90:9c", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d876bbd-c0", "ovs_interfaceid": "1d876bbd-c0b1-4c03-b47a-c413c6b9147c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:08:23 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:90:9c,bridge_name='br-int',has_traffic_filtering=True,id=1d876bbd-c0b1-4c03-b47a-c413c6b9147c,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d876bbd-c0') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:08:23 user nova-compute[72504]: DEBUG nova.objects.instance [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lazy-loading 'pci_devices' on Instance uuid 612e4609-6881-4373-9da0-ee5d762f7126 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:08:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:08:23 user nova-compute[72504]:   <uuid>612e4609-6881-4373-9da0-ee5d762f7126</uuid>
Aug 01 20:08:23 user nova-compute[72504]:   <name>instance-00000024</name>
Aug 01 20:08:23 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:08:23 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:08:23 user nova-compute[72504]:   <metadata>
Aug 01 20:08:23 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:08:23 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:08:23 user nova-compute[72504]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-245398826</nova:name>
Aug 01 20:08:23 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:08:21</nova:creationTime>
Aug 01 20:08:23 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:08:23 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:08:23 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:08:23 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:08:23 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:08:23 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:08:23 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:08:23 user nova-compute[72504]:       <nova:owner>
Aug 01 20:08:23 user nova-compute[72504]:         <nova:user uuid="f06381c8a6214ddea7f1b36b623ed4d5">tempest-TestVolumeBootPattern-685885098-project-member</nova:user>
Aug 01 20:08:23 user nova-compute[72504]:         <nova:project uuid="eb59fbc2bf9749f3af7d56435cb37066">tempest-TestVolumeBootPattern-685885098</nova:project>
Aug 01 20:08:23 user nova-compute[72504]:       </nova:owner>
Aug 01 20:08:23 user nova-compute[72504]:       <nova:ports>
Aug 01 20:08:23 user nova-compute[72504]:         <nova:port uuid="1d876bbd-c0b1-4c03-b47a-c413c6b9147c">
Aug 01 20:08:23 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 20:08:23 user nova-compute[72504]:         </nova:port>
Aug 01 20:08:23 user nova-compute[72504]:       </nova:ports>
Aug 01 20:08:23 user nova-compute[72504]:     </nova:instance>
Aug 01 20:08:23 user nova-compute[72504]:   </metadata>
Aug 01 20:08:23 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:08:23 user nova-compute[72504]:     <system>
Aug 01 20:08:23 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:08:23 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:08:23 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:08:23 user nova-compute[72504]:       <entry name="serial">612e4609-6881-4373-9da0-ee5d762f7126</entry>
Aug 01 20:08:23 user nova-compute[72504]:       <entry name="uuid">612e4609-6881-4373-9da0-ee5d762f7126</entry>
Aug 01 20:08:23 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:08:23 user nova-compute[72504]:     </system>
Aug 01 20:08:23 user nova-compute[72504]:   </sysinfo>
Aug 01 20:08:23 user nova-compute[72504]:   <os>
Aug 01 20:08:23 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:08:23 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:08:23 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:08:23 user nova-compute[72504]:   </os>
Aug 01 20:08:23 user nova-compute[72504]:   <features>
Aug 01 20:08:23 user nova-compute[72504]:     <acpi/>
Aug 01 20:08:23 user nova-compute[72504]:     <apic/>
Aug 01 20:08:23 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:08:23 user nova-compute[72504]:   </features>
Aug 01 20:08:23 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:08:23 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:08:23 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:08:23 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:08:23 user nova-compute[72504]:   </clock>
Aug 01 20:08:23 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:08:23 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:08:23 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:08:23 user nova-compute[72504]:   </cpu>
Aug 01 20:08:23 user nova-compute[72504]:   <devices>
Aug 01 20:08:23 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 20:08:23 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:08:23 user nova-compute[72504]:       <source dev="/dev/sdb"/>
Aug 01 20:08:23 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:08:23 user nova-compute[72504]:       <serial>7500d458-7e1b-43b3-a8a9-93d89adbbc1b</serial>
Aug 01 20:08:23 user nova-compute[72504]:     </disk>
Aug 01 20:08:23 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:08:23 user nova-compute[72504]:       <mac address="fa:16:3e:19:90:9c"/>
Aug 01 20:08:23 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:08:23 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:08:23 user nova-compute[72504]:       <target dev="tap1d876bbd-c0"/>
Aug 01 20:08:23 user nova-compute[72504]:     </interface>
Aug 01 20:08:23 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:08:23 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/612e4609-6881-4373-9da0-ee5d762f7126/console.log" append="off"/>
Aug 01 20:08:23 user nova-compute[72504]:     </serial>
Aug 01 20:08:23 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:08:23 user nova-compute[72504]:     <video>
Aug 01 20:08:23 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:08:23 user nova-compute[72504]:     </video>
Aug 01 20:08:23 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:08:23 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:08:23 user nova-compute[72504]:     </rng>
Aug 01 20:08:23 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:08:23 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:08:23 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:08:23 user nova-compute[72504]:     </memballoon>
Aug 01 20:08:23 user nova-compute[72504]:   </devices>
Aug 01 20:08:23 user nova-compute[72504]: </domain>
Aug 01 20:08:23 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:08:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:08:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-245398826',display_name='tempest-TestVolumeBootPattern-volume-backed-server-245398826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-245398826',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcXkKRIpyBHclSozhB5zfhurVAHAgD2lmjYT+Hj6mcbjAufUPXFqJvxWKb93NkDo5lGDRNkfZ7O4MVjLeMYtHH708iSsKPmUfVW+FbAfcnw2cAvhBzV8T38XKDl5vEx6w==',key_name='tempest-keypair-1801534996',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb59fbc2bf9749f3af7d56435cb37066',ramdisk_id='',reservation_id='r-4csin909',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-685885098',owner_user_name='tempest-TestVolumeBootPattern-685885098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:08:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f06381c8a6214ddea7f1b36b623ed4d5',uuid=612e4609-6881-4373-9da0-ee5d762f7126,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d876bbd-c0b1-4c03-b47a-c413c6b9147c", "address": "fa:16:3e:19:90:9c", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d876bbd-c0", "ovs_interfaceid": "1d876bbd-c0b1-4c03-b47a-c413c6b9147c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:08:23 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converting VIF {"id": "1d876bbd-c0b1-4c03-b47a-c413c6b9147c", "address": "fa:16:3e:19:90:9c", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d876bbd-c0", "ovs_interfaceid": "1d876bbd-c0b1-4c03-b47a-c413c6b9147c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:08:23 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:90:9c,bridge_name='br-int',has_traffic_filtering=True,id=1d876bbd-c0b1-4c03-b47a-c413c6b9147c,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d876bbd-c0') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:08:23 user nova-compute[72504]: DEBUG os_vif [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:90:9c,bridge_name='br-int',has_traffic_filtering=True,id=1d876bbd-c0b1-4c03-b47a-c413c6b9147c,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d876bbd-c0') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:08:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:08:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:08:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d876bbd-c0, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:08:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1d876bbd-c0, col_values=(('external_ids', {'iface-id': '1d876bbd-c0b1-4c03-b47a-c413c6b9147c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:90:9c', 'vm-uuid': '612e4609-6881-4373-9da0-ee5d762f7126'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:08:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:08:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:23 user nova-compute[72504]: INFO os_vif [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:90:9c,bridge_name='br-int',has_traffic_filtering=True,id=1d876bbd-c0b1-4c03-b47a-c413c6b9147c,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d876bbd-c0')
Aug 01 20:08:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:08:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] No VIF found with MAC fa:16:3e:19:90:9c, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:08:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:24 user nova-compute[72504]: DEBUG nova.compute.manager [req-23fa67c3-f94b-41ec-a54f-6837a4c578b4 req-ce746e8d-e748-48f0-aebd-65c9a6709e32 service nova] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Received event network-vif-plugged-1d876bbd-c0b1-4c03-b47a-c413c6b9147c {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:08:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-23fa67c3-f94b-41ec-a54f-6837a4c578b4 req-ce746e8d-e748-48f0-aebd-65c9a6709e32 service nova] Acquiring lock "612e4609-6881-4373-9da0-ee5d762f7126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:08:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-23fa67c3-f94b-41ec-a54f-6837a4c578b4 req-ce746e8d-e748-48f0-aebd-65c9a6709e32 service nova] Lock "612e4609-6881-4373-9da0-ee5d762f7126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:08:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-23fa67c3-f94b-41ec-a54f-6837a4c578b4 req-ce746e8d-e748-48f0-aebd-65c9a6709e32 service nova] Lock "612e4609-6881-4373-9da0-ee5d762f7126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:08:24 user nova-compute[72504]: DEBUG nova.compute.manager [req-23fa67c3-f94b-41ec-a54f-6837a4c578b4 req-ce746e8d-e748-48f0-aebd-65c9a6709e32 service nova] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] No waiting events found dispatching network-vif-plugged-1d876bbd-c0b1-4c03-b47a-c413c6b9147c {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:08:24 user nova-compute[72504]: WARNING nova.compute.manager [req-23fa67c3-f94b-41ec-a54f-6837a4c578b4 req-ce746e8d-e748-48f0-aebd-65c9a6709e32 service nova] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Received unexpected event network-vif-plugged-1d876bbd-c0b1-4c03-b47a-c413c6b9147c for instance with vm_state building and task_state spawning.
Aug 01 20:08:24 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:08:24 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:08:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:26 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920506.8201408, 612e4609-6881-4373-9da0-ee5d762f7126 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:08:26 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] VM Resumed (Lifecycle Event)
Aug 01 20:08:26 user nova-compute[72504]: DEBUG nova.compute.manager [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:08:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:08:26 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Instance spawned successfully.
Aug 01 20:08:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 20:08:26 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:08:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:08:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:08:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:08:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:08:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:08:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:08:26 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:08:26 user nova-compute[72504]: DEBUG nova.compute.manager [req-9ee74b69-ce3a-45aa-b4ee-3073813eb101 req-65543e9a-c720-48a8-ac99-98f6f734acac service nova] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Received event network-vif-plugged-1d876bbd-c0b1-4c03-b47a-c413c6b9147c {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:08:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-9ee74b69-ce3a-45aa-b4ee-3073813eb101 req-65543e9a-c720-48a8-ac99-98f6f734acac service nova] Acquiring lock "612e4609-6881-4373-9da0-ee5d762f7126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:08:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-9ee74b69-ce3a-45aa-b4ee-3073813eb101 req-65543e9a-c720-48a8-ac99-98f6f734acac service nova] Lock "612e4609-6881-4373-9da0-ee5d762f7126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:08:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-9ee74b69-ce3a-45aa-b4ee-3073813eb101 req-65543e9a-c720-48a8-ac99-98f6f734acac service nova] Lock "612e4609-6881-4373-9da0-ee5d762f7126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:08:26 user nova-compute[72504]: DEBUG nova.compute.manager [req-9ee74b69-ce3a-45aa-b4ee-3073813eb101 req-65543e9a-c720-48a8-ac99-98f6f734acac service nova] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] No waiting events found dispatching network-vif-plugged-1d876bbd-c0b1-4c03-b47a-c413c6b9147c {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:08:26 user nova-compute[72504]: WARNING nova.compute.manager [req-9ee74b69-ce3a-45aa-b4ee-3073813eb101 req-65543e9a-c720-48a8-ac99-98f6f734acac service nova] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Received unexpected event network-vif-plugged-1d876bbd-c0b1-4c03-b47a-c413c6b9147c for instance with vm_state building and task_state spawning.
Aug 01 20:08:26 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:08:26 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920506.8249075, 612e4609-6881-4373-9da0-ee5d762f7126 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:08:26 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] VM Started (Lifecycle Event)
Aug 01 20:08:26 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:08:26 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:08:26 user nova-compute[72504]: INFO nova.compute.manager [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Took 5.03 seconds to spawn the instance on the hypervisor.
Aug 01 20:08:26 user nova-compute[72504]: DEBUG nova.compute.manager [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:08:26 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:08:26 user nova-compute[72504]: INFO nova.compute.manager [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Took 13.89 seconds to build instance.
Aug 01 20:08:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b56837c7-c1cc-415f-9d12-499a31a51827 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "612e4609-6881-4373-9da0-ee5d762f7126" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.298s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:08:27 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:08:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:28 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:08:28 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:08:29 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690920494.3548281, 7391a8ce-7ce5-47ec-97f6-6159645688ea => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:08:29 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] VM Stopped (Lifecycle Event)
Aug 01 20:08:29 user nova-compute[72504]: DEBUG nova.compute.manager [None req-fd2c3ce8-2e88-4c24-86e5-073edc5be0dc None None] [instance: 7391a8ce-7ce5-47ec-97f6-6159645688ea] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:08:30 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:08:30 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:08:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:08:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:08:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:08:30 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:08:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:08:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:08:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-74a3d2ce-b75b-4fdf-a53f-ef8b41c3bc4e tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:08:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-74a3d2ce-b75b-4fdf-a53f-ef8b41c3bc4e tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:08:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-74a3d2ce-b75b-4fdf-a53f-ef8b41c3bc4e tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:08:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-74a3d2ce-b75b-4fdf-a53f-ef8b41c3bc4e tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:08:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-74a3d2ce-b75b-4fdf-a53f-ef8b41c3bc4e tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:08:33 user nova-compute[72504]: INFO nova.compute.manager [None req-74a3d2ce-b75b-4fdf-a53f-ef8b41c3bc4e tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Terminating instance
Aug 01 20:08:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-74a3d2ce-b75b-4fdf-a53f-ef8b41c3bc4e tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:08:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8921bc74-c5a3-46f4-acdf-8a248d9173b7/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8921bc74-c5a3-46f4-acdf-8a248d9173b7/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8921bc74-c5a3-46f4-acdf-8a248d9173b7/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:08:33 user nova-compute[72504]: DEBUG nova.compute.manager [req-f4715619-aba2-4e00-91e1-7dfc50be4df5 req-6af71a8f-812e-452f-90cd-d57cda06ca91 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received event network-vif-unplugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:08:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f4715619-aba2-4e00-91e1-7dfc50be4df5 req-6af71a8f-812e-452f-90cd-d57cda06ca91 service nova] Acquiring lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:08:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f4715619-aba2-4e00-91e1-7dfc50be4df5 req-6af71a8f-812e-452f-90cd-d57cda06ca91 service nova] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:08:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f4715619-aba2-4e00-91e1-7dfc50be4df5 req-6af71a8f-812e-452f-90cd-d57cda06ca91 service nova] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:08:33 user nova-compute[72504]: DEBUG nova.compute.manager [req-f4715619-aba2-4e00-91e1-7dfc50be4df5 req-6af71a8f-812e-452f-90cd-d57cda06ca91 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] No waiting events found dispatching network-vif-unplugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:08:33 user nova-compute[72504]: DEBUG nova.compute.manager [req-f4715619-aba2-4e00-91e1-7dfc50be4df5 req-6af71a8f-812e-452f-90cd-d57cda06ca91 service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received event network-vif-unplugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:08:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8921bc74-c5a3-46f4-acdf-8a248d9173b7/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:08:34 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:08:34 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:08:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=7674MB free_disk=25.13823699951172GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:08:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:08:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:08:34 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Instance destroyed successfully.
Aug 01 20:08:34 user nova-compute[72504]: DEBUG nova.objects.instance [None req-74a3d2ce-b75b-4fdf-a53f-ef8b41c3bc4e tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'resources' on Instance uuid e19bf04b-43e0-4153-a6b5-74dbe36fedb0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:08:34 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-74a3d2ce-b75b-4fdf-a53f-ef8b41c3bc4e tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-858127926',display_name='tempest-ServerRescueNegativeTestJSON-server-858127926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-858127926',id=28,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAulB7xKrQ3iwNSG1rJvFE3+trA8hmdkFqfWEnv5agU7clcZsDlocF6bKk7yN97AViHaHy9lGlueRa4sqKvs59bCNJwiRRu0euW/6zYzligMJY09K4XGFq7Tvk8Z/XH+rQ==',key_name='tempest-keypair-1316147877',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:04:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='274aed6773224c4fb534aac970d6bb34',ramdisk_id='',reservation_id='r-vx3ehgmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-897201375',owner_user_name='tempest-ServerRescueNegativeTestJSON-897201375-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:05:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be219e31095441269a1f140a77ad0d57',uuid=e19bf04b-43e0-4153-a6b5-74dbe36fedb0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "address": "fa:16:3e:c2:53:7c", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d66fd17-3c", "ovs_interfaceid": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:08:34 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-74a3d2ce-b75b-4fdf-a53f-ef8b41c3bc4e tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Converting VIF {"id": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "address": "fa:16:3e:c2:53:7c", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d66fd17-3c", "ovs_interfaceid": "6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:08:34 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-74a3d2ce-b75b-4fdf-a53f-ef8b41c3bc4e tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:53:7c,bridge_name='br-int',has_traffic_filtering=True,id=6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc,network=Network(9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d66fd17-3c') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:08:34 user nova-compute[72504]: DEBUG os_vif [None req-74a3d2ce-b75b-4fdf-a53f-ef8b41c3bc4e tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:53:7c,bridge_name='br-int',has_traffic_filtering=True,id=6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc,network=Network(9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d66fd17-3c') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:08:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d66fd17-3c, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:08:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:08:34 user nova-compute[72504]: INFO os_vif [None req-74a3d2ce-b75b-4fdf-a53f-ef8b41c3bc4e tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:53:7c,bridge_name='br-int',has_traffic_filtering=True,id=6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc,network=Network(9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d66fd17-3c')
Aug 01 20:08:34 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-74a3d2ce-b75b-4fdf-a53f-ef8b41c3bc4e tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Deleting instance files /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0_del
Aug 01 20:08:34 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-74a3d2ce-b75b-4fdf-a53f-ef8b41c3bc4e tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Deletion of /opt/stack/data/nova/instances/e19bf04b-43e0-4153-a6b5-74dbe36fedb0_del complete
Aug 01 20:08:34 user nova-compute[72504]: INFO nova.compute.manager [None req-74a3d2ce-b75b-4fdf-a53f-ef8b41c3bc4e tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Took 1.31 seconds to destroy the instance on the hypervisor.
Aug 01 20:08:34 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-74a3d2ce-b75b-4fdf-a53f-ef8b41c3bc4e tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:08:34 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:08:34 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:08:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:08:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:08:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 128c2981-363c-4ae9-b46d-15b5e5d9cac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:08:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 88f95d20-e391-4100-93b2-da29bfcf9704 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:08:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance e19bf04b-43e0-4153-a6b5-74dbe36fedb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:08:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1ac6e0af-4adb-47a7-988e-971aa5efeb2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:08:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 8b163903-b08f-44b6-a5b5-56dc897d5640 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:08:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 8921bc74-c5a3-46f4-acdf-8a248d9173b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:08:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 612e4609-6881-4373-9da0-ee5d762f7126 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:08:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:08:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:08:34 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:08:34 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:08:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:08:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.477s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:08:35 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:08:35 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Took 0.91 seconds to deallocate network for instance.
Aug 01 20:08:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-74a3d2ce-b75b-4fdf-a53f-ef8b41c3bc4e tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:08:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-74a3d2ce-b75b-4fdf-a53f-ef8b41c3bc4e tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:08:35 user nova-compute[72504]: DEBUG nova.compute.manager [req-0723d071-ece8-4774-b981-6d057b53edc8 req-083956f4-c88e-429e-b07d-96a5f0ac191e service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received event network-vif-plugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:08:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0723d071-ece8-4774-b981-6d057b53edc8 req-083956f4-c88e-429e-b07d-96a5f0ac191e service nova] Acquiring lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:08:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0723d071-ece8-4774-b981-6d057b53edc8 req-083956f4-c88e-429e-b07d-96a5f0ac191e service nova] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:08:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0723d071-ece8-4774-b981-6d057b53edc8 req-083956f4-c88e-429e-b07d-96a5f0ac191e service nova] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:08:35 user nova-compute[72504]: DEBUG nova.compute.manager [req-0723d071-ece8-4774-b981-6d057b53edc8 req-083956f4-c88e-429e-b07d-96a5f0ac191e service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] No waiting events found dispatching network-vif-plugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:08:35 user nova-compute[72504]: WARNING nova.compute.manager [req-0723d071-ece8-4774-b981-6d057b53edc8 req-083956f4-c88e-429e-b07d-96a5f0ac191e service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received unexpected event network-vif-plugged-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc for instance with vm_state deleted and task_state None.
Aug 01 20:08:35 user nova-compute[72504]: DEBUG nova.compute.manager [req-0723d071-ece8-4774-b981-6d057b53edc8 req-083956f4-c88e-429e-b07d-96a5f0ac191e service nova] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Received event network-vif-deleted-6d66fd17-3c7e-4d7e-8bfe-a0b7fd434bfc {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:08:35 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-74a3d2ce-b75b-4fdf-a53f-ef8b41c3bc4e tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:08:35 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-74a3d2ce-b75b-4fdf-a53f-ef8b41c3bc4e tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:08:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-74a3d2ce-b75b-4fdf-a53f-ef8b41c3bc4e tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:08:35 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-74a3d2ce-b75b-4fdf-a53f-ef8b41c3bc4e tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Deleted allocations for instance e19bf04b-43e0-4153-a6b5-74dbe36fedb0
Aug 01 20:08:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-74a3d2ce-b75b-4fdf-a53f-ef8b41c3bc4e tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "e19bf04b-43e0-4153-a6b5-74dbe36fedb0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.689s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:08:36 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:08:36 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:08:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-1ac6e0af-4adb-47a7-988e-971aa5efeb2c" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:08:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-1ac6e0af-4adb-47a7-988e-971aa5efeb2c" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:08:36 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:08:37 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Updating instance_info_cache with network_info: [{"id": "2fbee8e8-4a4b-44d6-812b-f50729e5b45f", "address": "fa:16:3e:b0:b8:e6", "network": {"id": "b8489ede-9e34-4dfa-b6d7-d0948a7bad05", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1846924261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea0f5bb5775e4071ab28bea2d9dd2512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbee8e8-4a", "ovs_interfaceid": "2fbee8e8-4a4b-44d6-812b-f50729e5b45f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:08:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-1ac6e0af-4adb-47a7-988e-971aa5efeb2c" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:08:37 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:08:37 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:08:37 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:08:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:49 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690920513.83054, e19bf04b-43e0-4153-a6b5-74dbe36fedb0 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:08:49 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] VM Stopped (Lifecycle Event)
Aug 01 20:08:49 user nova-compute[72504]: DEBUG nova.compute.manager [None req-a1c1a263-7189-4277-b1e9-46863efebb05 None None] [instance: e19bf04b-43e0-4153-a6b5-74dbe36fedb0] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:08:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:08:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:09:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:09:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:09:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:09:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:09:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:09:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:09:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-40830053-7450-426f-bb88-b207bc308095 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "39b3076d-ce59-4e7c-976f-9355bf2f6ff4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:09:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-40830053-7450-426f-bb88-b207bc308095 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "39b3076d-ce59-4e7c-976f-9355bf2f6ff4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:09:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-40830053-7450-426f-bb88-b207bc308095 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "39b3076d-ce59-4e7c-976f-9355bf2f6ff4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:09:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-40830053-7450-426f-bb88-b207bc308095 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "39b3076d-ce59-4e7c-976f-9355bf2f6ff4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:09:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-40830053-7450-426f-bb88-b207bc308095 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "39b3076d-ce59-4e7c-976f-9355bf2f6ff4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:09:04 user nova-compute[72504]: INFO nova.compute.manager [None req-40830053-7450-426f-bb88-b207bc308095 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Terminating instance
Aug 01 20:09:04 user nova-compute[72504]: DEBUG nova.compute.manager [None req-40830053-7450-426f-bb88-b207bc308095 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:09:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:09:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:09:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:09:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:09:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-0211bf2d-7745-4adc-bcae-2fd27b426f7f req-5ecad6ef-ec6e-4b8e-9f1d-588d58d7447c service nova] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Received event network-vif-unplugged-a4953c19-ef72-4bbe-b271-40cc5162842d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:09:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0211bf2d-7745-4adc-bcae-2fd27b426f7f req-5ecad6ef-ec6e-4b8e-9f1d-588d58d7447c service nova] Acquiring lock "39b3076d-ce59-4e7c-976f-9355bf2f6ff4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:09:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0211bf2d-7745-4adc-bcae-2fd27b426f7f req-5ecad6ef-ec6e-4b8e-9f1d-588d58d7447c service nova] Lock "39b3076d-ce59-4e7c-976f-9355bf2f6ff4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:09:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0211bf2d-7745-4adc-bcae-2fd27b426f7f req-5ecad6ef-ec6e-4b8e-9f1d-588d58d7447c service nova] Lock "39b3076d-ce59-4e7c-976f-9355bf2f6ff4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:09:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-0211bf2d-7745-4adc-bcae-2fd27b426f7f req-5ecad6ef-ec6e-4b8e-9f1d-588d58d7447c service nova] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] No waiting events found dispatching network-vif-unplugged-a4953c19-ef72-4bbe-b271-40cc5162842d {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:09:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-0211bf2d-7745-4adc-bcae-2fd27b426f7f req-5ecad6ef-ec6e-4b8e-9f1d-588d58d7447c service nova] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Received event network-vif-unplugged-a4953c19-ef72-4bbe-b271-40cc5162842d for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:09:05 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Instance destroyed successfully.
Aug 01 20:09:05 user nova-compute[72504]: DEBUG nova.objects.instance [None req-40830053-7450-426f-bb88-b207bc308095 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lazy-loading 'resources' on Instance uuid 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:09:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-40830053-7450-426f-bb88-b207bc308095 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:49:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-348118529',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-348118529',id=2,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:49:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b82898c99bce4f04afda7e9ff6e4d5db',ramdisk_id='',reservation_id='r-kgrbxdal',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-519115368',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:51:25Z,user_data=None,user_id='01263cb2c1874026be1c735abc966b45',uuid=39b3076d-ce59-4e7c-976f-9355bf2f6ff4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4953c19-ef72-4bbe-b271-40cc5162842d", "address": "fa:16:3e:86:10:53", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4953c19-ef", "ovs_interfaceid": "a4953c19-ef72-4bbe-b271-40cc5162842d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:09:05 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-40830053-7450-426f-bb88-b207bc308095 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Converting VIF {"id": "a4953c19-ef72-4bbe-b271-40cc5162842d", "address": "fa:16:3e:86:10:53", "network": {"id": "35d073f8-6d3d-4eea-a3f7-51d756f1bb92", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1260223736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82898c99bce4f04afda7e9ff6e4d5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4953c19-ef", "ovs_interfaceid": "a4953c19-ef72-4bbe-b271-40cc5162842d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:09:05 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-40830053-7450-426f-bb88-b207bc308095 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:10:53,bridge_name='br-int',has_traffic_filtering=True,id=a4953c19-ef72-4bbe-b271-40cc5162842d,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4953c19-ef') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:09:05 user nova-compute[72504]: DEBUG os_vif [None req-40830053-7450-426f-bb88-b207bc308095 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:10:53,bridge_name='br-int',has_traffic_filtering=True,id=a4953c19-ef72-4bbe-b271-40cc5162842d,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4953c19-ef') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:09:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:09:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4953c19-ef, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:09:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:09:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:09:05 user nova-compute[72504]: INFO os_vif [None req-40830053-7450-426f-bb88-b207bc308095 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:10:53,bridge_name='br-int',has_traffic_filtering=True,id=a4953c19-ef72-4bbe-b271-40cc5162842d,network=Network(35d073f8-6d3d-4eea-a3f7-51d756f1bb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4953c19-ef')
Aug 01 20:09:05 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-40830053-7450-426f-bb88-b207bc308095 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Deleting instance files /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4_del
Aug 01 20:09:05 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-40830053-7450-426f-bb88-b207bc308095 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Deletion of /opt/stack/data/nova/instances/39b3076d-ce59-4e7c-976f-9355bf2f6ff4_del complete
Aug 01 20:09:05 user nova-compute[72504]: INFO nova.compute.manager [None req-40830053-7450-426f-bb88-b207bc308095 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 01 20:09:05 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-40830053-7450-426f-bb88-b207bc308095 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:09:05 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:09:05 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:09:05 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:09:05 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Took 0.46 seconds to deallocate network for instance.
Aug 01 20:09:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-40830053-7450-426f-bb88-b207bc308095 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:09:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-40830053-7450-426f-bb88-b207bc308095 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:09:06 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-40830053-7450-426f-bb88-b207bc308095 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:09:06 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-40830053-7450-426f-bb88-b207bc308095 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:09:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-40830053-7450-426f-bb88-b207bc308095 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:09:06 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-40830053-7450-426f-bb88-b207bc308095 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Deleted allocations for instance 39b3076d-ce59-4e7c-976f-9355bf2f6ff4
Aug 01 20:09:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-40830053-7450-426f-bb88-b207bc308095 tempest-ServerBootFromVolumeStableRescueTest-519115368 tempest-ServerBootFromVolumeStableRescueTest-519115368-project-member] Lock "39b3076d-ce59-4e7c-976f-9355bf2f6ff4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.761s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:09:06 user nova-compute[72504]: DEBUG nova.compute.manager [req-6d0fe56b-b353-4c0b-98ce-e0601ad666ea req-5bae263a-93e4-472b-b7bb-5aca6f90c540 service nova] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Received event network-vif-plugged-a4953c19-ef72-4bbe-b271-40cc5162842d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:09:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6d0fe56b-b353-4c0b-98ce-e0601ad666ea req-5bae263a-93e4-472b-b7bb-5aca6f90c540 service nova] Acquiring lock "39b3076d-ce59-4e7c-976f-9355bf2f6ff4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:09:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6d0fe56b-b353-4c0b-98ce-e0601ad666ea req-5bae263a-93e4-472b-b7bb-5aca6f90c540 service nova] Lock "39b3076d-ce59-4e7c-976f-9355bf2f6ff4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:09:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6d0fe56b-b353-4c0b-98ce-e0601ad666ea req-5bae263a-93e4-472b-b7bb-5aca6f90c540 service nova] Lock "39b3076d-ce59-4e7c-976f-9355bf2f6ff4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:09:06 user nova-compute[72504]: DEBUG nova.compute.manager [req-6d0fe56b-b353-4c0b-98ce-e0601ad666ea req-5bae263a-93e4-472b-b7bb-5aca6f90c540 service nova] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] No waiting events found dispatching network-vif-plugged-a4953c19-ef72-4bbe-b271-40cc5162842d {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:09:06 user nova-compute[72504]: WARNING nova.compute.manager [req-6d0fe56b-b353-4c0b-98ce-e0601ad666ea req-5bae263a-93e4-472b-b7bb-5aca6f90c540 service nova] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Received unexpected event network-vif-plugged-a4953c19-ef72-4bbe-b271-40cc5162842d for instance with vm_state deleted and task_state None.
Aug 01 20:09:06 user nova-compute[72504]: DEBUG nova.compute.manager [req-6d0fe56b-b353-4c0b-98ce-e0601ad666ea req-5bae263a-93e4-472b-b7bb-5aca6f90c540 service nova] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Received event network-vif-deleted-a4953c19-ef72-4bbe-b271-40cc5162842d {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:09:10 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:09:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:09:20 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690920545.1980636, 39b3076d-ce59-4e7c-976f-9355bf2f6ff4 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:09:20 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] VM Stopped (Lifecycle Event)
Aug 01 20:09:20 user nova-compute[72504]: DEBUG nova.compute.manager [None req-a8a721c3-9492-4211-be9f-0e596180297a None None] [instance: 39b3076d-ce59-4e7c-976f-9355bf2f6ff4] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:09:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:09:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:09:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:09:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:09:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:09:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:09:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:09:24 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:09:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:09:26 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:09:27 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:09:29 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:09:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:09:30 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:09:30 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:09:30 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:09:31 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:09:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:09:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:09:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:09:31 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:09:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:09:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:09:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:09:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:09:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:09:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:09:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:09:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:09:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8921bc74-c5a3-46f4-acdf-8a248d9173b7/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:09:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8921bc74-c5a3-46f4-acdf-8a248d9173b7/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:09:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8921bc74-c5a3-46f4-acdf-8a248d9173b7/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:09:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8921bc74-c5a3-46f4-acdf-8a248d9173b7/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:09:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:09:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:09:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:09:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:09:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:09:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:09:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:09:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:09:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:09:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:09:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:09:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:09:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:09:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:09:34 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:09:34 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:09:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=7906MB free_disk=25.25417709350586GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-20f08173-41ce-40d1-a58e-59f457fbb144 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-20f08173-41ce-40d1-a58e-59f457fbb144 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-20f08173-41ce-40d1-a58e-59f457fbb144 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-20f08173-41ce-40d1-a58e-59f457fbb144 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-20f08173-41ce-40d1-a58e-59f457fbb144 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:09:34 user nova-compute[72504]: INFO nova.compute.manager [None req-20f08173-41ce-40d1-a58e-59f457fbb144 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Terminating instance
Aug 01 20:09:34 user nova-compute[72504]: DEBUG nova.compute.manager [None req-20f08173-41ce-40d1-a58e-59f457fbb144 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 128c2981-363c-4ae9-b46d-15b5e5d9cac6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 88f95d20-e391-4100-93b2-da29bfcf9704 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1ac6e0af-4adb-47a7-988e-971aa5efeb2c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 8b163903-b08f-44b6-a5b5-56dc897d5640 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 8921bc74-c5a3-46f4-acdf-8a248d9173b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 612e4609-6881-4373-9da0-ee5d762f7126 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG nova.compute.manager [req-00391bf7-3235-4f7d-b823-d815aed62898 req-11966844-090f-4cd8-bdf5-31f878d2d807 service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Received event network-vif-unplugged-88a4a208-7192-4e81-b9b2-1e07e7e307d1 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-00391bf7-3235-4f7d-b823-d815aed62898 req-11966844-090f-4cd8-bdf5-31f878d2d807 service nova] Acquiring lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-00391bf7-3235-4f7d-b823-d815aed62898 req-11966844-090f-4cd8-bdf5-31f878d2d807 service nova] Lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-00391bf7-3235-4f7d-b823-d815aed62898 req-11966844-090f-4cd8-bdf5-31f878d2d807 service nova] Lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG nova.compute.manager [req-00391bf7-3235-4f7d-b823-d815aed62898 req-11966844-090f-4cd8-bdf5-31f878d2d807 service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] No waiting events found dispatching network-vif-unplugged-88a4a208-7192-4e81-b9b2-1e07e7e307d1 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG nova.compute.manager [req-00391bf7-3235-4f7d-b823-d815aed62898 req-11966844-090f-4cd8-bdf5-31f878d2d807 service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Received event network-vif-unplugged-88a4a208-7192-4e81-b9b2-1e07e7e307d1 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.444s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:09:34 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Instance destroyed successfully.
Aug 01 20:09:34 user nova-compute[72504]: DEBUG nova.objects.instance [None req-20f08173-41ce-40d1-a58e-59f457fbb144 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'resources' on Instance uuid 128c2981-363c-4ae9-b46d-15b5e5d9cac6 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-20f08173-41ce-40d1-a58e-59f457fbb144 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:53:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2007920168',display_name='tempest-ServerRescueNegativeTestJSON-server-2007920168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2007920168',id=15,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:55:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='274aed6773224c4fb534aac970d6bb34',ramdisk_id='',reservation_id='r-dg8uckty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-897201375',owner_user_name='tempest-ServerRescueNegativeTestJSON-897201375-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:55:18Z,user_data=None,user_id='be219e31095441269a1f140a77ad0d57',uuid=128c2981-363c-4ae9-b46d-15b5e5d9cac6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "address": "fa:16:3e:c0:3a:dc", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88a4a208-71", "ovs_interfaceid": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-20f08173-41ce-40d1-a58e-59f457fbb144 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Converting VIF {"id": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "address": "fa:16:3e:c0:3a:dc", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88a4a208-71", "ovs_interfaceid": "88a4a208-7192-4e81-b9b2-1e07e7e307d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-20f08173-41ce-40d1-a58e-59f457fbb144 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:3a:dc,bridge_name='br-int',has_traffic_filtering=True,id=88a4a208-7192-4e81-b9b2-1e07e7e307d1,network=Network(9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88a4a208-71') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG os_vif [None req-20f08173-41ce-40d1-a58e-59f457fbb144 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:3a:dc,bridge_name='br-int',has_traffic_filtering=True,id=88a4a208-7192-4e81-b9b2-1e07e7e307d1,network=Network(9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88a4a208-71') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88a4a208-71, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:09:34 user nova-compute[72504]: INFO os_vif [None req-20f08173-41ce-40d1-a58e-59f457fbb144 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:3a:dc,bridge_name='br-int',has_traffic_filtering=True,id=88a4a208-7192-4e81-b9b2-1e07e7e307d1,network=Network(9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88a4a208-71')
Aug 01 20:09:34 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-20f08173-41ce-40d1-a58e-59f457fbb144 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Deleting instance files /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6_del
Aug 01 20:09:34 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-20f08173-41ce-40d1-a58e-59f457fbb144 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Deletion of /opt/stack/data/nova/instances/128c2981-363c-4ae9-b46d-15b5e5d9cac6_del complete
Aug 01 20:09:34 user nova-compute[72504]: INFO nova.compute.manager [None req-20f08173-41ce-40d1-a58e-59f457fbb144 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 01 20:09:34 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-20f08173-41ce-40d1-a58e-59f457fbb144 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:09:34 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:09:35 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:09:35 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Took 0.48 seconds to deallocate network for instance.
Aug 01 20:09:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-20f08173-41ce-40d1-a58e-59f457fbb144 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:09:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-20f08173-41ce-40d1-a58e-59f457fbb144 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:09:35 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-20f08173-41ce-40d1-a58e-59f457fbb144 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:09:35 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-20f08173-41ce-40d1-a58e-59f457fbb144 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:09:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-20f08173-41ce-40d1-a58e-59f457fbb144 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:09:35 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-20f08173-41ce-40d1-a58e-59f457fbb144 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Deleted allocations for instance 128c2981-363c-4ae9-b46d-15b5e5d9cac6
Aug 01 20:09:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-20f08173-41ce-40d1-a58e-59f457fbb144 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.697s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:09:36 user nova-compute[72504]: DEBUG nova.compute.manager [req-84187ace-85c8-4332-89bd-1b3477da0fa8 req-b0b8c42b-ee37-4087-947d-337234a05122 service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Received event network-vif-plugged-88a4a208-7192-4e81-b9b2-1e07e7e307d1 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:09:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-84187ace-85c8-4332-89bd-1b3477da0fa8 req-b0b8c42b-ee37-4087-947d-337234a05122 service nova] Acquiring lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:09:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-84187ace-85c8-4332-89bd-1b3477da0fa8 req-b0b8c42b-ee37-4087-947d-337234a05122 service nova] Lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:09:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-84187ace-85c8-4332-89bd-1b3477da0fa8 req-b0b8c42b-ee37-4087-947d-337234a05122 service nova] Lock "128c2981-363c-4ae9-b46d-15b5e5d9cac6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:09:36 user nova-compute[72504]: DEBUG nova.compute.manager [req-84187ace-85c8-4332-89bd-1b3477da0fa8 req-b0b8c42b-ee37-4087-947d-337234a05122 service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] No waiting events found dispatching network-vif-plugged-88a4a208-7192-4e81-b9b2-1e07e7e307d1 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:09:36 user nova-compute[72504]: WARNING nova.compute.manager [req-84187ace-85c8-4332-89bd-1b3477da0fa8 req-b0b8c42b-ee37-4087-947d-337234a05122 service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Received unexpected event network-vif-plugged-88a4a208-7192-4e81-b9b2-1e07e7e307d1 for instance with vm_state deleted and task_state None.
Aug 01 20:09:36 user nova-compute[72504]: DEBUG nova.compute.manager [req-84187ace-85c8-4332-89bd-1b3477da0fa8 req-b0b8c42b-ee37-4087-947d-337234a05122 service nova] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Received event network-vif-deleted-88a4a208-7192-4e81-b9b2-1e07e7e307d1 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:09:36 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:09:36 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:09:36 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 20:09:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:09:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:09:36 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:09:36 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lazy-loading 'info_cache' on Instance uuid 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:09:37 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Updating instance_info_cache with network_info: [{"id": "f0cefd5c-7285-4f5e-b771-61f61039f900", "address": "fa:16:3e:9a:5b:08", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cefd5c-72", "ovs_interfaceid": "f0cefd5c-7285-4f5e-b771-61f61039f900", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:09:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:09:37 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:09:37 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:09:38 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:09:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:09:39 user nova-compute[72504]: INFO nova.compute.manager [None req-85d52ad1-8235-41dc-9832-9f081066e480 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Get console output
Aug 01 20:09:40 user nova-compute[72504]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 01 20:09:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:09:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:09:49 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690920574.8581288, 128c2981-363c-4ae9-b46d-15b5e5d9cac6 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:09:49 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] VM Stopped (Lifecycle Event)
Aug 01 20:09:49 user nova-compute[72504]: DEBUG nova.compute.manager [None req-f9c6d1e1-52f1-4fdb-ae5b-e932100c5b75 None None] [instance: 128c2981-363c-4ae9-b46d-15b5e5d9cac6] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:09:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:09:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:09:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:09:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:09:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:09:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:09:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:09:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:09:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-dd7748e5-8cac-479c-87c6-c9704fb10bd3 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Acquiring lock "8921bc74-c5a3-46f4-acdf-8a248d9173b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-dd7748e5-8cac-479c-87c6-c9704fb10bd3 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "8921bc74-c5a3-46f4-acdf-8a248d9173b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-dd7748e5-8cac-479c-87c6-c9704fb10bd3 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Acquiring lock "8921bc74-c5a3-46f4-acdf-8a248d9173b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-dd7748e5-8cac-479c-87c6-c9704fb10bd3 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "8921bc74-c5a3-46f4-acdf-8a248d9173b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-dd7748e5-8cac-479c-87c6-c9704fb10bd3 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "8921bc74-c5a3-46f4-acdf-8a248d9173b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:02 user nova-compute[72504]: INFO nova.compute.manager [None req-dd7748e5-8cac-479c-87c6-c9704fb10bd3 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Terminating instance
Aug 01 20:10:02 user nova-compute[72504]: DEBUG nova.compute.manager [None req-dd7748e5-8cac-479c-87c6-c9704fb10bd3 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:10:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:02 user nova-compute[72504]: DEBUG nova.compute.manager [req-702447d0-d6c0-4b0c-9bd6-b37b78b6d3f2 req-7036f812-9b93-412a-bbfc-d98ed13eafcc service nova] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Received event network-vif-unplugged-76ce7613-6b10-4d90-b9ba-b6f676b8a4a6 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:10:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-702447d0-d6c0-4b0c-9bd6-b37b78b6d3f2 req-7036f812-9b93-412a-bbfc-d98ed13eafcc service nova] Acquiring lock "8921bc74-c5a3-46f4-acdf-8a248d9173b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-702447d0-d6c0-4b0c-9bd6-b37b78b6d3f2 req-7036f812-9b93-412a-bbfc-d98ed13eafcc service nova] Lock "8921bc74-c5a3-46f4-acdf-8a248d9173b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-702447d0-d6c0-4b0c-9bd6-b37b78b6d3f2 req-7036f812-9b93-412a-bbfc-d98ed13eafcc service nova] Lock "8921bc74-c5a3-46f4-acdf-8a248d9173b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:02 user nova-compute[72504]: DEBUG nova.compute.manager [req-702447d0-d6c0-4b0c-9bd6-b37b78b6d3f2 req-7036f812-9b93-412a-bbfc-d98ed13eafcc service nova] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] No waiting events found dispatching network-vif-unplugged-76ce7613-6b10-4d90-b9ba-b6f676b8a4a6 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:10:02 user nova-compute[72504]: DEBUG nova.compute.manager [req-702447d0-d6c0-4b0c-9bd6-b37b78b6d3f2 req-7036f812-9b93-412a-bbfc-d98ed13eafcc service nova] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Received event network-vif-unplugged-76ce7613-6b10-4d90-b9ba-b6f676b8a4a6 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:10:03 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Instance destroyed successfully.
Aug 01 20:10:03 user nova-compute[72504]: DEBUG nova.objects.instance [None req-dd7748e5-8cac-479c-87c6-c9704fb10bd3 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lazy-loading 'resources' on Instance uuid 8921bc74-c5a3-46f4-acdf-8a248d9173b7 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:10:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-dd7748e5-8cac-479c-87c6-c9704fb10bd3 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:08:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-597306872',display_name='tempest-VolumesActionsTest-instance-597306872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-597306872',id=35,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:08:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41110ec7bd3e4ba8a6726bfeeef400d3',ramdisk_id='',reservation_id='r-oilclz8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-53423842',owner_user_name='tempest-VolumesActionsTest-53423842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:08:18Z,user_data=None,user_id='7e9aad8402924317bb7c92ed6ccfa87c',uuid=8921bc74-c5a3-46f4-acdf-8a248d9173b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76ce7613-6b10-4d90-b9ba-b6f676b8a4a6", "address": "fa:16:3e:23:23:ba", "network": {"id": "d61a75e5-6ec0-491d-be83-e2ccba438d75", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1390479230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41110ec7bd3e4ba8a6726bfeeef400d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ce7613-6b", "ovs_interfaceid": "76ce7613-6b10-4d90-b9ba-b6f676b8a4a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:10:03 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-dd7748e5-8cac-479c-87c6-c9704fb10bd3 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Converting VIF {"id": "76ce7613-6b10-4d90-b9ba-b6f676b8a4a6", "address": "fa:16:3e:23:23:ba", "network": {"id": "d61a75e5-6ec0-491d-be83-e2ccba438d75", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1390479230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41110ec7bd3e4ba8a6726bfeeef400d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ce7613-6b", "ovs_interfaceid": "76ce7613-6b10-4d90-b9ba-b6f676b8a4a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:10:03 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-dd7748e5-8cac-479c-87c6-c9704fb10bd3 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:23:ba,bridge_name='br-int',has_traffic_filtering=True,id=76ce7613-6b10-4d90-b9ba-b6f676b8a4a6,network=Network(d61a75e5-6ec0-491d-be83-e2ccba438d75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ce7613-6b') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:10:03 user nova-compute[72504]: DEBUG os_vif [None req-dd7748e5-8cac-479c-87c6-c9704fb10bd3 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:23:ba,bridge_name='br-int',has_traffic_filtering=True,id=76ce7613-6b10-4d90-b9ba-b6f676b8a4a6,network=Network(d61a75e5-6ec0-491d-be83-e2ccba438d75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ce7613-6b') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:10:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76ce7613-6b, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:10:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:10:03 user nova-compute[72504]: INFO os_vif [None req-dd7748e5-8cac-479c-87c6-c9704fb10bd3 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:23:ba,bridge_name='br-int',has_traffic_filtering=True,id=76ce7613-6b10-4d90-b9ba-b6f676b8a4a6,network=Network(d61a75e5-6ec0-491d-be83-e2ccba438d75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ce7613-6b')
Aug 01 20:10:03 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-dd7748e5-8cac-479c-87c6-c9704fb10bd3 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Deleting instance files /opt/stack/data/nova/instances/8921bc74-c5a3-46f4-acdf-8a248d9173b7_del
Aug 01 20:10:03 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-dd7748e5-8cac-479c-87c6-c9704fb10bd3 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Deletion of /opt/stack/data/nova/instances/8921bc74-c5a3-46f4-acdf-8a248d9173b7_del complete
Aug 01 20:10:03 user nova-compute[72504]: INFO nova.compute.manager [None req-dd7748e5-8cac-479c-87c6-c9704fb10bd3 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 01 20:10:03 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-dd7748e5-8cac-479c-87c6-c9704fb10bd3 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:10:03 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:10:03 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:10:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:04 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:10:04 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Took 0.96 seconds to deallocate network for instance.
Aug 01 20:10:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-3fa49c13-de53-434d-a9ca-6f53f1f1cc3d req-dcfd0f42-2bf2-4d23-b416-30b77b3438e4 service nova] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Received event network-vif-deleted-76ce7613-6b10-4d90-b9ba-b6f676b8a4a6 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:10:04 user nova-compute[72504]: INFO nova.compute.manager [req-3fa49c13-de53-434d-a9ca-6f53f1f1cc3d req-dcfd0f42-2bf2-4d23-b416-30b77b3438e4 service nova] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Neutron deleted interface 76ce7613-6b10-4d90-b9ba-b6f676b8a4a6; detaching it from the instance and deleting it from the info cache
Aug 01 20:10:04 user nova-compute[72504]: DEBUG nova.network.neutron [req-3fa49c13-de53-434d-a9ca-6f53f1f1cc3d req-dcfd0f42-2bf2-4d23-b416-30b77b3438e4 service nova] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:10:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-3fa49c13-de53-434d-a9ca-6f53f1f1cc3d req-dcfd0f42-2bf2-4d23-b416-30b77b3438e4 service nova] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Detach interface failed, port_id=76ce7613-6b10-4d90-b9ba-b6f676b8a4a6, reason: Instance 8921bc74-c5a3-46f4-acdf-8a248d9173b7 could not be found. {{(pid=72504) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 20:10:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-dd7748e5-8cac-479c-87c6-c9704fb10bd3 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-dd7748e5-8cac-479c-87c6-c9704fb10bd3 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:04 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-dd7748e5-8cac-479c-87c6-c9704fb10bd3 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:10:04 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-dd7748e5-8cac-479c-87c6-c9704fb10bd3 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:10:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-dd7748e5-8cac-479c-87c6-c9704fb10bd3 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:04 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-dd7748e5-8cac-479c-87c6-c9704fb10bd3 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Deleted allocations for instance 8921bc74-c5a3-46f4-acdf-8a248d9173b7
Aug 01 20:10:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-dd7748e5-8cac-479c-87c6-c9704fb10bd3 tempest-VolumesActionsTest-53423842 tempest-VolumesActionsTest-53423842-project-member] Lock "8921bc74-c5a3-46f4-acdf-8a248d9173b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.321s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-11fef893-8299-42d9-aa5b-51887cb04bab req-ce239834-5178-4062-a28a-8bc0ec92e36d service nova] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Received event network-vif-plugged-76ce7613-6b10-4d90-b9ba-b6f676b8a4a6 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:10:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-11fef893-8299-42d9-aa5b-51887cb04bab req-ce239834-5178-4062-a28a-8bc0ec92e36d service nova] Acquiring lock "8921bc74-c5a3-46f4-acdf-8a248d9173b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-11fef893-8299-42d9-aa5b-51887cb04bab req-ce239834-5178-4062-a28a-8bc0ec92e36d service nova] Lock "8921bc74-c5a3-46f4-acdf-8a248d9173b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-11fef893-8299-42d9-aa5b-51887cb04bab req-ce239834-5178-4062-a28a-8bc0ec92e36d service nova] Lock "8921bc74-c5a3-46f4-acdf-8a248d9173b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-11fef893-8299-42d9-aa5b-51887cb04bab req-ce239834-5178-4062-a28a-8bc0ec92e36d service nova] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] No waiting events found dispatching network-vif-plugged-76ce7613-6b10-4d90-b9ba-b6f676b8a4a6 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:10:04 user nova-compute[72504]: WARNING nova.compute.manager [req-11fef893-8299-42d9-aa5b-51887cb04bab req-ce239834-5178-4062-a28a-8bc0ec92e36d service nova] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Received unexpected event network-vif-plugged-76ce7613-6b10-4d90-b9ba-b6f676b8a4a6 for instance with vm_state deleted and task_state None.
Aug 01 20:10:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-11fef893-8299-42d9-aa5b-51887cb04bab req-ce239834-5178-4062-a28a-8bc0ec92e36d service nova] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Received event network-changed-1d876bbd-c0b1-4c03-b47a-c413c6b9147c {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:10:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-11fef893-8299-42d9-aa5b-51887cb04bab req-ce239834-5178-4062-a28a-8bc0ec92e36d service nova] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Refreshing instance network info cache due to event network-changed-1d876bbd-c0b1-4c03-b47a-c413c6b9147c. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:10:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-11fef893-8299-42d9-aa5b-51887cb04bab req-ce239834-5178-4062-a28a-8bc0ec92e36d service nova] Acquiring lock "refresh_cache-612e4609-6881-4373-9da0-ee5d762f7126" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:10:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-11fef893-8299-42d9-aa5b-51887cb04bab req-ce239834-5178-4062-a28a-8bc0ec92e36d service nova] Acquired lock "refresh_cache-612e4609-6881-4373-9da0-ee5d762f7126" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:10:04 user nova-compute[72504]: DEBUG nova.network.neutron [req-11fef893-8299-42d9-aa5b-51887cb04bab req-ce239834-5178-4062-a28a-8bc0ec92e36d service nova] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Refreshing network info cache for port 1d876bbd-c0b1-4c03-b47a-c413c6b9147c {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:10:05 user nova-compute[72504]: DEBUG nova.network.neutron [req-11fef893-8299-42d9-aa5b-51887cb04bab req-ce239834-5178-4062-a28a-8bc0ec92e36d service nova] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Updated VIF entry in instance network info cache for port 1d876bbd-c0b1-4c03-b47a-c413c6b9147c. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:10:05 user nova-compute[72504]: DEBUG nova.network.neutron [req-11fef893-8299-42d9-aa5b-51887cb04bab req-ce239834-5178-4062-a28a-8bc0ec92e36d service nova] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Updating instance_info_cache with network_info: [{"id": "1d876bbd-c0b1-4c03-b47a-c413c6b9147c", "address": "fa:16:3e:19:90:9c", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d876bbd-c0", "ovs_interfaceid": "1d876bbd-c0b1-4c03-b47a-c413c6b9147c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:10:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-11fef893-8299-42d9-aa5b-51887cb04bab req-ce239834-5178-4062-a28a-8bc0ec92e36d service nova] Releasing lock "refresh_cache-612e4609-6881-4373-9da0-ee5d762f7126" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:10:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Acquiring lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:11 user nova-compute[72504]: DEBUG nova.compute.manager [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 20:10:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:10:11 user nova-compute[72504]: INFO nova.compute.claims [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Claim successful on node user
Aug 01 20:10:11 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:10:11 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:10:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:11 user nova-compute[72504]: DEBUG nova.compute.manager [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 20:10:11 user nova-compute[72504]: DEBUG nova.compute.manager [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 20:10:11 user nova-compute[72504]: DEBUG nova.network.neutron [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 20:10:11 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 20:10:12 user nova-compute[72504]: DEBUG nova.compute.manager [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 20:10:12 user nova-compute[72504]: DEBUG nova.policy [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e77534532ab04a699a69ee9d2ef6f5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f084e19e3c674b308d8a566f57bba3f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 20:10:12 user nova-compute[72504]: DEBUG nova.compute.manager [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 20:10:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:10:12 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Creating image(s)
Aug 01 20:10:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "/opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "/opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.132s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.154s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk 1073741824" returned: 0 in 0.052s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:12 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 20:10:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:12 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Cannot resize image /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 20:10:12 user nova-compute[72504]: DEBUG nova.objects.instance [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lazy-loading 'migration_context' on Instance uuid 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:10:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 20:10:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Ensure instance console log exists: /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:10:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:13 user nova-compute[72504]: DEBUG nova.network.neutron [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Successfully created port: 298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 20:10:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "eaa9af64-231b-4202-ba63-f18b293509da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "eaa9af64-231b-4202-ba63-f18b293509da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:13 user nova-compute[72504]: DEBUG nova.compute.manager [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 20:10:13 user nova-compute[72504]: DEBUG nova.network.neutron [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Successfully updated port: 298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 20:10:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Acquiring lock "refresh_cache-9ac6b63a-2c5a-4f72-9dc3-8f884253e180" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:10:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Acquired lock "refresh_cache-9ac6b63a-2c5a-4f72-9dc3-8f884253e180" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:10:13 user nova-compute[72504]: DEBUG nova.network.neutron [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:10:13 user nova-compute[72504]: DEBUG nova.compute.manager [req-bc2490c1-a28e-4f3f-a46a-63663e7f6dd1 req-4c470411-cd8b-44e3-bc59-10c63d0e3f9e service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received event network-changed-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:10:13 user nova-compute[72504]: DEBUG nova.compute.manager [req-bc2490c1-a28e-4f3f-a46a-63663e7f6dd1 req-4c470411-cd8b-44e3-bc59-10c63d0e3f9e service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Refreshing instance network info cache due to event network-changed-298ca2cd-b389-42be-bc06-05344f41e0d2. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:10:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-bc2490c1-a28e-4f3f-a46a-63663e7f6dd1 req-4c470411-cd8b-44e3-bc59-10c63d0e3f9e service nova] Acquiring lock "refresh_cache-9ac6b63a-2c5a-4f72-9dc3-8f884253e180" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:10:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:13 user nova-compute[72504]: DEBUG nova.network.neutron [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:10:13 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:10:13 user nova-compute[72504]: INFO nova.compute.claims [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Claim successful on node user
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.network.neutron [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Updating instance_info_cache with network_info: [{"id": "298ca2cd-b389-42be-bc06-05344f41e0d2", "address": "fa:16:3e:74:2e:28", "network": {"id": "d4bfb5e4-0509-436d-8605-07b850de35b1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1900175842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f084e19e3c674b308d8a566f57bba3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ca2cd-b3", "ovs_interfaceid": "298ca2cd-b389-42be-bc06-05344f41e0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Releasing lock "refresh_cache-9ac6b63a-2c5a-4f72-9dc3-8f884253e180" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.compute.manager [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Instance network_info: |[{"id": "298ca2cd-b389-42be-bc06-05344f41e0d2", "address": "fa:16:3e:74:2e:28", "network": {"id": "d4bfb5e4-0509-436d-8605-07b850de35b1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1900175842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f084e19e3c674b308d8a566f57bba3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ca2cd-b3", "ovs_interfaceid": "298ca2cd-b389-42be-bc06-05344f41e0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-bc2490c1-a28e-4f3f-a46a-63663e7f6dd1 req-4c470411-cd8b-44e3-bc59-10c63d0e3f9e service nova] Acquired lock "refresh_cache-9ac6b63a-2c5a-4f72-9dc3-8f884253e180" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.network.neutron [req-bc2490c1-a28e-4f3f-a46a-63663e7f6dd1 req-4c470411-cd8b-44e3-bc59-10c63d0e3f9e service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Refreshing network info cache for port 298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Start _get_guest_xml network_info=[{"id": "298ca2cd-b389-42be-bc06-05344f41e0d2", "address": "fa:16:3e:74:2e:28", "network": {"id": "d4bfb5e4-0509-436d-8605-07b850de35b1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1900175842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f084e19e3c674b308d8a566f57bba3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ca2cd-b3", "ovs_interfaceid": "298ca2cd-b389-42be-bc06-05344f41e0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.compute.manager [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 20:10:14 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:10:14 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:10:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1381056158',display_name='tempest-ServerStableDeviceRescueTest-server-1381056158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1381056158',id=37,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIVwp+tuXO6c8kD785Zo2XEHfC7u/nN/LRbpKentZruUp4OEarQSWw3qwP7r5vGpF4yfsIPZn6vwvxtuEVuQxxzjzDEY61CEq1/sMW/n2rGFZLUFfYrKgriISxcduSjrQ==',key_name='tempest-keypair-982487004',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f084e19e3c674b308d8a566f57bba3f2',ramdisk_id='',reservation_id='r-dv3t3ab9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1470200004',owner_user_name='tempest-ServerStableDeviceRescueTest-1470200004-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:10:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e77534532ab04a699a69ee9d2ef6f5b1',uuid=9ac6b63a-2c5a-4f72-9dc3-8f884253e180,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "298ca2cd-b389-42be-bc06-05344f41e0d2", "address": "fa:16:3e:74:2e:28", "network": {"id": "d4bfb5e4-0509-436d-8605-07b850de35b1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1900175842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f084e19e3c674b308d8a566f57bba3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ca2cd-b3", "ovs_interfaceid": "298ca2cd-b389-42be-bc06-05344f41e0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Converting VIF {"id": "298ca2cd-b389-42be-bc06-05344f41e0d2", "address": "fa:16:3e:74:2e:28", "network": {"id": "d4bfb5e4-0509-436d-8605-07b850de35b1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1900175842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f084e19e3c674b308d8a566f57bba3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ca2cd-b3", "ovs_interfaceid": "298ca2cd-b389-42be-bc06-05344f41e0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:2e:28,bridge_name='br-int',has_traffic_filtering=True,id=298ca2cd-b389-42be-bc06-05344f41e0d2,network=Network(d4bfb5e4-0509-436d-8605-07b850de35b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap298ca2cd-b3') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.objects.instance [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:10:14 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.compute.manager [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.network.neutron [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:10:14 user nova-compute[72504]:   <uuid>9ac6b63a-2c5a-4f72-9dc3-8f884253e180</uuid>
Aug 01 20:10:14 user nova-compute[72504]:   <name>instance-00000025</name>
Aug 01 20:10:14 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:10:14 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:10:14 user nova-compute[72504]:   <metadata>
Aug 01 20:10:14 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:10:14 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:10:14 user nova-compute[72504]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1381056158</nova:name>
Aug 01 20:10:14 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:10:14</nova:creationTime>
Aug 01 20:10:14 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:10:14 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:10:14 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:10:14 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:10:14 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:10:14 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:10:14 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:10:14 user nova-compute[72504]:       <nova:owner>
Aug 01 20:10:14 user nova-compute[72504]:         <nova:user uuid="e77534532ab04a699a69ee9d2ef6f5b1">tempest-ServerStableDeviceRescueTest-1470200004-project-member</nova:user>
Aug 01 20:10:14 user nova-compute[72504]:         <nova:project uuid="f084e19e3c674b308d8a566f57bba3f2">tempest-ServerStableDeviceRescueTest-1470200004</nova:project>
Aug 01 20:10:14 user nova-compute[72504]:       </nova:owner>
Aug 01 20:10:14 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 20:10:14 user nova-compute[72504]:       <nova:ports>
Aug 01 20:10:14 user nova-compute[72504]:         <nova:port uuid="298ca2cd-b389-42be-bc06-05344f41e0d2">
Aug 01 20:10:14 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 20:10:14 user nova-compute[72504]:         </nova:port>
Aug 01 20:10:14 user nova-compute[72504]:       </nova:ports>
Aug 01 20:10:14 user nova-compute[72504]:     </nova:instance>
Aug 01 20:10:14 user nova-compute[72504]:   </metadata>
Aug 01 20:10:14 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:10:14 user nova-compute[72504]:     <system>
Aug 01 20:10:14 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:10:14 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:10:14 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:10:14 user nova-compute[72504]:       <entry name="serial">9ac6b63a-2c5a-4f72-9dc3-8f884253e180</entry>
Aug 01 20:10:14 user nova-compute[72504]:       <entry name="uuid">9ac6b63a-2c5a-4f72-9dc3-8f884253e180</entry>
Aug 01 20:10:14 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:10:14 user nova-compute[72504]:     </system>
Aug 01 20:10:14 user nova-compute[72504]:   </sysinfo>
Aug 01 20:10:14 user nova-compute[72504]:   <os>
Aug 01 20:10:14 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:10:14 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:10:14 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:10:14 user nova-compute[72504]:   </os>
Aug 01 20:10:14 user nova-compute[72504]:   <features>
Aug 01 20:10:14 user nova-compute[72504]:     <acpi/>
Aug 01 20:10:14 user nova-compute[72504]:     <apic/>
Aug 01 20:10:14 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:10:14 user nova-compute[72504]:   </features>
Aug 01 20:10:14 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:10:14 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:10:14 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:10:14 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:10:14 user nova-compute[72504]:   </clock>
Aug 01 20:10:14 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:10:14 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:10:14 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:10:14 user nova-compute[72504]:   </cpu>
Aug 01 20:10:14 user nova-compute[72504]:   <devices>
Aug 01 20:10:14 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 20:10:14 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 20:10:14 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk"/>
Aug 01 20:10:14 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:10:14 user nova-compute[72504]:     </disk>
Aug 01 20:10:14 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:10:14 user nova-compute[72504]:       <mac address="fa:16:3e:74:2e:28"/>
Aug 01 20:10:14 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:10:14 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:10:14 user nova-compute[72504]:       <target dev="tap298ca2cd-b3"/>
Aug 01 20:10:14 user nova-compute[72504]:     </interface>
Aug 01 20:10:14 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:10:14 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/console.log" append="off"/>
Aug 01 20:10:14 user nova-compute[72504]:     </serial>
Aug 01 20:10:14 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:10:14 user nova-compute[72504]:     <video>
Aug 01 20:10:14 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:10:14 user nova-compute[72504]:     </video>
Aug 01 20:10:14 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:10:14 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:10:14 user nova-compute[72504]:     </rng>
Aug 01 20:10:14 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:10:14 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:10:14 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:10:14 user nova-compute[72504]:     </memballoon>
Aug 01 20:10:14 user nova-compute[72504]:   </devices>
Aug 01 20:10:14 user nova-compute[72504]: </domain>
Aug 01 20:10:14 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:10:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1381056158',display_name='tempest-ServerStableDeviceRescueTest-server-1381056158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1381056158',id=37,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIVwp+tuXO6c8kD785Zo2XEHfC7u/nN/LRbpKentZruUp4OEarQSWw3qwP7r5vGpF4yfsIPZn6vwvxtuEVuQxxzjzDEY61CEq1/sMW/n2rGFZLUFfYrKgriISxcduSjrQ==',key_name='tempest-keypair-982487004',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f084e19e3c674b308d8a566f57bba3f2',ramdisk_id='',reservation_id='r-dv3t3ab9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1470200004',owner_user_name='tempest-ServerStableDeviceRescueTest-1470200004-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:10:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e77534532ab04a699a69ee9d2ef6f5b1',uuid=9ac6b63a-2c5a-4f72-9dc3-8f884253e180,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "298ca2cd-b389-42be-bc06-05344f41e0d2", "address": "fa:16:3e:74:2e:28", "network": {"id": "d4bfb5e4-0509-436d-8605-07b850de35b1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1900175842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f084e19e3c674b308d8a566f57bba3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ca2cd-b3", "ovs_interfaceid": "298ca2cd-b389-42be-bc06-05344f41e0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Converting VIF {"id": "298ca2cd-b389-42be-bc06-05344f41e0d2", "address": "fa:16:3e:74:2e:28", "network": {"id": "d4bfb5e4-0509-436d-8605-07b850de35b1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1900175842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f084e19e3c674b308d8a566f57bba3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ca2cd-b3", "ovs_interfaceid": "298ca2cd-b389-42be-bc06-05344f41e0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:2e:28,bridge_name='br-int',has_traffic_filtering=True,id=298ca2cd-b389-42be-bc06-05344f41e0d2,network=Network(d4bfb5e4-0509-436d-8605-07b850de35b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap298ca2cd-b3') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG os_vif [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:2e:28,bridge_name='br-int',has_traffic_filtering=True,id=298ca2cd-b389-42be-bc06-05344f41e0d2,network=Network(d4bfb5e4-0509-436d-8605-07b850de35b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap298ca2cd-b3') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap298ca2cd-b3, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap298ca2cd-b3, col_values=(('external_ids', {'iface-id': '298ca2cd-b389-42be-bc06-05344f41e0d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:2e:28', 'vm-uuid': '9ac6b63a-2c5a-4f72-9dc3-8f884253e180'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.compute.manager [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:14 user nova-compute[72504]: INFO os_vif [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:2e:28,bridge_name='br-int',has_traffic_filtering=True,id=298ca2cd-b389-42be-bc06-05344f41e0d2,network=Network(d4bfb5e4-0509-436d-8605-07b850de35b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap298ca2cd-b3')
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] No VIF found with MAC fa:16:3e:74:2e:28, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:10:14 user nova-compute[72504]: INFO nova.virt.block_device [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Booting with volume snapshot 9af80e33-d5bf-4b22-b936-748fee907dd2 at /dev/vda
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.policy [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f06381c8a6214ddea7f1b36b623ed4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb59fbc2bf9749f3af7d56435cb37066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.network.neutron [req-bc2490c1-a28e-4f3f-a46a-63663e7f6dd1 req-4c470411-cd8b-44e3-bc59-10c63d0e3f9e service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Updated VIF entry in instance network info cache for port 298ca2cd-b389-42be-bc06-05344f41e0d2. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG nova.network.neutron [req-bc2490c1-a28e-4f3f-a46a-63663e7f6dd1 req-4c470411-cd8b-44e3-bc59-10c63d0e3f9e service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Updating instance_info_cache with network_info: [{"id": "298ca2cd-b389-42be-bc06-05344f41e0d2", "address": "fa:16:3e:74:2e:28", "network": {"id": "d4bfb5e4-0509-436d-8605-07b850de35b1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1900175842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f084e19e3c674b308d8a566f57bba3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ca2cd-b3", "ovs_interfaceid": "298ca2cd-b389-42be-bc06-05344f41e0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:10:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-bc2490c1-a28e-4f3f-a46a-63663e7f6dd1 req-4c470411-cd8b-44e3-bc59-10c63d0e3f9e service nova] Releasing lock "refresh_cache-9ac6b63a-2c5a-4f72-9dc3-8f884253e180" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:10:15 user nova-compute[72504]: DEBUG nova.network.neutron [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Successfully created port: a28b48bd-a25d-4254-9a02-e51941979d03 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 20:10:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:16 user nova-compute[72504]: DEBUG nova.compute.manager [req-82a528da-5b92-4ee1-979d-434ca5c90503 req-09523134-a050-4ee9-a6b6-f34747b00b8e service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received event network-vif-plugged-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:10:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-82a528da-5b92-4ee1-979d-434ca5c90503 req-09523134-a050-4ee9-a6b6-f34747b00b8e service nova] Acquiring lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-82a528da-5b92-4ee1-979d-434ca5c90503 req-09523134-a050-4ee9-a6b6-f34747b00b8e service nova] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-82a528da-5b92-4ee1-979d-434ca5c90503 req-09523134-a050-4ee9-a6b6-f34747b00b8e service nova] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:16 user nova-compute[72504]: DEBUG nova.compute.manager [req-82a528da-5b92-4ee1-979d-434ca5c90503 req-09523134-a050-4ee9-a6b6-f34747b00b8e service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] No waiting events found dispatching network-vif-plugged-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:10:16 user nova-compute[72504]: WARNING nova.compute.manager [req-82a528da-5b92-4ee1-979d-434ca5c90503 req-09523134-a050-4ee9-a6b6-f34747b00b8e service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received unexpected event network-vif-plugged-298ca2cd-b389-42be-bc06-05344f41e0d2 for instance with vm_state building and task_state spawning.
Aug 01 20:10:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:16 user nova-compute[72504]: DEBUG nova.network.neutron [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Successfully updated port: a28b48bd-a25d-4254-9a02-e51941979d03 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 20:10:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "refresh_cache-eaa9af64-231b-4202-ba63-f18b293509da" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:10:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquired lock "refresh_cache-eaa9af64-231b-4202-ba63-f18b293509da" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:10:16 user nova-compute[72504]: DEBUG nova.network.neutron [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:10:16 user nova-compute[72504]: DEBUG nova.network.neutron [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:10:17 user nova-compute[72504]: DEBUG nova.network.neutron [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Updating instance_info_cache with network_info: [{"id": "a28b48bd-a25d-4254-9a02-e51941979d03", "address": "fa:16:3e:70:92:f2", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa28b48bd-a2", "ovs_interfaceid": "a28b48bd-a25d-4254-9a02-e51941979d03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:10:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Releasing lock "refresh_cache-eaa9af64-231b-4202-ba63-f18b293509da" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:10:17 user nova-compute[72504]: DEBUG nova.compute.manager [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Instance network_info: |[{"id": "a28b48bd-a25d-4254-9a02-e51941979d03", "address": "fa:16:3e:70:92:f2", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa28b48bd-a2", "ovs_interfaceid": "a28b48bd-a25d-4254-9a02-e51941979d03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 20:10:18 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920618.0134838, 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:10:18 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] VM Resumed (Lifecycle Event)
Aug 01 20:10:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:10:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:10:18 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Instance spawned successfully.
Aug 01 20:10:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 20:10:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:10:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:10:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:10:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:10:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:10:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:10:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:10:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:10:18 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:10:18 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920618.0137901, 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:10:18 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] VM Started (Lifecycle Event)
Aug 01 20:10:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:10:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:10:18 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:10:18 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690920603.1491432, 8921bc74-c5a3-46f4-acdf-8a248d9173b7 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:10:18 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] VM Stopped (Lifecycle Event)
Aug 01 20:10:18 user nova-compute[72504]: INFO nova.compute.manager [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Took 6.03 seconds to spawn the instance on the hypervisor.
Aug 01 20:10:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:10:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-960ef209-6ff2-4641-ae08-221ea6fcbc10 None None] [instance: 8921bc74-c5a3-46f4-acdf-8a248d9173b7] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:10:18 user nova-compute[72504]: DEBUG nova.compute.manager [req-a0bb0983-4adf-4efc-a87b-c24cb9b3bb2e req-73409854-23b8-4ebf-a2c4-64514e083d38 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Received event network-changed-a28b48bd-a25d-4254-9a02-e51941979d03 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:10:18 user nova-compute[72504]: DEBUG nova.compute.manager [req-a0bb0983-4adf-4efc-a87b-c24cb9b3bb2e req-73409854-23b8-4ebf-a2c4-64514e083d38 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Refreshing instance network info cache due to event network-changed-a28b48bd-a25d-4254-9a02-e51941979d03. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:10:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a0bb0983-4adf-4efc-a87b-c24cb9b3bb2e req-73409854-23b8-4ebf-a2c4-64514e083d38 service nova] Acquiring lock "refresh_cache-eaa9af64-231b-4202-ba63-f18b293509da" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:10:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a0bb0983-4adf-4efc-a87b-c24cb9b3bb2e req-73409854-23b8-4ebf-a2c4-64514e083d38 service nova] Acquired lock "refresh_cache-eaa9af64-231b-4202-ba63-f18b293509da" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:10:18 user nova-compute[72504]: DEBUG nova.network.neutron [req-a0bb0983-4adf-4efc-a87b-c24cb9b3bb2e req-73409854-23b8-4ebf-a2c4-64514e083d38 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Refreshing network info cache for port a28b48bd-a25d-4254-9a02-e51941979d03 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:10:18 user nova-compute[72504]: INFO nova.compute.manager [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Took 6.88 seconds to build instance.
Aug 01 20:10:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fe2964e9-bd34-4e0e-9d94-0105c4667406 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.971s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:18 user nova-compute[72504]: DEBUG nova.network.neutron [req-a0bb0983-4adf-4efc-a87b-c24cb9b3bb2e req-73409854-23b8-4ebf-a2c4-64514e083d38 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Updated VIF entry in instance network info cache for port a28b48bd-a25d-4254-9a02-e51941979d03. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:10:18 user nova-compute[72504]: DEBUG nova.network.neutron [req-a0bb0983-4adf-4efc-a87b-c24cb9b3bb2e req-73409854-23b8-4ebf-a2c4-64514e083d38 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Updating instance_info_cache with network_info: [{"id": "a28b48bd-a25d-4254-9a02-e51941979d03", "address": "fa:16:3e:70:92:f2", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa28b48bd-a2", "ovs_interfaceid": "a28b48bd-a25d-4254-9a02-e51941979d03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:10:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a0bb0983-4adf-4efc-a87b-c24cb9b3bb2e req-73409854-23b8-4ebf-a2c4-64514e083d38 service nova] Releasing lock "refresh_cache-eaa9af64-231b-4202-ba63-f18b293509da" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:10:18 user nova-compute[72504]: DEBUG nova.compute.manager [req-a0bb0983-4adf-4efc-a87b-c24cb9b3bb2e req-73409854-23b8-4ebf-a2c4-64514e083d38 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received event network-vif-plugged-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:10:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a0bb0983-4adf-4efc-a87b-c24cb9b3bb2e req-73409854-23b8-4ebf-a2c4-64514e083d38 service nova] Acquiring lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a0bb0983-4adf-4efc-a87b-c24cb9b3bb2e req-73409854-23b8-4ebf-a2c4-64514e083d38 service nova] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a0bb0983-4adf-4efc-a87b-c24cb9b3bb2e req-73409854-23b8-4ebf-a2c4-64514e083d38 service nova] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:18 user nova-compute[72504]: DEBUG nova.compute.manager [req-a0bb0983-4adf-4efc-a87b-c24cb9b3bb2e req-73409854-23b8-4ebf-a2c4-64514e083d38 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] No waiting events found dispatching network-vif-plugged-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:10:18 user nova-compute[72504]: WARNING nova.compute.manager [req-a0bb0983-4adf-4efc-a87b-c24cb9b3bb2e req-73409854-23b8-4ebf-a2c4-64514e083d38 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received unexpected event network-vif-plugged-298ca2cd-b389-42be-bc06-05344f41e0d2 for instance with vm_state building and task_state spawning.
Aug 01 20:10:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:20 user nova-compute[72504]: DEBUG os_brick.utils [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:10:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe9e438-6504-41e1-913e-f13227fb0887]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:10:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c5c703-7a97-42bb-b34b-fd2a507b9b61]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:10:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2141fc2f-c19c-44e6-953f-cb09aeb24bbd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:10:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7ba415-c8bd-43fa-9066-9593a734e99b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:10:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:10:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:10:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:10:20 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:10:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[202ba7e6-00ec-499d-8919-715d08230f66]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:10:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:10:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:10:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:10:20 user nova-compute[72504]: DEBUG os_brick.utils [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:10:20 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Updating existing volume attachment record: fbec3428-ca71-42f5-a0fc-24668451bdd1 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:10:22 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:10:22 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Cleaning up deleted instances {{(pid=72504) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 20:10:22 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] There are 0 instances to clean {{(pid=72504) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 20:10:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a7c8784f-abe7-474f-84ef-f46d7a34f645 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a7c8784f-abe7-474f-84ef-f46d7a34f645 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a7c8784f-abe7-474f-84ef-f46d7a34f645 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a7c8784f-abe7-474f-84ef-f46d7a34f645 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a7c8784f-abe7-474f-84ef-f46d7a34f645 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:25 user nova-compute[72504]: INFO nova.compute.manager [None req-a7c8784f-abe7-474f-84ef-f46d7a34f645 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Terminating instance
Aug 01 20:10:25 user nova-compute[72504]: DEBUG nova.compute.manager [None req-a7c8784f-abe7-474f-84ef-f46d7a34f645 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:10:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:25 user nova-compute[72504]: DEBUG nova.compute.manager [req-3802db3c-ed32-44f3-a621-dcd4b62592cc req-b9fa5dbd-a6e7-44f8-9b60-e1a4c1f2bed1 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received event network-vif-unplugged-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:10:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3802db3c-ed32-44f3-a621-dcd4b62592cc req-b9fa5dbd-a6e7-44f8-9b60-e1a4c1f2bed1 service nova] Acquiring lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3802db3c-ed32-44f3-a621-dcd4b62592cc req-b9fa5dbd-a6e7-44f8-9b60-e1a4c1f2bed1 service nova] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3802db3c-ed32-44f3-a621-dcd4b62592cc req-b9fa5dbd-a6e7-44f8-9b60-e1a4c1f2bed1 service nova] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:25 user nova-compute[72504]: DEBUG nova.compute.manager [req-3802db3c-ed32-44f3-a621-dcd4b62592cc req-b9fa5dbd-a6e7-44f8-9b60-e1a4c1f2bed1 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] No waiting events found dispatching network-vif-unplugged-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:10:25 user nova-compute[72504]: DEBUG nova.compute.manager [req-3802db3c-ed32-44f3-a621-dcd4b62592cc req-b9fa5dbd-a6e7-44f8-9b60-e1a4c1f2bed1 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received event network-vif-unplugged-f0cefd5c-7285-4f5e-b771-61f61039f900 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:10:25 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:10:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:26 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Instance destroyed successfully.
Aug 01 20:10:26 user nova-compute[72504]: DEBUG nova.objects.instance [None req-a7c8784f-abe7-474f-84ef-f46d7a34f645 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lazy-loading 'resources' on Instance uuid 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:10:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-a7c8784f-abe7-474f-84ef-f46d7a34f645 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T19:53:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1870540243',display_name='tempest-ServerRescueNegativeTestJSON-server-1870540243',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1870540243',id=14,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:58:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='274aed6773224c4fb534aac970d6bb34',ramdisk_id='',reservation_id='r-lhs9qo3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-897201375',owner_user_name='tempest-ServerRescueNegativeTestJSON-897201375-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:00:04Z,user_data=None,user_id='be219e31095441269a1f140a77ad0d57',uuid=1cb0bb6e-66b2-4b74-ae9b-c447b764ec91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0cefd5c-7285-4f5e-b771-61f61039f900", "address": "fa:16:3e:9a:5b:08", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cefd5c-72", "ovs_interfaceid": "f0cefd5c-7285-4f5e-b771-61f61039f900", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:10:26 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-a7c8784f-abe7-474f-84ef-f46d7a34f645 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Converting VIF {"id": "f0cefd5c-7285-4f5e-b771-61f61039f900", "address": "fa:16:3e:9a:5b:08", "network": {"id": "9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1428903489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "274aed6773224c4fb534aac970d6bb34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0cefd5c-72", "ovs_interfaceid": "f0cefd5c-7285-4f5e-b771-61f61039f900", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:10:26 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-a7c8784f-abe7-474f-84ef-f46d7a34f645 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:5b:08,bridge_name='br-int',has_traffic_filtering=True,id=f0cefd5c-7285-4f5e-b771-61f61039f900,network=Network(9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0cefd5c-72') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:10:26 user nova-compute[72504]: DEBUG os_vif [None req-a7c8784f-abe7-474f-84ef-f46d7a34f645 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:5b:08,bridge_name='br-int',has_traffic_filtering=True,id=f0cefd5c-7285-4f5e-b771-61f61039f900,network=Network(9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0cefd5c-72') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:10:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0cefd5c-72, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:10:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:10:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:26 user nova-compute[72504]: INFO os_vif [None req-a7c8784f-abe7-474f-84ef-f46d7a34f645 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:5b:08,bridge_name='br-int',has_traffic_filtering=True,id=f0cefd5c-7285-4f5e-b771-61f61039f900,network=Network(9b88ec2f-aefb-41d6-8fb5-a221e95b2dc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0cefd5c-72')
Aug 01 20:10:26 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-a7c8784f-abe7-474f-84ef-f46d7a34f645 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Deleting instance files /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91_del
Aug 01 20:10:26 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-a7c8784f-abe7-474f-84ef-f46d7a34f645 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Deletion of /opt/stack/data/nova/instances/1cb0bb6e-66b2-4b74-ae9b-c447b764ec91_del complete
Aug 01 20:10:26 user nova-compute[72504]: INFO nova.compute.manager [None req-a7c8784f-abe7-474f-84ef-f46d7a34f645 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 01 20:10:26 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-a7c8784f-abe7-474f-84ef-f46d7a34f645 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:10:26 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:10:26 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:10:26 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:10:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:27 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:10:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:27 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Took 0.64 seconds to deallocate network for instance.
Aug 01 20:10:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:27 user nova-compute[72504]: DEBUG nova.compute.manager [req-e18cc974-0d7e-46b6-a9b7-aceebf9f7ace req-3503f719-0b4f-4c9c-b987-b8a47dbb4451 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received event network-vif-deleted-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:10:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a7c8784f-abe7-474f-84ef-f46d7a34f645 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a7c8784f-abe7-474f-84ef-f46d7a34f645 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:27 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-a7c8784f-abe7-474f-84ef-f46d7a34f645 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:10:27 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-a7c8784f-abe7-474f-84ef-f46d7a34f645 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:10:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a7c8784f-abe7-474f-84ef-f46d7a34f645 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:27 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-a7c8784f-abe7-474f-84ef-f46d7a34f645 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Deleted allocations for instance 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91
Aug 01 20:10:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a7c8784f-abe7-474f-84ef-f46d7a34f645 tempest-ServerRescueNegativeTestJSON-897201375 tempest-ServerRescueNegativeTestJSON-897201375-project-member] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.343s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:27 user nova-compute[72504]: DEBUG nova.compute.manager [req-853801d9-e4c9-40b9-b670-9b45b12c4bc2 req-8ae75648-3302-4759-8e70-0ae9c174cce2 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received event network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:10:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-853801d9-e4c9-40b9-b670-9b45b12c4bc2 req-8ae75648-3302-4759-8e70-0ae9c174cce2 service nova] Acquiring lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-853801d9-e4c9-40b9-b670-9b45b12c4bc2 req-8ae75648-3302-4759-8e70-0ae9c174cce2 service nova] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-853801d9-e4c9-40b9-b670-9b45b12c4bc2 req-8ae75648-3302-4759-8e70-0ae9c174cce2 service nova] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:27 user nova-compute[72504]: DEBUG nova.compute.manager [req-853801d9-e4c9-40b9-b670-9b45b12c4bc2 req-8ae75648-3302-4759-8e70-0ae9c174cce2 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] No waiting events found dispatching network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:10:27 user nova-compute[72504]: WARNING nova.compute.manager [req-853801d9-e4c9-40b9-b670-9b45b12c4bc2 req-8ae75648-3302-4759-8e70-0ae9c174cce2 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received unexpected event network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 for instance with vm_state deleted and task_state None.
Aug 01 20:10:27 user nova-compute[72504]: DEBUG nova.compute.manager [req-853801d9-e4c9-40b9-b670-9b45b12c4bc2 req-8ae75648-3302-4759-8e70-0ae9c174cce2 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received event network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:10:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-853801d9-e4c9-40b9-b670-9b45b12c4bc2 req-8ae75648-3302-4759-8e70-0ae9c174cce2 service nova] Acquiring lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-853801d9-e4c9-40b9-b670-9b45b12c4bc2 req-8ae75648-3302-4759-8e70-0ae9c174cce2 service nova] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-853801d9-e4c9-40b9-b670-9b45b12c4bc2 req-8ae75648-3302-4759-8e70-0ae9c174cce2 service nova] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:27 user nova-compute[72504]: DEBUG nova.compute.manager [req-853801d9-e4c9-40b9-b670-9b45b12c4bc2 req-8ae75648-3302-4759-8e70-0ae9c174cce2 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] No waiting events found dispatching network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:10:27 user nova-compute[72504]: WARNING nova.compute.manager [req-853801d9-e4c9-40b9-b670-9b45b12c4bc2 req-8ae75648-3302-4759-8e70-0ae9c174cce2 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received unexpected event network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 for instance with vm_state deleted and task_state None.
Aug 01 20:10:27 user nova-compute[72504]: DEBUG nova.compute.manager [req-853801d9-e4c9-40b9-b670-9b45b12c4bc2 req-8ae75648-3302-4759-8e70-0ae9c174cce2 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received event network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:10:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-853801d9-e4c9-40b9-b670-9b45b12c4bc2 req-8ae75648-3302-4759-8e70-0ae9c174cce2 service nova] Acquiring lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-853801d9-e4c9-40b9-b670-9b45b12c4bc2 req-8ae75648-3302-4759-8e70-0ae9c174cce2 service nova] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-853801d9-e4c9-40b9-b670-9b45b12c4bc2 req-8ae75648-3302-4759-8e70-0ae9c174cce2 service nova] Lock "1cb0bb6e-66b2-4b74-ae9b-c447b764ec91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:27 user nova-compute[72504]: DEBUG nova.compute.manager [req-853801d9-e4c9-40b9-b670-9b45b12c4bc2 req-8ae75648-3302-4759-8e70-0ae9c174cce2 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] No waiting events found dispatching network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:10:27 user nova-compute[72504]: WARNING nova.compute.manager [req-853801d9-e4c9-40b9-b670-9b45b12c4bc2 req-8ae75648-3302-4759-8e70-0ae9c174cce2 service nova] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Received unexpected event network-vif-plugged-f0cefd5c-7285-4f5e-b771-61f61039f900 for instance with vm_state deleted and task_state None.
Aug 01 20:10:28 user nova-compute[72504]: DEBUG nova.compute.manager [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:10:28 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Creating image(s)
Aug 01 20:10:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Did not create local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Ensure instance console log exists: /opt/stack/data/nova/instances/eaa9af64-231b-4202-ba63-f18b293509da/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Start _get_guest_xml network_info=[{"id": "a28b48bd-a25d-4254-9a02-e51941979d03", "address": "fa:16:3e:70:92:f2", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa28b48bd-a2", "ovs_interfaceid": "a28b48bd-a25d-4254-9a02-e51941979d03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-01T20:10:06Z,direct_url=<?>,disk_format='qcow2',id=3ee68730-f239-4f35-9ca3-f7d04e85b637,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1153805399',owner='eb59fbc2bf9749f3af7d56435cb37066',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-01T20:10:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYZfzEtU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eaa9af64-231b-4202-ba63-f18b293509da', 'attached_at': '', 'detached_at': '', 'volume_id': 'f1bd4286-77c7-4659-aa04-598bdb02f395', 'serial': 'f1bd4286-77c7-4659-aa04-598bdb02f395'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': 'fbec3428-ca71-42f5-a0fc-24668451bdd1', 'volume_type': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:10:28 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:10:28 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:10:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-01T20:10:06Z,direct_url=<?>,disk_format='qcow2',id=3ee68730-f239-4f35-9ca3-f7d04e85b637,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1153805399',owner='eb59fbc2bf9749f3af7d56435cb37066',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-01T20:10:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYZfzEtU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:10:28 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:10:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:10:28 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:10:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:10:28 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe30aa6-cc68-4f15-90e1-848147db085a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:10:28 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[de84a7ca-086d-4af7-a71c-5730a92a44a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395] added
Aug 01 20:10:28 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a1d9ec-f315-4970-bcae-56b1b15cf531]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad7b060-5218-48aa-9676-00fe40546a8d]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RYZfzEtU {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RYZfzEtU" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[091f456d-c064-423a-9618-1735fa647d02]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RYZfzEtU'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4be64de-28ad-4603-bdb0-65d7d3df88cb]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0078d8cd-8adc-45a6-8f40-84d53ea8e98c]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:10:28 user nova-compute[72504]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b (non-flash)
Aug 01 20:10:28 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:10:28 user nova-compute[72504]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b (non-flash)
Aug 01 20:10:28 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82b5341-486e-4873-bdc4-8b1abc7d55dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395, portal: 172.16.0.220,3260]
Aug 01 20:10:28 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395, portal: 172.16.0.220,3260] successful.
Aug 01 20:10:28 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d426f15b-492e-4c54-9680-68de8d9bde7f]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b80836-2d8a-4f09-b1c5-f1e53730bcca]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:10:28 user nova-compute[72504]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b (non-flash)
Aug 01 20:10:28 user nova-compute[72504]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 (non-flash)
Aug 01 20:10:28 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:10:28 user nova-compute[72504]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b (non-flash)
Aug 01 20:10:28 user nova-compute[72504]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 (non-flash)
Aug 01 20:10:28 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd891cd0-1f2a-4c30-8631-78791155caff]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYZfzEtU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:10:28 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:10:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:10:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23539386663323036', 'path': '/dev/sdc'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:10:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539386663323036', 'path': '/dev/sdc'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:10:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:10:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1882787420',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1882787420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1882787420',id=38,image_ref='3ee68730-f239-4f35-9ca3-f7d04e85b637',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMZueVIxJXrfuNCwvkaltc/Egc0qVjIcSt64ojW9OLXmkqnL+xy33//hgegowXOlgqcKyN2r/vrmqIrHHhkMoFIMA3m7NRil6QRwNEQW8vFtoyPu9gch4UvBpyItt72JA==',key_name='tempest-keypair-254298215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb59fbc2bf9749f3af7d56435cb37066',ramdisk_id='',reservation_id='r-pqadf02o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-685885098',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-685885098-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-685885098',owner_user_name='tempest-TestVolumeBootPattern-685885098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:10:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f06381c8a6214ddea7f1b36b623ed4d5',uuid=eaa9af64-231b-4202-ba63-f18b293509da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a28b48bd-a25d-4254-9a02-e51941979d03", "address": "fa:16:3e:70:92:f2", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa28b48bd-a2", "ovs_interfaceid": "a28b48bd-a25d-4254-9a02-e51941979d03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:10:29 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converting VIF {"id": "a28b48bd-a25d-4254-9a02-e51941979d03", "address": "fa:16:3e:70:92:f2", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa28b48bd-a2", "ovs_interfaceid": "a28b48bd-a25d-4254-9a02-e51941979d03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:10:29 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:92:f2,bridge_name='br-int',has_traffic_filtering=True,id=a28b48bd-a25d-4254-9a02-e51941979d03,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa28b48bd-a2') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:10:29 user nova-compute[72504]: DEBUG nova.objects.instance [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lazy-loading 'pci_devices' on Instance uuid eaa9af64-231b-4202-ba63-f18b293509da {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:10:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:10:29 user nova-compute[72504]:   <uuid>eaa9af64-231b-4202-ba63-f18b293509da</uuid>
Aug 01 20:10:29 user nova-compute[72504]:   <name>instance-00000026</name>
Aug 01 20:10:29 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:10:29 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:10:29 user nova-compute[72504]:   <metadata>
Aug 01 20:10:29 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:10:29 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:10:29 user nova-compute[72504]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1882787420</nova:name>
Aug 01 20:10:29 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:10:28</nova:creationTime>
Aug 01 20:10:29 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:10:29 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:10:29 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:10:29 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:10:29 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:10:29 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:10:29 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:10:29 user nova-compute[72504]:       <nova:owner>
Aug 01 20:10:29 user nova-compute[72504]:         <nova:user uuid="f06381c8a6214ddea7f1b36b623ed4d5">tempest-TestVolumeBootPattern-685885098-project-member</nova:user>
Aug 01 20:10:29 user nova-compute[72504]:         <nova:project uuid="eb59fbc2bf9749f3af7d56435cb37066">tempest-TestVolumeBootPattern-685885098</nova:project>
Aug 01 20:10:29 user nova-compute[72504]:       </nova:owner>
Aug 01 20:10:29 user nova-compute[72504]:       <nova:root type="image" uuid="3ee68730-f239-4f35-9ca3-f7d04e85b637"/>
Aug 01 20:10:29 user nova-compute[72504]:       <nova:ports>
Aug 01 20:10:29 user nova-compute[72504]:         <nova:port uuid="a28b48bd-a25d-4254-9a02-e51941979d03">
Aug 01 20:10:29 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 20:10:29 user nova-compute[72504]:         </nova:port>
Aug 01 20:10:29 user nova-compute[72504]:       </nova:ports>
Aug 01 20:10:29 user nova-compute[72504]:     </nova:instance>
Aug 01 20:10:29 user nova-compute[72504]:   </metadata>
Aug 01 20:10:29 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:10:29 user nova-compute[72504]:     <system>
Aug 01 20:10:29 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:10:29 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:10:29 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:10:29 user nova-compute[72504]:       <entry name="serial">eaa9af64-231b-4202-ba63-f18b293509da</entry>
Aug 01 20:10:29 user nova-compute[72504]:       <entry name="uuid">eaa9af64-231b-4202-ba63-f18b293509da</entry>
Aug 01 20:10:29 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:10:29 user nova-compute[72504]:     </system>
Aug 01 20:10:29 user nova-compute[72504]:   </sysinfo>
Aug 01 20:10:29 user nova-compute[72504]:   <os>
Aug 01 20:10:29 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:10:29 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:10:29 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:10:29 user nova-compute[72504]:   </os>
Aug 01 20:10:29 user nova-compute[72504]:   <features>
Aug 01 20:10:29 user nova-compute[72504]:     <acpi/>
Aug 01 20:10:29 user nova-compute[72504]:     <apic/>
Aug 01 20:10:29 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:10:29 user nova-compute[72504]:   </features>
Aug 01 20:10:29 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:10:29 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:10:29 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:10:29 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:10:29 user nova-compute[72504]:   </clock>
Aug 01 20:10:29 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:10:29 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:10:29 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:10:29 user nova-compute[72504]:   </cpu>
Aug 01 20:10:29 user nova-compute[72504]:   <devices>
Aug 01 20:10:29 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 20:10:29 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:10:29 user nova-compute[72504]:       <source dev="/dev/sdc"/>
Aug 01 20:10:29 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:10:29 user nova-compute[72504]:       <serial>f1bd4286-77c7-4659-aa04-598bdb02f395</serial>
Aug 01 20:10:29 user nova-compute[72504]:     </disk>
Aug 01 20:10:29 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:10:29 user nova-compute[72504]:       <mac address="fa:16:3e:70:92:f2"/>
Aug 01 20:10:29 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:10:29 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:10:29 user nova-compute[72504]:       <target dev="tapa28b48bd-a2"/>
Aug 01 20:10:29 user nova-compute[72504]:     </interface>
Aug 01 20:10:29 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:10:29 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/eaa9af64-231b-4202-ba63-f18b293509da/console.log" append="off"/>
Aug 01 20:10:29 user nova-compute[72504]:     </serial>
Aug 01 20:10:29 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:10:29 user nova-compute[72504]:     <video>
Aug 01 20:10:29 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:10:29 user nova-compute[72504]:     </video>
Aug 01 20:10:29 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:10:29 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:10:29 user nova-compute[72504]:     </rng>
Aug 01 20:10:29 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:10:29 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:10:29 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:10:29 user nova-compute[72504]:     </memballoon>
Aug 01 20:10:29 user nova-compute[72504]:   </devices>
Aug 01 20:10:29 user nova-compute[72504]: </domain>
Aug 01 20:10:29 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:10:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:10:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1882787420',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1882787420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1882787420',id=38,image_ref='3ee68730-f239-4f35-9ca3-f7d04e85b637',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMZueVIxJXrfuNCwvkaltc/Egc0qVjIcSt64ojW9OLXmkqnL+xy33//hgegowXOlgqcKyN2r/vrmqIrHHhkMoFIMA3m7NRil6QRwNEQW8vFtoyPu9gch4UvBpyItt72JA==',key_name='tempest-keypair-254298215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb59fbc2bf9749f3af7d56435cb37066',ramdisk_id='',reservation_id='r-pqadf02o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-685885098',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-685885098-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-685885098',owner_user_name='tempest-TestVolumeBootPattern-685885098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:10:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f06381c8a6214ddea7f1b36b623ed4d5',uuid=eaa9af64-231b-4202-ba63-f18b293509da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a28b48bd-a25d-4254-9a02-e51941979d03", "address": "fa:16:3e:70:92:f2", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa28b48bd-a2", "ovs_interfaceid": "a28b48bd-a25d-4254-9a02-e51941979d03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:10:29 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converting VIF {"id": "a28b48bd-a25d-4254-9a02-e51941979d03", "address": "fa:16:3e:70:92:f2", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa28b48bd-a2", "ovs_interfaceid": "a28b48bd-a25d-4254-9a02-e51941979d03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:10:29 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:92:f2,bridge_name='br-int',has_traffic_filtering=True,id=a28b48bd-a25d-4254-9a02-e51941979d03,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa28b48bd-a2') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:10:29 user nova-compute[72504]: DEBUG os_vif [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:92:f2,bridge_name='br-int',has_traffic_filtering=True,id=a28b48bd-a25d-4254-9a02-e51941979d03,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa28b48bd-a2') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:10:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:10:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:10:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa28b48bd-a2, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:10:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa28b48bd-a2, col_values=(('external_ids', {'iface-id': 'a28b48bd-a25d-4254-9a02-e51941979d03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:92:f2', 'vm-uuid': 'eaa9af64-231b-4202-ba63-f18b293509da'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:10:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:10:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:29 user nova-compute[72504]: INFO os_vif [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:92:f2,bridge_name='br-int',has_traffic_filtering=True,id=a28b48bd-a25d-4254-9a02-e51941979d03,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa28b48bd-a2')
Aug 01 20:10:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:10:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] No VIF found with MAC fa:16:3e:70:92:f2, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:10:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:30 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:10:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:31 user nova-compute[72504]: DEBUG nova.compute.manager [req-79cf2be8-5d5e-419e-84ab-c460c273af86 req-322bd4ee-3dc6-4a9e-be84-ac2cc1d97d38 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Received event network-vif-plugged-a28b48bd-a25d-4254-9a02-e51941979d03 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:10:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-79cf2be8-5d5e-419e-84ab-c460c273af86 req-322bd4ee-3dc6-4a9e-be84-ac2cc1d97d38 service nova] Acquiring lock "eaa9af64-231b-4202-ba63-f18b293509da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-79cf2be8-5d5e-419e-84ab-c460c273af86 req-322bd4ee-3dc6-4a9e-be84-ac2cc1d97d38 service nova] Lock "eaa9af64-231b-4202-ba63-f18b293509da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-79cf2be8-5d5e-419e-84ab-c460c273af86 req-322bd4ee-3dc6-4a9e-be84-ac2cc1d97d38 service nova] Lock "eaa9af64-231b-4202-ba63-f18b293509da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:31 user nova-compute[72504]: DEBUG nova.compute.manager [req-79cf2be8-5d5e-419e-84ab-c460c273af86 req-322bd4ee-3dc6-4a9e-be84-ac2cc1d97d38 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] No waiting events found dispatching network-vif-plugged-a28b48bd-a25d-4254-9a02-e51941979d03 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:10:31 user nova-compute[72504]: WARNING nova.compute.manager [req-79cf2be8-5d5e-419e-84ab-c460c273af86 req-322bd4ee-3dc6-4a9e-be84-ac2cc1d97d38 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Received unexpected event network-vif-plugged-a28b48bd-a25d-4254-9a02-e51941979d03 for instance with vm_state building and task_state spawning.
Aug 01 20:10:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:31 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:10:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:31 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:10:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:10:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:10:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:10:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:33 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920633.0940168, eaa9af64-231b-4202-ba63-f18b293509da => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:10:33 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: eaa9af64-231b-4202-ba63-f18b293509da] VM Resumed (Lifecycle Event)
Aug 01 20:10:33 user nova-compute[72504]: DEBUG nova.compute.manager [req-ae566733-e53e-4197-bc87-282cd330961e req-bc1f3507-9066-4107-83cf-88aa2f1f9015 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Received event network-vif-plugged-a28b48bd-a25d-4254-9a02-e51941979d03 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:10:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ae566733-e53e-4197-bc87-282cd330961e req-bc1f3507-9066-4107-83cf-88aa2f1f9015 service nova] Acquiring lock "eaa9af64-231b-4202-ba63-f18b293509da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ae566733-e53e-4197-bc87-282cd330961e req-bc1f3507-9066-4107-83cf-88aa2f1f9015 service nova] Lock "eaa9af64-231b-4202-ba63-f18b293509da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ae566733-e53e-4197-bc87-282cd330961e req-bc1f3507-9066-4107-83cf-88aa2f1f9015 service nova] Lock "eaa9af64-231b-4202-ba63-f18b293509da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:33 user nova-compute[72504]: DEBUG nova.compute.manager [req-ae566733-e53e-4197-bc87-282cd330961e req-bc1f3507-9066-4107-83cf-88aa2f1f9015 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] No waiting events found dispatching network-vif-plugged-a28b48bd-a25d-4254-9a02-e51941979d03 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:10:33 user nova-compute[72504]: WARNING nova.compute.manager [req-ae566733-e53e-4197-bc87-282cd330961e req-bc1f3507-9066-4107-83cf-88aa2f1f9015 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Received unexpected event network-vif-plugged-a28b48bd-a25d-4254-9a02-e51941979d03 for instance with vm_state building and task_state spawning.
Aug 01 20:10:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:10:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:10:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:10:33 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:10:33 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:10:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8032MB free_disk=25.308032989501953GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:10:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:33 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Instance spawned successfully.
Aug 01 20:10:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 20:10:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:10:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:10:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:10:33 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: eaa9af64-231b-4202-ba63-f18b293509da] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:10:33 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920633.0950515, eaa9af64-231b-4202-ba63-f18b293509da => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:10:33 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: eaa9af64-231b-4202-ba63-f18b293509da] VM Started (Lifecycle Event)
Aug 01 20:10:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:10:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:10:33 user nova-compute[72504]: INFO nova.compute.manager [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Took 5.35 seconds to spawn the instance on the hypervisor.
Aug 01 20:10:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:10:33 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: eaa9af64-231b-4202-ba63-f18b293509da] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:10:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 88f95d20-e391-4100-93b2-da29bfcf9704 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:10:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 1ac6e0af-4adb-47a7-988e-971aa5efeb2c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:10:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 8b163903-b08f-44b6-a5b5-56dc897d5640 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:10:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 612e4609-6881-4373-9da0-ee5d762f7126 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:10:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:10:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance eaa9af64-231b-4202-ba63-f18b293509da actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:10:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:10:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:10:33 user nova-compute[72504]: INFO nova.compute.manager [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Took 19.63 seconds to build instance.
Aug 01 20:10:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-401d8cc3-fd2f-403e-84fe-d8b62bb975b8 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "eaa9af64-231b-4202-ba63-f18b293509da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.722s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:33 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:10:33 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:10:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:10:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.405s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:34 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:10:34 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:10:35 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:10:35 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:10:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-88f95d20-e391-4100-93b2-da29bfcf9704" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:10:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-88f95d20-e391-4100-93b2-da29bfcf9704" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:10:35 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:10:36 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Updating instance_info_cache with network_info: [{"id": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "address": "fa:16:3e:c3:aa:1c", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a4ace30-3c", "ovs_interfaceid": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:10:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-88f95d20-e391-4100-93b2-da29bfcf9704" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:10:36 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:10:36 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:10:37 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:10:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:38 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:10:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "8b163903-b08f-44b6-a5b5-56dc897d5640" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:40 user nova-compute[72504]: INFO nova.compute.manager [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Terminating instance
Aug 01 20:10:40 user nova-compute[72504]: DEBUG nova.compute.manager [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:10:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-08aaa092-ca3a-4e2b-a296-2c88468ca606 req-b7650b5e-ded8-4245-8191-f2fcb63be698 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Received event network-vif-unplugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-08aaa092-ca3a-4e2b-a296-2c88468ca606 req-b7650b5e-ded8-4245-8191-f2fcb63be698 service nova] Acquiring lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-08aaa092-ca3a-4e2b-a296-2c88468ca606 req-b7650b5e-ded8-4245-8191-f2fcb63be698 service nova] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-08aaa092-ca3a-4e2b-a296-2c88468ca606 req-b7650b5e-ded8-4245-8191-f2fcb63be698 service nova] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-08aaa092-ca3a-4e2b-a296-2c88468ca606 req-b7650b5e-ded8-4245-8191-f2fcb63be698 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] No waiting events found dispatching network-vif-unplugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-08aaa092-ca3a-4e2b-a296-2c88468ca606 req-b7650b5e-ded8-4245-8191-f2fcb63be698 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Received event network-vif-unplugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690920626.1432676, 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:10:41 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] VM Stopped (Lifecycle Event)
Aug 01 20:10:41 user nova-compute[72504]: DEBUG nova.compute.manager [None req-6d2a614c-74a9-45c6-975a-0e5fe6b29c36 None None] [instance: 1cb0bb6e-66b2-4b74-ae9b-c447b764ec91] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:41 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Instance destroyed successfully.
Aug 01 20:10:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG nova.objects.instance [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lazy-loading 'resources' on Instance uuid 8b163903-b08f-44b6-a5b5-56dc897d5640 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:04:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-678696080',display_name='tempest-ServerActionsTestOtherA-server-678696080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-678696080',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLbPu5MF6DPaLmysryryb5dEvmDVe/ZpzyX1JNIgtOIXBuGnF7k0B3yFjfDeyUfOXvFKWH1T1tnnmguBKUJb6gDrcdFY/x4LtLMGVeolXUhKxLNh5O13uubFnujvAs7Sg==',key_name='tempest-keypair-2041585985',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:06:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='816239d15d3341cdaa785fc36c8e7cdb',ramdisk_id='',reservation_id='r-3tk0djaw',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1009670506',owner_user_name='tempest-ServerActionsTestOtherA-1009670506-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:07:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d76765d1d24342f99ce0d65f416d382b',uuid=8b163903-b08f-44b6-a5b5-56dc897d5640,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "address": "fa:16:3e:ac:33:02", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeea59ba-65", "ovs_interfaceid": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Converting VIF {"id": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "address": "fa:16:3e:ac:33:02", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeea59ba-65", "ovs_interfaceid": "aeea59ba-654d-4640-a3ca-33f8a7f302ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:33:02,bridge_name='br-int',has_traffic_filtering=True,id=aeea59ba-654d-4640-a3ca-33f8a7f302ff,network=Network(92749f96-d369-4df5-85ce-252c277e7ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeea59ba-65') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG os_vif [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:33:02,bridge_name='br-int',has_traffic_filtering=True,id=aeea59ba-654d-4640-a3ca-33f8a7f302ff,network=Network(92749f96-d369-4df5-85ce-252c277e7ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeea59ba-65') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaeea59ba-65, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:41 user nova-compute[72504]: INFO os_vif [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:33:02,bridge_name='br-int',has_traffic_filtering=True,id=aeea59ba-654d-4640-a3ca-33f8a7f302ff,network=Network(92749f96-d369-4df5-85ce-252c277e7ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeea59ba-65')
Aug 01 20:10:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrhkdDLS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:10:41 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:10:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[743e754d-8f9f-432b-b33f-bb62a5af8da0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b537b843-07d4-48a6-96f8-338210788fc6]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:10:41 user nova-compute[72504]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b (non-flash)
Aug 01 20:10:41 user nova-compute[72504]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 (non-flash)
Aug 01 20:10:41 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 (non-flash)
Aug 01 20:10:41 user nova-compute[72504]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b (non-flash)
Aug 01 20:10:41 user nova-compute[72504]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 (non-flash)
Aug 01 20:10:41 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3f4466290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160'): ({'sde'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Removing single pathed devices sde {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4293117f-94fe-465a-967f-ead2497e29fe]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2f8d43-64d6-4a4c-b62c-eba399657bff]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Flushing IO for device /dev/sde {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[955e8209-434d-4003-a38c-e93ff23f2d68]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ec3ee2-6fe5-405d-a195-edc44f683d9e]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] SCSI volumes sde have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_276d0970', '/dev/disk/by-id/scsi-1SCST_BIO276d0970-e413d397f956c37d', '/dev/disk/by-id/scsi-26534313364333937') {{(pid=83379) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 20:10:41 user nova-compute[72504]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_276d0970
Aug 01 20:10:41 user nova-compute[72504]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO276d0970-e413d397f956c37d
Aug 01 20:10:41 user nova-compute[72504]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26534313364333937
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a204ec25-925f-4d1d-a3b6-0ac1ada670b8]: (4, None) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6ded15-56c0-4830-8451-a35a8123a35a]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --logout" returned: 0 in 0.098s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f2a451-b51a-4c4c-b985-b02060f11187]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160, portal: 172.16.0.220,3260]
Aug 01 20:10:41 user nova-compute[72504]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160, portal: 172.16.0.220,3260] successful.
Aug 01 20:10:41 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8d42905-453b-4a20-8b79-736283896160 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8626a243-4dd0-4fe7-995a-ad827e5f6555]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] <== disconnect_volume: return (381ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:10:41 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Deleting instance files /opt/stack/data/nova/instances/8b163903-b08f-44b6-a5b5-56dc897d5640_del
Aug 01 20:10:41 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Deletion of /opt/stack/data/nova/instances/8b163903-b08f-44b6-a5b5-56dc897d5640_del complete
Aug 01 20:10:41 user nova-compute[72504]: INFO nova.compute.manager [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 01 20:10:41 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:10:41 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:10:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:43 user nova-compute[72504]: DEBUG nova.compute.manager [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Received event network-vif-plugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:10:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] Acquiring lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:43 user nova-compute[72504]: DEBUG nova.compute.manager [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] No waiting events found dispatching network-vif-plugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:10:43 user nova-compute[72504]: WARNING nova.compute.manager [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Received unexpected event network-vif-plugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff for instance with vm_state active and task_state deleting.
Aug 01 20:10:43 user nova-compute[72504]: DEBUG nova.compute.manager [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Received event network-vif-plugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:10:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] Acquiring lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:43 user nova-compute[72504]: DEBUG nova.compute.manager [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] No waiting events found dispatching network-vif-plugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:10:43 user nova-compute[72504]: WARNING nova.compute.manager [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Received unexpected event network-vif-plugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff for instance with vm_state active and task_state deleting.
Aug 01 20:10:43 user nova-compute[72504]: DEBUG nova.compute.manager [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Received event network-vif-plugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:10:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] Acquiring lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:43 user nova-compute[72504]: DEBUG nova.compute.manager [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] No waiting events found dispatching network-vif-plugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:10:43 user nova-compute[72504]: WARNING nova.compute.manager [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Received unexpected event network-vif-plugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff for instance with vm_state active and task_state deleting.
Aug 01 20:10:43 user nova-compute[72504]: DEBUG nova.compute.manager [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Received event network-vif-unplugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:10:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] Acquiring lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:43 user nova-compute[72504]: DEBUG nova.compute.manager [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] No waiting events found dispatching network-vif-unplugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:10:43 user nova-compute[72504]: DEBUG nova.compute.manager [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Received event network-vif-unplugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:10:43 user nova-compute[72504]: DEBUG nova.compute.manager [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Received event network-vif-plugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:10:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] Acquiring lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:43 user nova-compute[72504]: DEBUG nova.compute.manager [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] No waiting events found dispatching network-vif-plugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:10:43 user nova-compute[72504]: WARNING nova.compute.manager [req-161764cc-80c3-4aef-add1-5fc3fd271e57 req-5a15a2d1-b74d-4e55-8096-6da2b6a8054c service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Received unexpected event network-vif-plugged-aeea59ba-654d-4640-a3ca-33f8a7f302ff for instance with vm_state active and task_state deleting.
Aug 01 20:10:43 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:10:43 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Took 1.25 seconds to deallocate network for instance.
Aug 01 20:10:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:43 user nova-compute[72504]: INFO nova.compute.manager [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Took 0.71 seconds to detach 1 volumes for instance.
Aug 01 20:10:43 user nova-compute[72504]: DEBUG nova.compute.manager [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Deleting volume: f8d42905-453b-4a20-8b79-736283896160 {{(pid=72504) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 20:10:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:44 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:10:44 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:10:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:44 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Deleted allocations for instance 8b163903-b08f-44b6-a5b5-56dc897d5640
Aug 01 20:10:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-98575081-1a1b-465e-82e5-e6dae6374e95 tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "8b163903-b08f-44b6-a5b5-56dc897d5640" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.683s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:45 user nova-compute[72504]: DEBUG nova.compute.manager [req-a6ebaab7-6f79-4e8b-9899-3b45eff0b65d req-afef823f-130e-42e2-8c9e-2b5d9ec66fb4 service nova] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Received event network-vif-deleted-aeea59ba-654d-4640-a3ca-33f8a7f302ff {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:10:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:51 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:56 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690920641.4853506, 8b163903-b08f-44b6-a5b5-56dc897d5640 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:10:56 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] VM Stopped (Lifecycle Event)
Aug 01 20:10:56 user nova-compute[72504]: DEBUG nova.compute.manager [None req-c4473b98-48b4-4c0a-b139-ca2d9c457c88 None None] [instance: 8b163903-b08f-44b6-a5b5-56dc897d5640] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:10:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ba9b433e-e256-4961-9299-9149c04b53c2 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Acquiring lock "1ac6e0af-4adb-47a7-988e-971aa5efeb2c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ba9b433e-e256-4961-9299-9149c04b53c2 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "1ac6e0af-4adb-47a7-988e-971aa5efeb2c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ba9b433e-e256-4961-9299-9149c04b53c2 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Acquiring lock "1ac6e0af-4adb-47a7-988e-971aa5efeb2c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ba9b433e-e256-4961-9299-9149c04b53c2 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "1ac6e0af-4adb-47a7-988e-971aa5efeb2c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ba9b433e-e256-4961-9299-9149c04b53c2 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "1ac6e0af-4adb-47a7-988e-971aa5efeb2c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:58 user nova-compute[72504]: INFO nova.compute.manager [None req-ba9b433e-e256-4961-9299-9149c04b53c2 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Terminating instance
Aug 01 20:10:58 user nova-compute[72504]: DEBUG nova.compute.manager [None req-ba9b433e-e256-4961-9299-9149c04b53c2 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:10:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:58 user nova-compute[72504]: DEBUG nova.compute.manager [req-83a5635a-6c1b-4594-9036-8d4e0c2c5f63 req-0040027d-2905-49d1-a236-b3f1f129f476 service nova] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Received event network-vif-unplugged-2fbee8e8-4a4b-44d6-812b-f50729e5b45f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:10:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-83a5635a-6c1b-4594-9036-8d4e0c2c5f63 req-0040027d-2905-49d1-a236-b3f1f129f476 service nova] Acquiring lock "1ac6e0af-4adb-47a7-988e-971aa5efeb2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-83a5635a-6c1b-4594-9036-8d4e0c2c5f63 req-0040027d-2905-49d1-a236-b3f1f129f476 service nova] Lock "1ac6e0af-4adb-47a7-988e-971aa5efeb2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-83a5635a-6c1b-4594-9036-8d4e0c2c5f63 req-0040027d-2905-49d1-a236-b3f1f129f476 service nova] Lock "1ac6e0af-4adb-47a7-988e-971aa5efeb2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:58 user nova-compute[72504]: DEBUG nova.compute.manager [req-83a5635a-6c1b-4594-9036-8d4e0c2c5f63 req-0040027d-2905-49d1-a236-b3f1f129f476 service nova] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] No waiting events found dispatching network-vif-unplugged-2fbee8e8-4a4b-44d6-812b-f50729e5b45f {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:10:58 user nova-compute[72504]: DEBUG nova.compute.manager [req-83a5635a-6c1b-4594-9036-8d4e0c2c5f63 req-0040027d-2905-49d1-a236-b3f1f129f476 service nova] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Received event network-vif-unplugged-2fbee8e8-4a4b-44d6-812b-f50729e5b45f for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:10:58 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:10:58 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72504) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 20:10:58 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Instance destroyed successfully.
Aug 01 20:10:58 user nova-compute[72504]: DEBUG nova.objects.instance [None req-ba9b433e-e256-4961-9299-9149c04b53c2 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lazy-loading 'resources' on Instance uuid 1ac6e0af-4adb-47a7-988e-971aa5efeb2c {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:10:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-ba9b433e-e256-4961-9299-9149c04b53c2 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:02:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1929287952',display_name='tempest-ServersNegativeTestJSON-server-1929287952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1929287952',id=29,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:02:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea0f5bb5775e4071ab28bea2d9dd2512',ramdisk_id='',reservation_id='r-cnzbl54v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-865865258',owner_user_name='tempest-ServersNegativeTestJSON-865865258-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:02:12Z,user_data=None,user_id='a04ab5f67aaa4969b3df48d274a86d5e',uuid=1ac6e0af-4adb-47a7-988e-971aa5efeb2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2fbee8e8-4a4b-44d6-812b-f50729e5b45f", "address": "fa:16:3e:b0:b8:e6", "network": {"id": "b8489ede-9e34-4dfa-b6d7-d0948a7bad05", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1846924261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea0f5bb5775e4071ab28bea2d9dd2512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbee8e8-4a", "ovs_interfaceid": "2fbee8e8-4a4b-44d6-812b-f50729e5b45f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:10:58 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-ba9b433e-e256-4961-9299-9149c04b53c2 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Converting VIF {"id": "2fbee8e8-4a4b-44d6-812b-f50729e5b45f", "address": "fa:16:3e:b0:b8:e6", "network": {"id": "b8489ede-9e34-4dfa-b6d7-d0948a7bad05", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1846924261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea0f5bb5775e4071ab28bea2d9dd2512", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbee8e8-4a", "ovs_interfaceid": "2fbee8e8-4a4b-44d6-812b-f50729e5b45f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:10:58 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-ba9b433e-e256-4961-9299-9149c04b53c2 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:b8:e6,bridge_name='br-int',has_traffic_filtering=True,id=2fbee8e8-4a4b-44d6-812b-f50729e5b45f,network=Network(b8489ede-9e34-4dfa-b6d7-d0948a7bad05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fbee8e8-4a') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:10:58 user nova-compute[72504]: DEBUG os_vif [None req-ba9b433e-e256-4961-9299-9149c04b53c2 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:b8:e6,bridge_name='br-int',has_traffic_filtering=True,id=2fbee8e8-4a4b-44d6-812b-f50729e5b45f,network=Network(b8489ede-9e34-4dfa-b6d7-d0948a7bad05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fbee8e8-4a') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:10:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2fbee8e8-4a, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:10:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:10:58 user nova-compute[72504]: INFO os_vif [None req-ba9b433e-e256-4961-9299-9149c04b53c2 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:b8:e6,bridge_name='br-int',has_traffic_filtering=True,id=2fbee8e8-4a4b-44d6-812b-f50729e5b45f,network=Network(b8489ede-9e34-4dfa-b6d7-d0948a7bad05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fbee8e8-4a')
Aug 01 20:10:58 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-ba9b433e-e256-4961-9299-9149c04b53c2 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Deleting instance files /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c_del
Aug 01 20:10:58 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-ba9b433e-e256-4961-9299-9149c04b53c2 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Deletion of /opt/stack/data/nova/instances/1ac6e0af-4adb-47a7-988e-971aa5efeb2c_del complete
Aug 01 20:10:58 user nova-compute[72504]: INFO nova.compute.manager [None req-ba9b433e-e256-4961-9299-9149c04b53c2 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 01 20:10:58 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-ba9b433e-e256-4961-9299-9149c04b53c2 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:10:58 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:10:58 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:10:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:10:59 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:10:59 user nova-compute[72504]: DEBUG nova.compute.manager [req-775c784c-0f80-4143-a330-86fc90d6d1da req-a1ed97d1-30a7-484d-a582-ce40682e5eaa service nova] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Received event network-vif-deleted-2fbee8e8-4a4b-44d6-812b-f50729e5b45f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:10:59 user nova-compute[72504]: INFO nova.compute.manager [req-775c784c-0f80-4143-a330-86fc90d6d1da req-a1ed97d1-30a7-484d-a582-ce40682e5eaa service nova] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Neutron deleted interface 2fbee8e8-4a4b-44d6-812b-f50729e5b45f; detaching it from the instance and deleting it from the info cache
Aug 01 20:10:59 user nova-compute[72504]: DEBUG nova.network.neutron [req-775c784c-0f80-4143-a330-86fc90d6d1da req-a1ed97d1-30a7-484d-a582-ce40682e5eaa service nova] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:10:59 user nova-compute[72504]: DEBUG nova.compute.manager [req-775c784c-0f80-4143-a330-86fc90d6d1da req-a1ed97d1-30a7-484d-a582-ce40682e5eaa service nova] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Detach interface failed, port_id=2fbee8e8-4a4b-44d6-812b-f50729e5b45f, reason: Instance 1ac6e0af-4adb-47a7-988e-971aa5efeb2c could not be found. {{(pid=72504) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 20:10:59 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Took 0.54 seconds to deallocate network for instance.
Aug 01 20:10:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ba9b433e-e256-4961-9299-9149c04b53c2 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:10:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ba9b433e-e256-4961-9299-9149c04b53c2 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:10:59 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-ba9b433e-e256-4961-9299-9149c04b53c2 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:10:59 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-ba9b433e-e256-4961-9299-9149c04b53c2 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:10:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ba9b433e-e256-4961-9299-9149c04b53c2 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:10:59 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-ba9b433e-e256-4961-9299-9149c04b53c2 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Deleted allocations for instance 1ac6e0af-4adb-47a7-988e-971aa5efeb2c
Aug 01 20:10:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-ba9b433e-e256-4961-9299-9149c04b53c2 tempest-ServersNegativeTestJSON-865865258 tempest-ServersNegativeTestJSON-865865258-project-member] Lock "1ac6e0af-4adb-47a7-988e-971aa5efeb2c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.658s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:11:00 user nova-compute[72504]: DEBUG nova.compute.manager [req-113bc242-7216-4181-8630-9587c081f8a2 req-5ce5f0e1-78c0-4e07-b068-4f21865db7d1 service nova] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Received event network-vif-plugged-2fbee8e8-4a4b-44d6-812b-f50729e5b45f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:11:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-113bc242-7216-4181-8630-9587c081f8a2 req-5ce5f0e1-78c0-4e07-b068-4f21865db7d1 service nova] Acquiring lock "1ac6e0af-4adb-47a7-988e-971aa5efeb2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:11:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-113bc242-7216-4181-8630-9587c081f8a2 req-5ce5f0e1-78c0-4e07-b068-4f21865db7d1 service nova] Lock "1ac6e0af-4adb-47a7-988e-971aa5efeb2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:11:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-113bc242-7216-4181-8630-9587c081f8a2 req-5ce5f0e1-78c0-4e07-b068-4f21865db7d1 service nova] Lock "1ac6e0af-4adb-47a7-988e-971aa5efeb2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:11:00 user nova-compute[72504]: DEBUG nova.compute.manager [req-113bc242-7216-4181-8630-9587c081f8a2 req-5ce5f0e1-78c0-4e07-b068-4f21865db7d1 service nova] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] No waiting events found dispatching network-vif-plugged-2fbee8e8-4a4b-44d6-812b-f50729e5b45f {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:11:00 user nova-compute[72504]: WARNING nova.compute.manager [req-113bc242-7216-4181-8630-9587c081f8a2 req-5ce5f0e1-78c0-4e07-b068-4f21865db7d1 service nova] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Received unexpected event network-vif-plugged-2fbee8e8-4a4b-44d6-812b-f50729e5b45f for instance with vm_state deleted and task_state None.
Aug 01 20:11:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:11:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:11:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:11:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:11:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:13 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690920658.8931644, 1ac6e0af-4adb-47a7-988e-971aa5efeb2c => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:11:13 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] VM Stopped (Lifecycle Event)
Aug 01 20:11:13 user nova-compute[72504]: DEBUG nova.compute.manager [None req-c02b132c-baf5-457d-9e90-0514fa9916fa None None] [instance: 1ac6e0af-4adb-47a7-988e-971aa5efeb2c] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:11:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:11:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:11:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:11:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:11:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:11:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:25 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:11:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:28 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:11:28 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:11:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:30 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:11:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:31 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:11:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:11:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:11:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:11:31 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:11:31 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:11:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:11:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:11:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:11:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:11:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:11:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:11:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:11:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:11:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:11:33 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:11:33 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:11:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8281MB free_disk=25.323287963867188GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:11:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:11:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:11:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 88f95d20-e391-4100-93b2-da29bfcf9704 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:11:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 612e4609-6881-4373-9da0-ee5d762f7126 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:11:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:11:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance eaa9af64-231b-4202-ba63-f18b293509da actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:11:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:11:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:11:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:33 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:11:33 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:11:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:11:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.703s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:11:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "a4f9c59c-cf0b-4216-a194-22712725328d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:11:34 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "a4f9c59c-cf0b-4216-a194-22712725328d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:11:34 user nova-compute[72504]: DEBUG nova.compute.manager [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 20:11:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:11:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:11:35 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:11:35 user nova-compute[72504]: INFO nova.compute.claims [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Claim successful on node user
Aug 01 20:11:35 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Refreshing inventories for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 20:11:35 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Updating ProviderTree inventory for provider b951a798-e88c-472c-8347-2c5f6a05d47c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 20:11:35 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Updating inventory in ProviderTree for provider b951a798-e88c-472c-8347-2c5f6a05d47c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 20:11:35 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Refreshing aggregate associations for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c, aggregates: None {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 20:11:35 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Refreshing trait associations for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c, traits: HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 20:11:35 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:11:35 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:11:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:11:35 user nova-compute[72504]: DEBUG nova.compute.manager [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 20:11:35 user nova-compute[72504]: DEBUG nova.compute.manager [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 20:11:35 user nova-compute[72504]: DEBUG nova.network.neutron [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 20:11:35 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 20:11:35 user nova-compute[72504]: DEBUG nova.compute.manager [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 20:11:35 user nova-compute[72504]: DEBUG nova.policy [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90bea00e45b541baa6f98812cce770f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef67b412883421f949be025bdc1cf38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 20:11:35 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:11:35 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:11:35 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:11:35 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:11:35 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:11:35 user nova-compute[72504]: DEBUG nova.compute.manager [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 20:11:35 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:11:35 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Creating image(s)
Aug 01 20:11:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:11:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "/opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:11:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "/opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:11:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-612e4609-6881-4373-9da0-ee5d762f7126" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-612e4609-6881-4373-9da0-ee5d762f7126" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.163s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.141s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk 1073741824" returned: 0 in 0.051s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.150s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG nova.network.neutron [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Successfully created port: b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Cannot resize image /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG nova.objects.instance [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'migration_context' on Instance uuid a4f9c59c-cf0b-4216-a194-22712725328d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Ensure instance console log exists: /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Updating instance_info_cache with network_info: [{"id": "1d876bbd-c0b1-4c03-b47a-c413c6b9147c", "address": "fa:16:3e:19:90:9c", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d876bbd-c0", "ovs_interfaceid": "1d876bbd-c0b1-4c03-b47a-c413c6b9147c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-612e4609-6881-4373-9da0-ee5d762f7126" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f33a5a22-6611-4bf2-ac22-dacaf760fe7d tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "88f95d20-e391-4100-93b2-da29bfcf9704" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f33a5a22-6611-4bf2-ac22-dacaf760fe7d tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "88f95d20-e391-4100-93b2-da29bfcf9704" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f33a5a22-6611-4bf2-ac22-dacaf760fe7d tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "88f95d20-e391-4100-93b2-da29bfcf9704-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f33a5a22-6611-4bf2-ac22-dacaf760fe7d tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "88f95d20-e391-4100-93b2-da29bfcf9704-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:11:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f33a5a22-6611-4bf2-ac22-dacaf760fe7d tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "88f95d20-e391-4100-93b2-da29bfcf9704-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:11:36 user nova-compute[72504]: INFO nova.compute.manager [None req-f33a5a22-6611-4bf2-ac22-dacaf760fe7d tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Terminating instance
Aug 01 20:11:37 user nova-compute[72504]: DEBUG nova.compute.manager [None req-f33a5a22-6611-4bf2-ac22-dacaf760fe7d tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:11:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:37 user nova-compute[72504]: DEBUG nova.compute.manager [req-c691186f-e9c7-4c2f-9c4d-b468c0825794 req-c325ad2d-adc6-4259-815e-6fccf37a81a9 service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Received event network-vif-unplugged-3a4ace30-3ca6-4cc9-8125-599cc4097662 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:11:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c691186f-e9c7-4c2f-9c4d-b468c0825794 req-c325ad2d-adc6-4259-815e-6fccf37a81a9 service nova] Acquiring lock "88f95d20-e391-4100-93b2-da29bfcf9704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:11:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c691186f-e9c7-4c2f-9c4d-b468c0825794 req-c325ad2d-adc6-4259-815e-6fccf37a81a9 service nova] Lock "88f95d20-e391-4100-93b2-da29bfcf9704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:11:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c691186f-e9c7-4c2f-9c4d-b468c0825794 req-c325ad2d-adc6-4259-815e-6fccf37a81a9 service nova] Lock "88f95d20-e391-4100-93b2-da29bfcf9704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:11:37 user nova-compute[72504]: DEBUG nova.compute.manager [req-c691186f-e9c7-4c2f-9c4d-b468c0825794 req-c325ad2d-adc6-4259-815e-6fccf37a81a9 service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] No waiting events found dispatching network-vif-unplugged-3a4ace30-3ca6-4cc9-8125-599cc4097662 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:11:37 user nova-compute[72504]: DEBUG nova.compute.manager [req-c691186f-e9c7-4c2f-9c4d-b468c0825794 req-c325ad2d-adc6-4259-815e-6fccf37a81a9 service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Received event network-vif-unplugged-3a4ace30-3ca6-4cc9-8125-599cc4097662 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:11:37 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Instance destroyed successfully.
Aug 01 20:11:37 user nova-compute[72504]: DEBUG nova.objects.instance [None req-f33a5a22-6611-4bf2-ac22-dacaf760fe7d tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lazy-loading 'resources' on Instance uuid 88f95d20-e391-4100-93b2-da29bfcf9704 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:11:37 user nova-compute[72504]: DEBUG nova.network.neutron [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Successfully updated port: b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 20:11:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-f33a5a22-6611-4bf2-ac22-dacaf760fe7d tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T19:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1800688900',display_name='tempest-ServerActionsTestOtherA-server-1216550078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1800688900',id=18,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLbPu5MF6DPaLmysryryb5dEvmDVe/ZpzyX1JNIgtOIXBuGnF7k0B3yFjfDeyUfOXvFKWH1T1tnnmguBKUJb6gDrcdFY/x4LtLMGVeolXUhKxLNh5O13uubFnujvAs7Sg==',key_name='tempest-keypair-2041585985',keypairs=<?>,launch_index=0,launched_at=2023-08-01T19:59:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='816239d15d3341cdaa785fc36c8e7cdb',ramdisk_id='',reservation_id='r-5qhy089r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1009670506',owner_user_name='tempest-ServerActionsTestOtherA-1009670506-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T19:59:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d76765d1d24342f99ce0d65f416d382b',uuid=88f95d20-e391-4100-93b2-da29bfcf9704,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "address": "fa:16:3e:c3:aa:1c", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a4ace30-3c", "ovs_interfaceid": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:11:37 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-f33a5a22-6611-4bf2-ac22-dacaf760fe7d tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Converting VIF {"id": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "address": "fa:16:3e:c3:aa:1c", "network": {"id": "92749f96-d369-4df5-85ce-252c277e7ddf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806048076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "816239d15d3341cdaa785fc36c8e7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a4ace30-3c", "ovs_interfaceid": "3a4ace30-3ca6-4cc9-8125-599cc4097662", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:11:37 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-f33a5a22-6611-4bf2-ac22-dacaf760fe7d tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:aa:1c,bridge_name='br-int',has_traffic_filtering=True,id=3a4ace30-3ca6-4cc9-8125-599cc4097662,network=Network(92749f96-d369-4df5-85ce-252c277e7ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a4ace30-3c') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:11:37 user nova-compute[72504]: DEBUG os_vif [None req-f33a5a22-6611-4bf2-ac22-dacaf760fe7d tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:aa:1c,bridge_name='br-int',has_traffic_filtering=True,id=3a4ace30-3ca6-4cc9-8125-599cc4097662,network=Network(92749f96-d369-4df5-85ce-252c277e7ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a4ace30-3c') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:11:37 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:11:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a4ace30-3c, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:11:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "refresh_cache-a4f9c59c-cf0b-4216-a194-22712725328d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:11:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquired lock "refresh_cache-a4f9c59c-cf0b-4216-a194-22712725328d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:11:37 user nova-compute[72504]: DEBUG nova.network.neutron [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:11:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:11:37 user nova-compute[72504]: INFO os_vif [None req-f33a5a22-6611-4bf2-ac22-dacaf760fe7d tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:aa:1c,bridge_name='br-int',has_traffic_filtering=True,id=3a4ace30-3ca6-4cc9-8125-599cc4097662,network=Network(92749f96-d369-4df5-85ce-252c277e7ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a4ace30-3c')
Aug 01 20:11:37 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-f33a5a22-6611-4bf2-ac22-dacaf760fe7d tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Deleting instance files /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704_del
Aug 01 20:11:37 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-f33a5a22-6611-4bf2-ac22-dacaf760fe7d tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Deletion of /opt/stack/data/nova/instances/88f95d20-e391-4100-93b2-da29bfcf9704_del complete
Aug 01 20:11:37 user nova-compute[72504]: INFO nova.compute.manager [None req-f33a5a22-6611-4bf2-ac22-dacaf760fe7d tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 01 20:11:37 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-f33a5a22-6611-4bf2-ac22-dacaf760fe7d tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:11:37 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:11:37 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:11:37 user nova-compute[72504]: DEBUG nova.network.neutron [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.network.neutron [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Updating instance_info_cache with network_info: [{"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Releasing lock "refresh_cache-a4f9c59c-cf0b-4216-a194-22712725328d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.compute.manager [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Instance network_info: |[{"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Start _get_guest_xml network_info=[{"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:11:38 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:11:38 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-61706399',display_name='tempest-AttachVolumeTestJSON-server-61706399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-61706399',id=39,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkLGKKoGI8XVsLxOaZh71hKpWONiOBrT0aje+GastgHoLyKuLQKlYfDXp3OwjC4WlZ28DTo1JlEqCpYnSgt/d2rMN3aO60eaUVx+bzZGYhJZWV5gQhPPIA8s7t5AmK8sA==',key_name='tempest-keypair-1070424172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ef67b412883421f949be025bdc1cf38',ramdisk_id='',reservation_id='r-1eu867rc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1031917511',owner_user_name='tempest-AttachVolumeTestJSON-1031917511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:11:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90bea00e45b541baa6f98812cce770f8',uuid=a4f9c59c-cf0b-4216-a194-22712725328d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Converting VIF {"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:34:ea,bridge_name='br-int',has_traffic_filtering=True,id=b8f38092-7fe7-4274-8fcb-1e4a2808454e,network=Network(253a3888-9ae8-47b5-8875-9e4b823ac978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8f38092-7f') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.objects.instance [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'pci_devices' on Instance uuid a4f9c59c-cf0b-4216-a194-22712725328d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:11:38 user nova-compute[72504]:   <uuid>a4f9c59c-cf0b-4216-a194-22712725328d</uuid>
Aug 01 20:11:38 user nova-compute[72504]:   <name>instance-00000027</name>
Aug 01 20:11:38 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:11:38 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:11:38 user nova-compute[72504]:   <metadata>
Aug 01 20:11:38 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:11:38 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:11:38 user nova-compute[72504]:       <nova:name>tempest-AttachVolumeTestJSON-server-61706399</nova:name>
Aug 01 20:11:38 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:11:38</nova:creationTime>
Aug 01 20:11:38 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:11:38 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:11:38 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:11:38 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:11:38 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:11:38 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:11:38 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:11:38 user nova-compute[72504]:       <nova:owner>
Aug 01 20:11:38 user nova-compute[72504]:         <nova:user uuid="90bea00e45b541baa6f98812cce770f8">tempest-AttachVolumeTestJSON-1031917511-project-member</nova:user>
Aug 01 20:11:38 user nova-compute[72504]:         <nova:project uuid="8ef67b412883421f949be025bdc1cf38">tempest-AttachVolumeTestJSON-1031917511</nova:project>
Aug 01 20:11:38 user nova-compute[72504]:       </nova:owner>
Aug 01 20:11:38 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 20:11:38 user nova-compute[72504]:       <nova:ports>
Aug 01 20:11:38 user nova-compute[72504]:         <nova:port uuid="b8f38092-7fe7-4274-8fcb-1e4a2808454e">
Aug 01 20:11:38 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 20:11:38 user nova-compute[72504]:         </nova:port>
Aug 01 20:11:38 user nova-compute[72504]:       </nova:ports>
Aug 01 20:11:38 user nova-compute[72504]:     </nova:instance>
Aug 01 20:11:38 user nova-compute[72504]:   </metadata>
Aug 01 20:11:38 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:11:38 user nova-compute[72504]:     <system>
Aug 01 20:11:38 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:11:38 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:11:38 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:11:38 user nova-compute[72504]:       <entry name="serial">a4f9c59c-cf0b-4216-a194-22712725328d</entry>
Aug 01 20:11:38 user nova-compute[72504]:       <entry name="uuid">a4f9c59c-cf0b-4216-a194-22712725328d</entry>
Aug 01 20:11:38 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:11:38 user nova-compute[72504]:     </system>
Aug 01 20:11:38 user nova-compute[72504]:   </sysinfo>
Aug 01 20:11:38 user nova-compute[72504]:   <os>
Aug 01 20:11:38 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:11:38 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:11:38 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:11:38 user nova-compute[72504]:   </os>
Aug 01 20:11:38 user nova-compute[72504]:   <features>
Aug 01 20:11:38 user nova-compute[72504]:     <acpi/>
Aug 01 20:11:38 user nova-compute[72504]:     <apic/>
Aug 01 20:11:38 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:11:38 user nova-compute[72504]:   </features>
Aug 01 20:11:38 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:11:38 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:11:38 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:11:38 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:11:38 user nova-compute[72504]:   </clock>
Aug 01 20:11:38 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:11:38 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:11:38 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:11:38 user nova-compute[72504]:   </cpu>
Aug 01 20:11:38 user nova-compute[72504]:   <devices>
Aug 01 20:11:38 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 20:11:38 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 20:11:38 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk"/>
Aug 01 20:11:38 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:11:38 user nova-compute[72504]:     </disk>
Aug 01 20:11:38 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:11:38 user nova-compute[72504]:       <mac address="fa:16:3e:de:34:ea"/>
Aug 01 20:11:38 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:11:38 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:11:38 user nova-compute[72504]:       <target dev="tapb8f38092-7f"/>
Aug 01 20:11:38 user nova-compute[72504]:     </interface>
Aug 01 20:11:38 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:11:38 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/console.log" append="off"/>
Aug 01 20:11:38 user nova-compute[72504]:     </serial>
Aug 01 20:11:38 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:11:38 user nova-compute[72504]:     <video>
Aug 01 20:11:38 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:11:38 user nova-compute[72504]:     </video>
Aug 01 20:11:38 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:11:38 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:11:38 user nova-compute[72504]:     </rng>
Aug 01 20:11:38 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:11:38 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:11:38 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:11:38 user nova-compute[72504]:     </memballoon>
Aug 01 20:11:38 user nova-compute[72504]:   </devices>
Aug 01 20:11:38 user nova-compute[72504]: </domain>
Aug 01 20:11:38 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-61706399',display_name='tempest-AttachVolumeTestJSON-server-61706399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-61706399',id=39,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkLGKKoGI8XVsLxOaZh71hKpWONiOBrT0aje+GastgHoLyKuLQKlYfDXp3OwjC4WlZ28DTo1JlEqCpYnSgt/d2rMN3aO60eaUVx+bzZGYhJZWV5gQhPPIA8s7t5AmK8sA==',key_name='tempest-keypair-1070424172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ef67b412883421f949be025bdc1cf38',ramdisk_id='',reservation_id='r-1eu867rc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1031917511',owner_user_name='tempest-AttachVolumeTestJSON-1031917511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:11:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90bea00e45b541baa6f98812cce770f8',uuid=a4f9c59c-cf0b-4216-a194-22712725328d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Converting VIF {"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:34:ea,bridge_name='br-int',has_traffic_filtering=True,id=b8f38092-7fe7-4274-8fcb-1e4a2808454e,network=Network(253a3888-9ae8-47b5-8875-9e4b823ac978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8f38092-7f') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG os_vif [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:34:ea,bridge_name='br-int',has_traffic_filtering=True,id=b8f38092-7fe7-4274-8fcb-1e4a2808454e,network=Network(253a3888-9ae8-47b5-8875-9e4b823ac978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8f38092-7f') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8f38092-7f, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb8f38092-7f, col_values=(('external_ids', {'iface-id': 'b8f38092-7fe7-4274-8fcb-1e4a2808454e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:34:ea', 'vm-uuid': 'a4f9c59c-cf0b-4216-a194-22712725328d'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:38 user nova-compute[72504]: INFO os_vif [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:34:ea,bridge_name='br-int',has_traffic_filtering=True,id=b8f38092-7fe7-4274-8fcb-1e4a2808454e,network=Network(253a3888-9ae8-47b5-8875-9e4b823ac978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8f38092-7f')
Aug 01 20:11:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] No VIF found with MAC fa:16:3e:de:34:ea, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.compute.manager [req-4cb83b2e-3242-4bf4-b21e-56bb09b5e958 req-c851d287-7465-4302-a755-6d0cc7f851f0 service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Received event network-vif-deleted-3a4ace30-3ca6-4cc9-8125-599cc4097662 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:11:38 user nova-compute[72504]: INFO nova.compute.manager [req-4cb83b2e-3242-4bf4-b21e-56bb09b5e958 req-c851d287-7465-4302-a755-6d0cc7f851f0 service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Neutron deleted interface 3a4ace30-3ca6-4cc9-8125-599cc4097662; detaching it from the instance and deleting it from the info cache
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.network.neutron [req-4cb83b2e-3242-4bf4-b21e-56bb09b5e958 req-c851d287-7465-4302-a755-6d0cc7f851f0 service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:11:38 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Took 0.94 seconds to deallocate network for instance.
Aug 01 20:11:38 user nova-compute[72504]: DEBUG nova.compute.manager [req-4cb83b2e-3242-4bf4-b21e-56bb09b5e958 req-c851d287-7465-4302-a755-6d0cc7f851f0 service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Detach interface failed, port_id=3a4ace30-3ca6-4cc9-8125-599cc4097662, reason: Instance 88f95d20-e391-4100-93b2-da29bfcf9704 could not be found. {{(pid=72504) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f33a5a22-6611-4bf2-ac22-dacaf760fe7d tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:11:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f33a5a22-6611-4bf2-ac22-dacaf760fe7d tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:11:39 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-f33a5a22-6611-4bf2-ac22-dacaf760fe7d tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:11:39 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-f33a5a22-6611-4bf2-ac22-dacaf760fe7d tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:11:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f33a5a22-6611-4bf2-ac22-dacaf760fe7d tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:11:39 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-f33a5a22-6611-4bf2-ac22-dacaf760fe7d tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Deleted allocations for instance 88f95d20-e391-4100-93b2-da29bfcf9704
Aug 01 20:11:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f33a5a22-6611-4bf2-ac22-dacaf760fe7d tempest-ServerActionsTestOtherA-1009670506 tempest-ServerActionsTestOtherA-1009670506-project-member] Lock "88f95d20-e391-4100-93b2-da29bfcf9704" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.294s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:11:39 user nova-compute[72504]: DEBUG nova.compute.manager [req-6486b6b5-2f33-4995-a587-7773e4f6faf3 req-5e76e2d1-a1b2-4c6c-869d-9708694957aa service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Received event network-changed-b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:11:39 user nova-compute[72504]: DEBUG nova.compute.manager [req-6486b6b5-2f33-4995-a587-7773e4f6faf3 req-5e76e2d1-a1b2-4c6c-869d-9708694957aa service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Refreshing instance network info cache due to event network-changed-b8f38092-7fe7-4274-8fcb-1e4a2808454e. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:11:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6486b6b5-2f33-4995-a587-7773e4f6faf3 req-5e76e2d1-a1b2-4c6c-869d-9708694957aa service nova] Acquiring lock "refresh_cache-a4f9c59c-cf0b-4216-a194-22712725328d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:11:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6486b6b5-2f33-4995-a587-7773e4f6faf3 req-5e76e2d1-a1b2-4c6c-869d-9708694957aa service nova] Acquired lock "refresh_cache-a4f9c59c-cf0b-4216-a194-22712725328d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:11:39 user nova-compute[72504]: DEBUG nova.network.neutron [req-6486b6b5-2f33-4995-a587-7773e4f6faf3 req-5e76e2d1-a1b2-4c6c-869d-9708694957aa service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Refreshing network info cache for port b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:11:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:40 user nova-compute[72504]: DEBUG nova.network.neutron [req-6486b6b5-2f33-4995-a587-7773e4f6faf3 req-5e76e2d1-a1b2-4c6c-869d-9708694957aa service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Updated VIF entry in instance network info cache for port b8f38092-7fe7-4274-8fcb-1e4a2808454e. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:11:40 user nova-compute[72504]: DEBUG nova.network.neutron [req-6486b6b5-2f33-4995-a587-7773e4f6faf3 req-5e76e2d1-a1b2-4c6c-869d-9708694957aa service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Updating instance_info_cache with network_info: [{"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:11:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6486b6b5-2f33-4995-a587-7773e4f6faf3 req-5e76e2d1-a1b2-4c6c-869d-9708694957aa service nova] Releasing lock "refresh_cache-a4f9c59c-cf0b-4216-a194-22712725328d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:11:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-6486b6b5-2f33-4995-a587-7773e4f6faf3 req-5e76e2d1-a1b2-4c6c-869d-9708694957aa service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Received event network-vif-plugged-3a4ace30-3ca6-4cc9-8125-599cc4097662 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:11:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6486b6b5-2f33-4995-a587-7773e4f6faf3 req-5e76e2d1-a1b2-4c6c-869d-9708694957aa service nova] Acquiring lock "88f95d20-e391-4100-93b2-da29bfcf9704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:11:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6486b6b5-2f33-4995-a587-7773e4f6faf3 req-5e76e2d1-a1b2-4c6c-869d-9708694957aa service nova] Lock "88f95d20-e391-4100-93b2-da29bfcf9704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:11:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6486b6b5-2f33-4995-a587-7773e4f6faf3 req-5e76e2d1-a1b2-4c6c-869d-9708694957aa service nova] Lock "88f95d20-e391-4100-93b2-da29bfcf9704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:11:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-6486b6b5-2f33-4995-a587-7773e4f6faf3 req-5e76e2d1-a1b2-4c6c-869d-9708694957aa service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] No waiting events found dispatching network-vif-plugged-3a4ace30-3ca6-4cc9-8125-599cc4097662 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:11:40 user nova-compute[72504]: WARNING nova.compute.manager [req-6486b6b5-2f33-4995-a587-7773e4f6faf3 req-5e76e2d1-a1b2-4c6c-869d-9708694957aa service nova] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Received unexpected event network-vif-plugged-3a4ace30-3ca6-4cc9-8125-599cc4097662 for instance with vm_state deleted and task_state None.
Aug 01 20:11:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-0679bf0c-b167-4e5b-944a-3d46b81ee981 req-7d119a3e-f2a9-463d-bd6f-6e26078f4ed9 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Received event network-vif-plugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:11:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0679bf0c-b167-4e5b-944a-3d46b81ee981 req-7d119a3e-f2a9-463d-bd6f-6e26078f4ed9 service nova] Acquiring lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:11:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0679bf0c-b167-4e5b-944a-3d46b81ee981 req-7d119a3e-f2a9-463d-bd6f-6e26078f4ed9 service nova] Lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:11:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0679bf0c-b167-4e5b-944a-3d46b81ee981 req-7d119a3e-f2a9-463d-bd6f-6e26078f4ed9 service nova] Lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:11:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-0679bf0c-b167-4e5b-944a-3d46b81ee981 req-7d119a3e-f2a9-463d-bd6f-6e26078f4ed9 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] No waiting events found dispatching network-vif-plugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:11:41 user nova-compute[72504]: WARNING nova.compute.manager [req-0679bf0c-b167-4e5b-944a-3d46b81ee981 req-7d119a3e-f2a9-463d-bd6f-6e26078f4ed9 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Received unexpected event network-vif-plugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e for instance with vm_state building and task_state spawning.
Aug 01 20:11:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-0679bf0c-b167-4e5b-944a-3d46b81ee981 req-7d119a3e-f2a9-463d-bd6f-6e26078f4ed9 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Received event network-vif-plugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:11:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0679bf0c-b167-4e5b-944a-3d46b81ee981 req-7d119a3e-f2a9-463d-bd6f-6e26078f4ed9 service nova] Acquiring lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:11:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0679bf0c-b167-4e5b-944a-3d46b81ee981 req-7d119a3e-f2a9-463d-bd6f-6e26078f4ed9 service nova] Lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:11:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0679bf0c-b167-4e5b-944a-3d46b81ee981 req-7d119a3e-f2a9-463d-bd6f-6e26078f4ed9 service nova] Lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:11:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-0679bf0c-b167-4e5b-944a-3d46b81ee981 req-7d119a3e-f2a9-463d-bd6f-6e26078f4ed9 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] No waiting events found dispatching network-vif-plugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:11:41 user nova-compute[72504]: WARNING nova.compute.manager [req-0679bf0c-b167-4e5b-944a-3d46b81ee981 req-7d119a3e-f2a9-463d-bd6f-6e26078f4ed9 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Received unexpected event network-vif-plugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e for instance with vm_state building and task_state spawning.
Aug 01 20:11:42 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920702.0088418, a4f9c59c-cf0b-4216-a194-22712725328d => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:11:42 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] VM Resumed (Lifecycle Event)
Aug 01 20:11:42 user nova-compute[72504]: DEBUG nova.compute.manager [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:11:42 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:11:42 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Instance spawned successfully.
Aug 01 20:11:42 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 20:11:42 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:11:42 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:11:42 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:11:42 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:11:42 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:11:42 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:11:42 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:11:42 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:11:42 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:11:42 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920702.012661, a4f9c59c-cf0b-4216-a194-22712725328d => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:11:42 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] VM Started (Lifecycle Event)
Aug 01 20:11:42 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:11:42 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:11:42 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:11:42 user nova-compute[72504]: INFO nova.compute.manager [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Took 6.27 seconds to spawn the instance on the hypervisor.
Aug 01 20:11:42 user nova-compute[72504]: DEBUG nova.compute.manager [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:11:42 user nova-compute[72504]: INFO nova.compute.manager [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Took 7.23 seconds to build instance.
Aug 01 20:11:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9c57103d-905f-4e16-b516-6bdde9e2fe45 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "a4f9c59c-cf0b-4216-a194-22712725328d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.329s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:11:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:52 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690920697.797846, 88f95d20-e391-4100-93b2-da29bfcf9704 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:11:52 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] VM Stopped (Lifecycle Event)
Aug 01 20:11:52 user nova-compute[72504]: DEBUG nova.compute.manager [None req-fcf1258b-ff8e-4820-a743-1724af354218 None None] [instance: 88f95d20-e391-4100-93b2-da29bfcf9704] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:11:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:11:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:11:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:11:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:11:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:11:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:02 user nova-compute[72504]: DEBUG nova.compute.manager [req-2d6b91d6-5c87-4c3e-912c-9dca7205685b req-e2ced9b8-2518-4cfb-9e5f-877a2eabb324 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received event network-changed-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:12:02 user nova-compute[72504]: DEBUG nova.compute.manager [req-2d6b91d6-5c87-4c3e-912c-9dca7205685b req-e2ced9b8-2518-4cfb-9e5f-877a2eabb324 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Refreshing instance network info cache due to event network-changed-298ca2cd-b389-42be-bc06-05344f41e0d2. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:12:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2d6b91d6-5c87-4c3e-912c-9dca7205685b req-e2ced9b8-2518-4cfb-9e5f-877a2eabb324 service nova] Acquiring lock "refresh_cache-9ac6b63a-2c5a-4f72-9dc3-8f884253e180" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:12:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2d6b91d6-5c87-4c3e-912c-9dca7205685b req-e2ced9b8-2518-4cfb-9e5f-877a2eabb324 service nova] Acquired lock "refresh_cache-9ac6b63a-2c5a-4f72-9dc3-8f884253e180" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:12:02 user nova-compute[72504]: DEBUG nova.network.neutron [req-2d6b91d6-5c87-4c3e-912c-9dca7205685b req-e2ced9b8-2518-4cfb-9e5f-877a2eabb324 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Refreshing network info cache for port 298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:12:03 user nova-compute[72504]: DEBUG nova.network.neutron [req-2d6b91d6-5c87-4c3e-912c-9dca7205685b req-e2ced9b8-2518-4cfb-9e5f-877a2eabb324 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Updated VIF entry in instance network info cache for port 298ca2cd-b389-42be-bc06-05344f41e0d2. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:12:03 user nova-compute[72504]: DEBUG nova.network.neutron [req-2d6b91d6-5c87-4c3e-912c-9dca7205685b req-e2ced9b8-2518-4cfb-9e5f-877a2eabb324 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Updating instance_info_cache with network_info: [{"id": "298ca2cd-b389-42be-bc06-05344f41e0d2", "address": "fa:16:3e:74:2e:28", "network": {"id": "d4bfb5e4-0509-436d-8605-07b850de35b1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1900175842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f084e19e3c674b308d8a566f57bba3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ca2cd-b3", "ovs_interfaceid": "298ca2cd-b389-42be-bc06-05344f41e0d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:12:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2d6b91d6-5c87-4c3e-912c-9dca7205685b req-e2ced9b8-2518-4cfb-9e5f-877a2eabb324 service nova] Releasing lock "refresh_cache-9ac6b63a-2c5a-4f72-9dc3-8f884253e180" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:12:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3e8b6ce5-c590-4990-a6b5-3e5c7f8cf6c2 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:12:03 user nova-compute[72504]: INFO nova.compute.manager [None req-3e8b6ce5-c590-4990-a6b5-3e5c7f8cf6c2 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] instance snapshotting
Aug 01 20:12:04 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-3e8b6ce5-c590-4990-a6b5-3e5c7f8cf6c2 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Beginning live snapshot process
Aug 01 20:12:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3e8b6ce5-c590-4990-a6b5-3e5c7f8cf6c2 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json -f qcow2 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:12:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3e8b6ce5-c590-4990-a6b5-3e5c7f8cf6c2 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json -f qcow2" returned: 0 in 0.151s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:12:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3e8b6ce5-c590-4990-a6b5-3e5c7f8cf6c2 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json -f qcow2 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:12:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3e8b6ce5-c590-4990-a6b5-3e5c7f8cf6c2 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json -f qcow2" returned: 0 in 0.168s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:12:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3e8b6ce5-c590-4990-a6b5-3e5c7f8cf6c2 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:12:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3e8b6ce5-c590-4990-a6b5-3e5c7f8cf6c2 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.156s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:12:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3e8b6ce5-c590-4990-a6b5-3e5c7f8cf6c2 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpihscjjxh/5d737ad9416a4727a6ec4370d61d2bc0.delta 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:12:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3e8b6ce5-c590-4990-a6b5-3e5c7f8cf6c2 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpihscjjxh/5d737ad9416a4727a6ec4370d61d2bc0.delta 1073741824" returned: 0 in 0.059s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:12:04 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-3e8b6ce5-c590-4990-a6b5-3e5c7f8cf6c2 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 20:12:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-88be42e0-e47f-4235-b4c4-2b481f5b61f2 req-ebe316f0-250f-409f-a060-cf1f667f4f89 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Received event network-changed-a28b48bd-a25d-4254-9a02-e51941979d03 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:12:04 user nova-compute[72504]: DEBUG nova.compute.manager [req-88be42e0-e47f-4235-b4c4-2b481f5b61f2 req-ebe316f0-250f-409f-a060-cf1f667f4f89 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Refreshing instance network info cache due to event network-changed-a28b48bd-a25d-4254-9a02-e51941979d03. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:12:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-88be42e0-e47f-4235-b4c4-2b481f5b61f2 req-ebe316f0-250f-409f-a060-cf1f667f4f89 service nova] Acquiring lock "refresh_cache-eaa9af64-231b-4202-ba63-f18b293509da" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:12:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-88be42e0-e47f-4235-b4c4-2b481f5b61f2 req-ebe316f0-250f-409f-a060-cf1f667f4f89 service nova] Acquired lock "refresh_cache-eaa9af64-231b-4202-ba63-f18b293509da" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:12:04 user nova-compute[72504]: DEBUG nova.network.neutron [req-88be42e0-e47f-4235-b4c4-2b481f5b61f2 req-ebe316f0-250f-409f-a060-cf1f667f4f89 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Refreshing network info cache for port a28b48bd-a25d-4254-9a02-e51941979d03 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:12:05 user nova-compute[72504]: DEBUG nova.network.neutron [req-88be42e0-e47f-4235-b4c4-2b481f5b61f2 req-ebe316f0-250f-409f-a060-cf1f667f4f89 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Updated VIF entry in instance network info cache for port a28b48bd-a25d-4254-9a02-e51941979d03. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:12:05 user nova-compute[72504]: DEBUG nova.network.neutron [req-88be42e0-e47f-4235-b4c4-2b481f5b61f2 req-ebe316f0-250f-409f-a060-cf1f667f4f89 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Updating instance_info_cache with network_info: [{"id": "a28b48bd-a25d-4254-9a02-e51941979d03", "address": "fa:16:3e:70:92:f2", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa28b48bd-a2", "ovs_interfaceid": "a28b48bd-a25d-4254-9a02-e51941979d03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:12:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-88be42e0-e47f-4235-b4c4-2b481f5b61f2 req-ebe316f0-250f-409f-a060-cf1f667f4f89 service nova] Releasing lock "refresh_cache-eaa9af64-231b-4202-ba63-f18b293509da" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:12:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-3e8b6ce5-c590-4990-a6b5-3e5c7f8cf6c2 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72504) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 20:12:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "eaa9af64-231b-4202-ba63-f18b293509da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:12:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "eaa9af64-231b-4202-ba63-f18b293509da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:12:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "eaa9af64-231b-4202-ba63-f18b293509da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:12:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "eaa9af64-231b-4202-ba63-f18b293509da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:12:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "eaa9af64-231b-4202-ba63-f18b293509da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:12:05 user nova-compute[72504]: INFO nova.compute.manager [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Terminating instance
Aug 01 20:12:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:12:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-3e8b6ce5-c590-4990-a6b5-3e5c7f8cf6c2 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72504) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 20:12:06 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-3e8b6ce5-c590-4990-a6b5-3e5c7f8cf6c2 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 20:12:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:06 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Instance destroyed successfully.
Aug 01 20:12:06 user nova-compute[72504]: DEBUG nova.objects.instance [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lazy-loading 'resources' on Instance uuid eaa9af64-231b-4202-ba63-f18b293509da {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG nova.privsep.utils [None req-3e8b6ce5-c590-4990-a6b5-3e5c7f8cf6c2 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72504) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3e8b6ce5-c590-4990-a6b5-3e5c7f8cf6c2 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpihscjjxh/5d737ad9416a4727a6ec4370d61d2bc0.delta /opt/stack/data/nova/instances/snapshots/tmpihscjjxh/5d737ad9416a4727a6ec4370d61d2bc0 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:10:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1882787420',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1882787420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1882787420',id=38,image_ref='3ee68730-f239-4f35-9ca3-f7d04e85b637',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMZueVIxJXrfuNCwvkaltc/Egc0qVjIcSt64ojW9OLXmkqnL+xy33//hgegowXOlgqcKyN2r/vrmqIrHHhkMoFIMA3m7NRil6QRwNEQW8vFtoyPu9gch4UvBpyItt72JA==',key_name='tempest-keypair-254298215',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:10:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb59fbc2bf9749f3af7d56435cb37066',ramdisk_id='',reservation_id='r-pqadf02o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-685885098',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-685885098-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-685885098',owner_user_name='tempest-TestVolumeBootPattern-685885098-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f06381c8a6214ddea7f1b36b623ed4d5',uuid=eaa9af64-231b-4202-ba63-f18b293509da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a28b48bd-a25d-4254-9a02-e51941979d03", "address": "fa:16:3e:70:92:f2", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa28b48bd-a2", "ovs_interfaceid": "a28b48bd-a25d-4254-9a02-e51941979d03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converting VIF {"id": "a28b48bd-a25d-4254-9a02-e51941979d03", "address": "fa:16:3e:70:92:f2", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa28b48bd-a2", "ovs_interfaceid": "a28b48bd-a25d-4254-9a02-e51941979d03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:92:f2,bridge_name='br-int',has_traffic_filtering=True,id=a28b48bd-a25d-4254-9a02-e51941979d03,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa28b48bd-a2') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG os_vif [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:92:f2,bridge_name='br-int',has_traffic_filtering=True,id=a28b48bd-a25d-4254-9a02-e51941979d03,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa28b48bd-a2') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa28b48bd-a2, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:12:06 user nova-compute[72504]: INFO os_vif [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:92:f2,bridge_name='br-int',has_traffic_filtering=True,id=a28b48bd-a25d-4254-9a02-e51941979d03,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa28b48bd-a2')
Aug 01 20:12:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYZfzEtU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:12:06 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:12:06 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.035s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f445542-b7e5-4999-a01d-df10846a6e81]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.070s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40d8338-452b-4605-8c6b-73e54f33a62e]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b (non-flash)
Aug 01 20:12:06 user nova-compute[72504]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 (non-flash)
Aug 01 20:12:06 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b (non-flash)
Aug 01 20:12:06 user nova-compute[72504]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 (non-flash)
Aug 01 20:12:06 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff41871bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395'): ({'sdc'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Removing single pathed devices sdc {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1178387-3dec-44e3-a57a-41bc5a97fb96]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.031s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcaa3e1-103f-4288-a744-24aeb2dde53a]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Flushing IO for device /dev/sdc {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ba573d-3b35-4158-9d2d-9ffe9e5813dc]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.081s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cd936e-b9d5-4e42-8162-63495a128ca4]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:12:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3e8b6ce5-c590-4990-a6b5-3e5c7f8cf6c2 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpihscjjxh/5d737ad9416a4727a6ec4370d61d2bc0.delta /opt/stack/data/nova/instances/snapshots/tmpihscjjxh/5d737ad9416a4727a6ec4370d61d2bc0" returned: 0 in 0.422s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:12:07 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-3e8b6ce5-c590-4990-a6b5-3e5c7f8cf6c2 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Snapshot extracted, beginning image upload
Aug 01 20:12:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e5c6ad-c398-47a1-91e4-f9a782633c97]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG nova.compute.manager [req-eb536a06-be7f-4ea2-812d-7e86f64004e0 req-f62d81cf-9d50-4f98-971c-f68ebf4439b8 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Received event network-vif-unplugged-a28b48bd-a25d-4254-9a02-e51941979d03 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-eb536a06-be7f-4ea2-812d-7e86f64004e0 req-f62d81cf-9d50-4f98-971c-f68ebf4439b8 service nova] Acquiring lock "eaa9af64-231b-4202-ba63-f18b293509da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-eb536a06-be7f-4ea2-812d-7e86f64004e0 req-f62d81cf-9d50-4f98-971c-f68ebf4439b8 service nova] Lock "eaa9af64-231b-4202-ba63-f18b293509da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-eb536a06-be7f-4ea2-812d-7e86f64004e0 req-f62d81cf-9d50-4f98-971c-f68ebf4439b8 service nova] Lock "eaa9af64-231b-4202-ba63-f18b293509da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG nova.compute.manager [req-eb536a06-be7f-4ea2-812d-7e86f64004e0 req-f62d81cf-9d50-4f98-971c-f68ebf4439b8 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] No waiting events found dispatching network-vif-unplugged-a28b48bd-a25d-4254-9a02-e51941979d03 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG nova.compute.manager [req-eb536a06-be7f-4ea2-812d-7e86f64004e0 req-f62d81cf-9d50-4f98-971c-f68ebf4439b8 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Received event network-vif-unplugged-a28b48bd-a25d-4254-9a02-e51941979d03 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG nova.compute.manager [req-eb536a06-be7f-4ea2-812d-7e86f64004e0 req-f62d81cf-9d50-4f98-971c-f68ebf4439b8 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Received event network-vif-plugged-a28b48bd-a25d-4254-9a02-e51941979d03 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-eb536a06-be7f-4ea2-812d-7e86f64004e0 req-f62d81cf-9d50-4f98-971c-f68ebf4439b8 service nova] Acquiring lock "eaa9af64-231b-4202-ba63-f18b293509da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-eb536a06-be7f-4ea2-812d-7e86f64004e0 req-f62d81cf-9d50-4f98-971c-f68ebf4439b8 service nova] Lock "eaa9af64-231b-4202-ba63-f18b293509da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-eb536a06-be7f-4ea2-812d-7e86f64004e0 req-f62d81cf-9d50-4f98-971c-f68ebf4439b8 service nova] Lock "eaa9af64-231b-4202-ba63-f18b293509da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG nova.compute.manager [req-eb536a06-be7f-4ea2-812d-7e86f64004e0 req-f62d81cf-9d50-4f98-971c-f68ebf4439b8 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] No waiting events found dispatching network-vif-plugged-a28b48bd-a25d-4254-9a02-e51941979d03 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:12:07 user nova-compute[72504]: WARNING nova.compute.manager [req-eb536a06-be7f-4ea2-812d-7e86f64004e0 req-f62d81cf-9d50-4f98-971c-f68ebf4439b8 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Received unexpected event network-vif-plugged-a28b48bd-a25d-4254-9a02-e51941979d03 for instance with vm_state active and task_state deleting.
Aug 01 20:12:07 user nova-compute[72504]: DEBUG nova.compute.manager [req-eb536a06-be7f-4ea2-812d-7e86f64004e0 req-f62d81cf-9d50-4f98-971c-f68ebf4439b8 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Received event network-vif-plugged-a28b48bd-a25d-4254-9a02-e51941979d03 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-eb536a06-be7f-4ea2-812d-7e86f64004e0 req-f62d81cf-9d50-4f98-971c-f68ebf4439b8 service nova] Acquiring lock "eaa9af64-231b-4202-ba63-f18b293509da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-eb536a06-be7f-4ea2-812d-7e86f64004e0 req-f62d81cf-9d50-4f98-971c-f68ebf4439b8 service nova] Lock "eaa9af64-231b-4202-ba63-f18b293509da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-eb536a06-be7f-4ea2-812d-7e86f64004e0 req-f62d81cf-9d50-4f98-971c-f68ebf4439b8 service nova] Lock "eaa9af64-231b-4202-ba63-f18b293509da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG nova.compute.manager [req-eb536a06-be7f-4ea2-812d-7e86f64004e0 req-f62d81cf-9d50-4f98-971c-f68ebf4439b8 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] No waiting events found dispatching network-vif-plugged-a28b48bd-a25d-4254-9a02-e51941979d03 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:12:07 user nova-compute[72504]: WARNING nova.compute.manager [req-eb536a06-be7f-4ea2-812d-7e86f64004e0 req-f62d81cf-9d50-4f98-971c-f68ebf4439b8 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Received unexpected event network-vif-plugged-a28b48bd-a25d-4254-9a02-e51941979d03 for instance with vm_state active and task_state deleting.
Aug 01 20:12:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[484fa00f-4a46-490c-93f3-12606d691b41]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395, portal: 172.16.0.220,3260]
Aug 01 20:12:07 user nova-compute[72504]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395, portal: 172.16.0.220,3260] successful.
Aug 01 20:12:07 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1bd4286-77c7-4659-aa04-598bdb02f395 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c5ab00-41d5-4691-a03f-047a84480d6d]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.457s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] <== disconnect_volume: return (459ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:12:07 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Deleting instance files /opt/stack/data/nova/instances/eaa9af64-231b-4202-ba63-f18b293509da_del
Aug 01 20:12:07 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Deletion of /opt/stack/data/nova/instances/eaa9af64-231b-4202-ba63-f18b293509da_del complete
Aug 01 20:12:07 user nova-compute[72504]: INFO nova.compute.manager [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Took 1.51 seconds to destroy the instance on the hypervisor.
Aug 01 20:12:07 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:12:07 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: eaa9af64-231b-4202-ba63-f18b293509da] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:12:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:08 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:12:08 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Took 1.60 seconds to deallocate network for instance.
Aug 01 20:12:09 user nova-compute[72504]: DEBUG nova.compute.manager [req-77c1b8e8-1a87-43af-9005-7889de484d93 req-50c20f86-50b1-4c42-a077-9b75f7bcb7b2 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Received event network-vif-plugged-a28b48bd-a25d-4254-9a02-e51941979d03 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:12:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-77c1b8e8-1a87-43af-9005-7889de484d93 req-50c20f86-50b1-4c42-a077-9b75f7bcb7b2 service nova] Acquiring lock "eaa9af64-231b-4202-ba63-f18b293509da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:12:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-77c1b8e8-1a87-43af-9005-7889de484d93 req-50c20f86-50b1-4c42-a077-9b75f7bcb7b2 service nova] Lock "eaa9af64-231b-4202-ba63-f18b293509da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:12:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-77c1b8e8-1a87-43af-9005-7889de484d93 req-50c20f86-50b1-4c42-a077-9b75f7bcb7b2 service nova] Lock "eaa9af64-231b-4202-ba63-f18b293509da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:12:09 user nova-compute[72504]: DEBUG nova.compute.manager [req-77c1b8e8-1a87-43af-9005-7889de484d93 req-50c20f86-50b1-4c42-a077-9b75f7bcb7b2 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] No waiting events found dispatching network-vif-plugged-a28b48bd-a25d-4254-9a02-e51941979d03 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:12:09 user nova-compute[72504]: WARNING nova.compute.manager [req-77c1b8e8-1a87-43af-9005-7889de484d93 req-50c20f86-50b1-4c42-a077-9b75f7bcb7b2 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Received unexpected event network-vif-plugged-a28b48bd-a25d-4254-9a02-e51941979d03 for instance with vm_state active and task_state deleting.
Aug 01 20:12:09 user nova-compute[72504]: DEBUG nova.compute.manager [req-77c1b8e8-1a87-43af-9005-7889de484d93 req-50c20f86-50b1-4c42-a077-9b75f7bcb7b2 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Received event network-vif-unplugged-a28b48bd-a25d-4254-9a02-e51941979d03 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:12:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-77c1b8e8-1a87-43af-9005-7889de484d93 req-50c20f86-50b1-4c42-a077-9b75f7bcb7b2 service nova] Acquiring lock "eaa9af64-231b-4202-ba63-f18b293509da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:12:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-77c1b8e8-1a87-43af-9005-7889de484d93 req-50c20f86-50b1-4c42-a077-9b75f7bcb7b2 service nova] Lock "eaa9af64-231b-4202-ba63-f18b293509da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:12:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-77c1b8e8-1a87-43af-9005-7889de484d93 req-50c20f86-50b1-4c42-a077-9b75f7bcb7b2 service nova] Lock "eaa9af64-231b-4202-ba63-f18b293509da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:12:09 user nova-compute[72504]: DEBUG nova.compute.manager [req-77c1b8e8-1a87-43af-9005-7889de484d93 req-50c20f86-50b1-4c42-a077-9b75f7bcb7b2 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] No waiting events found dispatching network-vif-unplugged-a28b48bd-a25d-4254-9a02-e51941979d03 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:12:09 user nova-compute[72504]: DEBUG nova.compute.manager [req-77c1b8e8-1a87-43af-9005-7889de484d93 req-50c20f86-50b1-4c42-a077-9b75f7bcb7b2 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Received event network-vif-unplugged-a28b48bd-a25d-4254-9a02-e51941979d03 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:12:09 user nova-compute[72504]: DEBUG nova.compute.manager [req-77c1b8e8-1a87-43af-9005-7889de484d93 req-50c20f86-50b1-4c42-a077-9b75f7bcb7b2 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Received event network-vif-plugged-a28b48bd-a25d-4254-9a02-e51941979d03 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:12:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-77c1b8e8-1a87-43af-9005-7889de484d93 req-50c20f86-50b1-4c42-a077-9b75f7bcb7b2 service nova] Acquiring lock "eaa9af64-231b-4202-ba63-f18b293509da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:12:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-77c1b8e8-1a87-43af-9005-7889de484d93 req-50c20f86-50b1-4c42-a077-9b75f7bcb7b2 service nova] Lock "eaa9af64-231b-4202-ba63-f18b293509da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:12:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-77c1b8e8-1a87-43af-9005-7889de484d93 req-50c20f86-50b1-4c42-a077-9b75f7bcb7b2 service nova] Lock "eaa9af64-231b-4202-ba63-f18b293509da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:12:09 user nova-compute[72504]: DEBUG nova.compute.manager [req-77c1b8e8-1a87-43af-9005-7889de484d93 req-50c20f86-50b1-4c42-a077-9b75f7bcb7b2 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] No waiting events found dispatching network-vif-plugged-a28b48bd-a25d-4254-9a02-e51941979d03 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:12:09 user nova-compute[72504]: WARNING nova.compute.manager [req-77c1b8e8-1a87-43af-9005-7889de484d93 req-50c20f86-50b1-4c42-a077-9b75f7bcb7b2 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Received unexpected event network-vif-plugged-a28b48bd-a25d-4254-9a02-e51941979d03 for instance with vm_state active and task_state deleting.
Aug 01 20:12:09 user nova-compute[72504]: DEBUG nova.compute.manager [req-77c1b8e8-1a87-43af-9005-7889de484d93 req-50c20f86-50b1-4c42-a077-9b75f7bcb7b2 service nova] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Received event network-vif-deleted-a28b48bd-a25d-4254-9a02-e51941979d03 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:12:09 user nova-compute[72504]: INFO nova.compute.manager [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Took 0.84 seconds to detach 1 volumes for instance.
Aug 01 20:12:09 user nova-compute[72504]: DEBUG nova.compute.manager [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Deleting volume: f1bd4286-77c7-4659-aa04-598bdb02f395 {{(pid=72504) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 20:12:09 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-3e8b6ce5-c590-4990-a6b5-3e5c7f8cf6c2 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Snapshot image upload complete
Aug 01 20:12:09 user nova-compute[72504]: INFO nova.compute.manager [None req-3e8b6ce5-c590-4990-a6b5-3e5c7f8cf6c2 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Took 5.78 seconds to snapshot the instance on the hypervisor.
Aug 01 20:12:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:12:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:12:09 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:12:09 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:12:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:12:09 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Deleted allocations for instance eaa9af64-231b-4202-ba63-f18b293509da
Aug 01 20:12:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-670ab03d-b568-4317-b2a2-8d9f69b56de5 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "eaa9af64-231b-4202-ba63-f18b293509da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.381s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:12:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:21 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690920726.5412118, eaa9af64-231b-4202-ba63-f18b293509da => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:12:21 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: eaa9af64-231b-4202-ba63-f18b293509da] VM Stopped (Lifecycle Event)
Aug 01 20:12:21 user nova-compute[72504]: DEBUG nova.compute.manager [None req-a681edf8-7fff-4de3-bcb2-791354d5a277 None None] [instance: eaa9af64-231b-4202-ba63-f18b293509da] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:12:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:26 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:12:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:28 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:12:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:30 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:12:30 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:12:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:33 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:12:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:12:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:12:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:12:33 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:12:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:12:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:12:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:12:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:12:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:12:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:12:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:12:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:12:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:12:35 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:12:35 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:12:35 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8378MB free_disk=25.26193618774414GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:12:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:12:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:12:35 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 612e4609-6881-4373-9da0-ee5d762f7126 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:12:35 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:12:35 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance a4f9c59c-cf0b-4216-a194-22712725328d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:12:35 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:12:35 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:12:35 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:12:35 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:12:35 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:12:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.273s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:12:36 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:12:36 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:12:36 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 20:12:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-612e4609-6881-4373-9da0-ee5d762f7126" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:12:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-612e4609-6881-4373-9da0-ee5d762f7126" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:12:36 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:12:36 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lazy-loading 'info_cache' on Instance uuid 612e4609-6881-4373-9da0-ee5d762f7126 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:12:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:36 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Updating instance_info_cache with network_info: [{"id": "1d876bbd-c0b1-4c03-b47a-c413c6b9147c", "address": "fa:16:3e:19:90:9c", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d876bbd-c0", "ovs_interfaceid": "1d876bbd-c0b1-4c03-b47a-c413c6b9147c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:12:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-612e4609-6881-4373-9da0-ee5d762f7126" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:12:36 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:12:36 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:12:36 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:12:37 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:12:38 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:12:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:12:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:12:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:12:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:12:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:51 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:12:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "612e4609-6881-4373-9da0-ee5d762f7126" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:13:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "612e4609-6881-4373-9da0-ee5d762f7126" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:13:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "612e4609-6881-4373-9da0-ee5d762f7126-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:13:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "612e4609-6881-4373-9da0-ee5d762f7126-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:13:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "612e4609-6881-4373-9da0-ee5d762f7126-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:13:00 user nova-compute[72504]: INFO nova.compute.manager [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Terminating instance
Aug 01 20:13:00 user nova-compute[72504]: DEBUG nova.compute.manager [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:13:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG nova.compute.manager [req-ec48a515-5a2f-42df-86ba-c436f5176898 req-8fa7c0be-3e92-4232-b6a7-10b41851ad9f service nova] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Received event network-vif-unplugged-1d876bbd-c0b1-4c03-b47a-c413c6b9147c {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ec48a515-5a2f-42df-86ba-c436f5176898 req-8fa7c0be-3e92-4232-b6a7-10b41851ad9f service nova] Acquiring lock "612e4609-6881-4373-9da0-ee5d762f7126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ec48a515-5a2f-42df-86ba-c436f5176898 req-8fa7c0be-3e92-4232-b6a7-10b41851ad9f service nova] Lock "612e4609-6881-4373-9da0-ee5d762f7126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ec48a515-5a2f-42df-86ba-c436f5176898 req-8fa7c0be-3e92-4232-b6a7-10b41851ad9f service nova] Lock "612e4609-6881-4373-9da0-ee5d762f7126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG nova.compute.manager [req-ec48a515-5a2f-42df-86ba-c436f5176898 req-8fa7c0be-3e92-4232-b6a7-10b41851ad9f service nova] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] No waiting events found dispatching network-vif-unplugged-1d876bbd-c0b1-4c03-b47a-c413c6b9147c {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG nova.compute.manager [req-ec48a515-5a2f-42df-86ba-c436f5176898 req-8fa7c0be-3e92-4232-b6a7-10b41851ad9f service nova] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Received event network-vif-unplugged-1d876bbd-c0b1-4c03-b47a-c413c6b9147c for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:01 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Instance destroyed successfully.
Aug 01 20:13:01 user nova-compute[72504]: DEBUG nova.objects.instance [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lazy-loading 'resources' on Instance uuid 612e4609-6881-4373-9da0-ee5d762f7126 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:08:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-245398826',display_name='tempest-TestVolumeBootPattern-volume-backed-server-245398826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-245398826',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcXkKRIpyBHclSozhB5zfhurVAHAgD2lmjYT+Hj6mcbjAufUPXFqJvxWKb93NkDo5lGDRNkfZ7O4MVjLeMYtHH708iSsKPmUfVW+FbAfcnw2cAvhBzV8T38XKDl5vEx6w==',key_name='tempest-keypair-1801534996',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:08:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb59fbc2bf9749f3af7d56435cb37066',ramdisk_id='',reservation_id='r-4csin909',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-685885098',owner_user_name='tempest-TestVolumeBootPattern-685885098-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:08:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f06381c8a6214ddea7f1b36b623ed4d5',uuid=612e4609-6881-4373-9da0-ee5d762f7126,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d876bbd-c0b1-4c03-b47a-c413c6b9147c", "address": "fa:16:3e:19:90:9c", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d876bbd-c0", "ovs_interfaceid": "1d876bbd-c0b1-4c03-b47a-c413c6b9147c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converting VIF {"id": "1d876bbd-c0b1-4c03-b47a-c413c6b9147c", "address": "fa:16:3e:19:90:9c", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d876bbd-c0", "ovs_interfaceid": "1d876bbd-c0b1-4c03-b47a-c413c6b9147c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:90:9c,bridge_name='br-int',has_traffic_filtering=True,id=1d876bbd-c0b1-4c03-b47a-c413c6b9147c,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d876bbd-c0') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG os_vif [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:90:9c,bridge_name='br-int',has_traffic_filtering=True,id=1d876bbd-c0b1-4c03-b47a-c413c6b9147c,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d876bbd-c0') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d876bbd-c0, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:13:01 user nova-compute[72504]: INFO os_vif [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:90:9c,bridge_name='br-int',has_traffic_filtering=True,id=1d876bbd-c0b1-4c03-b47a-c413c6b9147c,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d876bbd-c0')
Aug 01 20:13:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsjEPdOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:13:01 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:13:01 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[535a9311-baf2-49c5-a423-407422f16281]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e133102c-83d3-4016-85b3-fb4bb5148398]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b (non-flash)
Aug 01 20:13:01 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b (non-flash)
Aug 01 20:13:01 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3f45c1a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b'): ({'sdb'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Removing single pathed devices sdb {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2e7761-1078-4da5-b178-bfcac5914a82]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4904a6a7-8441-4233-9f3b-491ddaf9ddc9]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Flushing IO for device /dev/sdb {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4965f0-2383-4e1f-b262-9d345e6e3023]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd4913c-27e5-4329-aa62-014ee631e9f4]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6245c0fc-19370800020d5ff8', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6245c0fc', '/dev/disk/by-id/scsi-23139333730383030') {{(pid=83379) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4334d0e-5eaf-4dc3-b04e-14a430ae94d4]: (4, None) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a069826-f0b8-4ade-93d8-baad6ccada2d]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8b03dc-d77d-49ba-a4dc-2f80b5b509b4]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b, portal: 172.16.0.220,3260]
Aug 01 20:13:01 user nova-compute[72504]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b, portal: 172.16.0.220,3260] successful.
Aug 01 20:13:01 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500d458-7e1b-43b3-a8a9-93d89adbbc1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fac402-5907-4efa-a247-63175adce649]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] <== disconnect_volume: return (309ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:13:01 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Deleting instance files /opt/stack/data/nova/instances/612e4609-6881-4373-9da0-ee5d762f7126_del
Aug 01 20:13:01 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Deletion of /opt/stack/data/nova/instances/612e4609-6881-4373-9da0-ee5d762f7126_del complete
Aug 01 20:13:01 user nova-compute[72504]: INFO nova.compute.manager [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 01 20:13:01 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:13:01 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:13:02 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:13:02 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Took 1.02 seconds to deallocate network for instance.
Aug 01 20:13:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-879e7c52-5e26-4981-abbd-26571c79d9ec req-3ddee7db-a900-430c-bb35-2f8f5524ee9c service nova] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Received event network-vif-plugged-1d876bbd-c0b1-4c03-b47a-c413c6b9147c {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:13:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-879e7c52-5e26-4981-abbd-26571c79d9ec req-3ddee7db-a900-430c-bb35-2f8f5524ee9c service nova] Acquiring lock "612e4609-6881-4373-9da0-ee5d762f7126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:13:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-879e7c52-5e26-4981-abbd-26571c79d9ec req-3ddee7db-a900-430c-bb35-2f8f5524ee9c service nova] Lock "612e4609-6881-4373-9da0-ee5d762f7126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:13:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-879e7c52-5e26-4981-abbd-26571c79d9ec req-3ddee7db-a900-430c-bb35-2f8f5524ee9c service nova] Lock "612e4609-6881-4373-9da0-ee5d762f7126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:13:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-879e7c52-5e26-4981-abbd-26571c79d9ec req-3ddee7db-a900-430c-bb35-2f8f5524ee9c service nova] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] No waiting events found dispatching network-vif-plugged-1d876bbd-c0b1-4c03-b47a-c413c6b9147c {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:13:03 user nova-compute[72504]: WARNING nova.compute.manager [req-879e7c52-5e26-4981-abbd-26571c79d9ec req-3ddee7db-a900-430c-bb35-2f8f5524ee9c service nova] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Received unexpected event network-vif-plugged-1d876bbd-c0b1-4c03-b47a-c413c6b9147c for instance with vm_state active and task_state deleting.
Aug 01 20:13:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-879e7c52-5e26-4981-abbd-26571c79d9ec req-3ddee7db-a900-430c-bb35-2f8f5524ee9c service nova] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Received event network-vif-deleted-1d876bbd-c0b1-4c03-b47a-c413c6b9147c {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:13:03 user nova-compute[72504]: INFO nova.compute.manager [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Took 0.79 seconds to detach 1 volumes for instance.
Aug 01 20:13:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Deleting volume: 7500d458-7e1b-43b3-a8a9-93d89adbbc1b {{(pid=72504) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 20:13:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:13:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:13:03 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:13:03 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:13:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:13:03 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Deleted allocations for instance 612e4609-6881-4373-9da0-ee5d762f7126
Aug 01 20:13:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-bce803f2-0bc8-4104-b415-8e1fff807636 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "612e4609-6881-4373-9da0-ee5d762f7126" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.499s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:13:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Acquiring lock "38748b45-c891-4ffb-8326-5ca0b15579f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:13:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Lock "38748b45-c891-4ffb-8326-5ca0b15579f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:13:08 user nova-compute[72504]: DEBUG nova.compute.manager [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 20:13:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:13:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:13:08 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:13:08 user nova-compute[72504]: INFO nova.compute.claims [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Claim successful on node user
Aug 01 20:13:09 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:13:09 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:13:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.230s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:13:09 user nova-compute[72504]: DEBUG nova.compute.manager [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 20:13:09 user nova-compute[72504]: DEBUG nova.compute.manager [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 20:13:09 user nova-compute[72504]: DEBUG nova.network.neutron [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 20:13:09 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 20:13:09 user nova-compute[72504]: DEBUG nova.compute.manager [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 20:13:09 user nova-compute[72504]: DEBUG nova.policy [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffa16ee272b74ead854fe1b332d57a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f5e5932c09a4ea68e896ec7e1fd2b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 20:13:09 user nova-compute[72504]: DEBUG nova.compute.manager [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 20:13:09 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:13:09 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Creating image(s)
Aug 01 20:13:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Acquiring lock "/opt/stack/data/nova/instances/38748b45-c891-4ffb-8326-5ca0b15579f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:13:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Lock "/opt/stack/data/nova/instances/38748b45-c891-4ffb-8326-5ca0b15579f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:13:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Lock "/opt/stack/data/nova/instances/38748b45-c891-4ffb-8326-5ca0b15579f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:13:09 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:09 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.134s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:13:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:13:09 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:09 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.146s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:09 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/38748b45-c891-4ffb-8326-5ca0b15579f3/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:09 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/38748b45-c891-4ffb-8326-5ca0b15579f3/disk 1073741824" returned: 0 in 0.052s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:13:09 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:09 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:09 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Checking if we can resize image /opt/stack/data/nova/instances/38748b45-c891-4ffb-8326-5ca0b15579f3/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 20:13:09 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38748b45-c891-4ffb-8326-5ca0b15579f3/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:09 user nova-compute[72504]: DEBUG nova.network.neutron [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Successfully created port: d6cc07c7-ec98-4467-b715-87899cbbe7a1 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 20:13:09 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38748b45-c891-4ffb-8326-5ca0b15579f3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:09 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Cannot resize image /opt/stack/data/nova/instances/38748b45-c891-4ffb-8326-5ca0b15579f3/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 20:13:10 user nova-compute[72504]: DEBUG nova.objects.instance [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Lazy-loading 'migration_context' on Instance uuid 38748b45-c891-4ffb-8326-5ca0b15579f3 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:13:10 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 20:13:10 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Ensure instance console log exists: /opt/stack/data/nova/instances/38748b45-c891-4ffb-8326-5ca0b15579f3/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:13:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:13:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:13:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:13:10 user nova-compute[72504]: DEBUG nova.network.neutron [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Successfully updated port: d6cc07c7-ec98-4467-b715-87899cbbe7a1 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 20:13:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Acquiring lock "refresh_cache-38748b45-c891-4ffb-8326-5ca0b15579f3" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:13:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Acquired lock "refresh_cache-38748b45-c891-4ffb-8326-5ca0b15579f3" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:13:10 user nova-compute[72504]: DEBUG nova.network.neutron [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:13:10 user nova-compute[72504]: DEBUG nova.compute.manager [req-0d8c4581-facc-4811-b687-80735b3b4b78 req-c8c6f188-4363-4842-b0f3-ce201671183b service nova] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Received event network-changed-d6cc07c7-ec98-4467-b715-87899cbbe7a1 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:13:10 user nova-compute[72504]: DEBUG nova.compute.manager [req-0d8c4581-facc-4811-b687-80735b3b4b78 req-c8c6f188-4363-4842-b0f3-ce201671183b service nova] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Refreshing instance network info cache due to event network-changed-d6cc07c7-ec98-4467-b715-87899cbbe7a1. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:13:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0d8c4581-facc-4811-b687-80735b3b4b78 req-c8c6f188-4363-4842-b0f3-ce201671183b service nova] Acquiring lock "refresh_cache-38748b45-c891-4ffb-8326-5ca0b15579f3" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:13:10 user nova-compute[72504]: DEBUG nova.network.neutron [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:13:10 user nova-compute[72504]: DEBUG nova.network.neutron [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Updating instance_info_cache with network_info: [{"id": "d6cc07c7-ec98-4467-b715-87899cbbe7a1", "address": "fa:16:3e:f7:7d:5d", "network": {"id": "2bf9d6e2-fadf-430f-9412-07dd349c174c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-715845787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f5e5932c09a4ea68e896ec7e1fd2b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6cc07c7-ec", "ovs_interfaceid": "d6cc07c7-ec98-4467-b715-87899cbbe7a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Releasing lock "refresh_cache-38748b45-c891-4ffb-8326-5ca0b15579f3" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.compute.manager [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Instance network_info: |[{"id": "d6cc07c7-ec98-4467-b715-87899cbbe7a1", "address": "fa:16:3e:f7:7d:5d", "network": {"id": "2bf9d6e2-fadf-430f-9412-07dd349c174c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-715845787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f5e5932c09a4ea68e896ec7e1fd2b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6cc07c7-ec", "ovs_interfaceid": "d6cc07c7-ec98-4467-b715-87899cbbe7a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0d8c4581-facc-4811-b687-80735b3b4b78 req-c8c6f188-4363-4842-b0f3-ce201671183b service nova] Acquired lock "refresh_cache-38748b45-c891-4ffb-8326-5ca0b15579f3" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.network.neutron [req-0d8c4581-facc-4811-b687-80735b3b4b78 req-c8c6f188-4363-4842-b0f3-ce201671183b service nova] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Refreshing network info cache for port d6cc07c7-ec98-4467-b715-87899cbbe7a1 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Start _get_guest_xml network_info=[{"id": "d6cc07c7-ec98-4467-b715-87899cbbe7a1", "address": "fa:16:3e:f7:7d:5d", "network": {"id": "2bf9d6e2-fadf-430f-9412-07dd349c174c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-715845787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f5e5932c09a4ea68e896ec7e1fd2b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6cc07c7-ec", "ovs_interfaceid": "d6cc07c7-ec98-4467-b715-87899cbbe7a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:13:11 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:13:11 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:13:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1816069911',display_name='tempest-VolumesActionsTest-instance-1816069911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1816069911',id=40,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f5e5932c09a4ea68e896ec7e1fd2b42',ramdisk_id='',reservation_id='r-psecg8ow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1392877926',owner_user_name='tempest-VolumesActionsTest-1392877926-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:13:09Z,user_data=None,user_id='ffa16ee272b74ead854fe1b332d57a18',uuid=38748b45-c891-4ffb-8326-5ca0b15579f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6cc07c7-ec98-4467-b715-87899cbbe7a1", "address": "fa:16:3e:f7:7d:5d", "network": {"id": "2bf9d6e2-fadf-430f-9412-07dd349c174c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-715845787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f5e5932c09a4ea68e896ec7e1fd2b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6cc07c7-ec", "ovs_interfaceid": "d6cc07c7-ec98-4467-b715-87899cbbe7a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Converting VIF {"id": "d6cc07c7-ec98-4467-b715-87899cbbe7a1", "address": "fa:16:3e:f7:7d:5d", "network": {"id": "2bf9d6e2-fadf-430f-9412-07dd349c174c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-715845787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f5e5932c09a4ea68e896ec7e1fd2b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6cc07c7-ec", "ovs_interfaceid": "d6cc07c7-ec98-4467-b715-87899cbbe7a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:7d:5d,bridge_name='br-int',has_traffic_filtering=True,id=d6cc07c7-ec98-4467-b715-87899cbbe7a1,network=Network(2bf9d6e2-fadf-430f-9412-07dd349c174c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6cc07c7-ec') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.objects.instance [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Lazy-loading 'pci_devices' on Instance uuid 38748b45-c891-4ffb-8326-5ca0b15579f3 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:13:11 user nova-compute[72504]:   <uuid>38748b45-c891-4ffb-8326-5ca0b15579f3</uuid>
Aug 01 20:13:11 user nova-compute[72504]:   <name>instance-00000028</name>
Aug 01 20:13:11 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:13:11 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:13:11 user nova-compute[72504]:   <metadata>
Aug 01 20:13:11 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:13:11 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:13:11 user nova-compute[72504]:       <nova:name>tempest-VolumesActionsTest-instance-1816069911</nova:name>
Aug 01 20:13:11 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:13:11</nova:creationTime>
Aug 01 20:13:11 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:13:11 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:13:11 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:13:11 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:13:11 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:13:11 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:13:11 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:13:11 user nova-compute[72504]:       <nova:owner>
Aug 01 20:13:11 user nova-compute[72504]:         <nova:user uuid="ffa16ee272b74ead854fe1b332d57a18">tempest-VolumesActionsTest-1392877926-project-member</nova:user>
Aug 01 20:13:11 user nova-compute[72504]:         <nova:project uuid="1f5e5932c09a4ea68e896ec7e1fd2b42">tempest-VolumesActionsTest-1392877926</nova:project>
Aug 01 20:13:11 user nova-compute[72504]:       </nova:owner>
Aug 01 20:13:11 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 20:13:11 user nova-compute[72504]:       <nova:ports>
Aug 01 20:13:11 user nova-compute[72504]:         <nova:port uuid="d6cc07c7-ec98-4467-b715-87899cbbe7a1">
Aug 01 20:13:11 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 20:13:11 user nova-compute[72504]:         </nova:port>
Aug 01 20:13:11 user nova-compute[72504]:       </nova:ports>
Aug 01 20:13:11 user nova-compute[72504]:     </nova:instance>
Aug 01 20:13:11 user nova-compute[72504]:   </metadata>
Aug 01 20:13:11 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:13:11 user nova-compute[72504]:     <system>
Aug 01 20:13:11 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:13:11 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:13:11 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:13:11 user nova-compute[72504]:       <entry name="serial">38748b45-c891-4ffb-8326-5ca0b15579f3</entry>
Aug 01 20:13:11 user nova-compute[72504]:       <entry name="uuid">38748b45-c891-4ffb-8326-5ca0b15579f3</entry>
Aug 01 20:13:11 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:13:11 user nova-compute[72504]:     </system>
Aug 01 20:13:11 user nova-compute[72504]:   </sysinfo>
Aug 01 20:13:11 user nova-compute[72504]:   <os>
Aug 01 20:13:11 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:13:11 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:13:11 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:13:11 user nova-compute[72504]:   </os>
Aug 01 20:13:11 user nova-compute[72504]:   <features>
Aug 01 20:13:11 user nova-compute[72504]:     <acpi/>
Aug 01 20:13:11 user nova-compute[72504]:     <apic/>
Aug 01 20:13:11 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:13:11 user nova-compute[72504]:   </features>
Aug 01 20:13:11 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:13:11 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:13:11 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:13:11 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:13:11 user nova-compute[72504]:   </clock>
Aug 01 20:13:11 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:13:11 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:13:11 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:13:11 user nova-compute[72504]:   </cpu>
Aug 01 20:13:11 user nova-compute[72504]:   <devices>
Aug 01 20:13:11 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 20:13:11 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 20:13:11 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/38748b45-c891-4ffb-8326-5ca0b15579f3/disk"/>
Aug 01 20:13:11 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:13:11 user nova-compute[72504]:     </disk>
Aug 01 20:13:11 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:13:11 user nova-compute[72504]:       <mac address="fa:16:3e:f7:7d:5d"/>
Aug 01 20:13:11 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:13:11 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:13:11 user nova-compute[72504]:       <target dev="tapd6cc07c7-ec"/>
Aug 01 20:13:11 user nova-compute[72504]:     </interface>
Aug 01 20:13:11 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:13:11 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/38748b45-c891-4ffb-8326-5ca0b15579f3/console.log" append="off"/>
Aug 01 20:13:11 user nova-compute[72504]:     </serial>
Aug 01 20:13:11 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:13:11 user nova-compute[72504]:     <video>
Aug 01 20:13:11 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:13:11 user nova-compute[72504]:     </video>
Aug 01 20:13:11 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:13:11 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:13:11 user nova-compute[72504]:     </rng>
Aug 01 20:13:11 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:13:11 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:13:11 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:13:11 user nova-compute[72504]:     </memballoon>
Aug 01 20:13:11 user nova-compute[72504]:   </devices>
Aug 01 20:13:11 user nova-compute[72504]: </domain>
Aug 01 20:13:11 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:13:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1816069911',display_name='tempest-VolumesActionsTest-instance-1816069911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1816069911',id=40,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f5e5932c09a4ea68e896ec7e1fd2b42',ramdisk_id='',reservation_id='r-psecg8ow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1392877926',owner_user_name='tempest-VolumesActionsTest-1392877926-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:13:09Z,user_data=None,user_id='ffa16ee272b74ead854fe1b332d57a18',uuid=38748b45-c891-4ffb-8326-5ca0b15579f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6cc07c7-ec98-4467-b715-87899cbbe7a1", "address": "fa:16:3e:f7:7d:5d", "network": {"id": "2bf9d6e2-fadf-430f-9412-07dd349c174c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-715845787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f5e5932c09a4ea68e896ec7e1fd2b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6cc07c7-ec", "ovs_interfaceid": "d6cc07c7-ec98-4467-b715-87899cbbe7a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Converting VIF {"id": "d6cc07c7-ec98-4467-b715-87899cbbe7a1", "address": "fa:16:3e:f7:7d:5d", "network": {"id": "2bf9d6e2-fadf-430f-9412-07dd349c174c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-715845787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f5e5932c09a4ea68e896ec7e1fd2b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6cc07c7-ec", "ovs_interfaceid": "d6cc07c7-ec98-4467-b715-87899cbbe7a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:7d:5d,bridge_name='br-int',has_traffic_filtering=True,id=d6cc07c7-ec98-4467-b715-87899cbbe7a1,network=Network(2bf9d6e2-fadf-430f-9412-07dd349c174c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6cc07c7-ec') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG os_vif [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:7d:5d,bridge_name='br-int',has_traffic_filtering=True,id=d6cc07c7-ec98-4467-b715-87899cbbe7a1,network=Network(2bf9d6e2-fadf-430f-9412-07dd349c174c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6cc07c7-ec') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6cc07c7-ec, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd6cc07c7-ec, col_values=(('external_ids', {'iface-id': 'd6cc07c7-ec98-4467-b715-87899cbbe7a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:7d:5d', 'vm-uuid': '38748b45-c891-4ffb-8326-5ca0b15579f3'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:11 user nova-compute[72504]: INFO os_vif [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:7d:5d,bridge_name='br-int',has_traffic_filtering=True,id=d6cc07c7-ec98-4467-b715-87899cbbe7a1,network=Network(2bf9d6e2-fadf-430f-9412-07dd349c174c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6cc07c7-ec')
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] No VIF found with MAC fa:16:3e:f7:7d:5d, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.network.neutron [req-0d8c4581-facc-4811-b687-80735b3b4b78 req-c8c6f188-4363-4842-b0f3-ce201671183b service nova] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Updated VIF entry in instance network info cache for port d6cc07c7-ec98-4467-b715-87899cbbe7a1. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG nova.network.neutron [req-0d8c4581-facc-4811-b687-80735b3b4b78 req-c8c6f188-4363-4842-b0f3-ce201671183b service nova] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Updating instance_info_cache with network_info: [{"id": "d6cc07c7-ec98-4467-b715-87899cbbe7a1", "address": "fa:16:3e:f7:7d:5d", "network": {"id": "2bf9d6e2-fadf-430f-9412-07dd349c174c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-715845787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f5e5932c09a4ea68e896ec7e1fd2b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6cc07c7-ec", "ovs_interfaceid": "d6cc07c7-ec98-4467-b715-87899cbbe7a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:13:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0d8c4581-facc-4811-b687-80735b3b4b78 req-c8c6f188-4363-4842-b0f3-ce201671183b service nova] Releasing lock "refresh_cache-38748b45-c891-4ffb-8326-5ca0b15579f3" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:13:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:12 user nova-compute[72504]: DEBUG nova.compute.manager [req-903ea6ac-a7ea-4715-b55e-a404be049760 req-7db40938-d098-40b6-bc7c-e80f049bb6c8 service nova] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Received event network-vif-plugged-d6cc07c7-ec98-4467-b715-87899cbbe7a1 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:13:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-903ea6ac-a7ea-4715-b55e-a404be049760 req-7db40938-d098-40b6-bc7c-e80f049bb6c8 service nova] Acquiring lock "38748b45-c891-4ffb-8326-5ca0b15579f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:13:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-903ea6ac-a7ea-4715-b55e-a404be049760 req-7db40938-d098-40b6-bc7c-e80f049bb6c8 service nova] Lock "38748b45-c891-4ffb-8326-5ca0b15579f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:13:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-903ea6ac-a7ea-4715-b55e-a404be049760 req-7db40938-d098-40b6-bc7c-e80f049bb6c8 service nova] Lock "38748b45-c891-4ffb-8326-5ca0b15579f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:13:12 user nova-compute[72504]: DEBUG nova.compute.manager [req-903ea6ac-a7ea-4715-b55e-a404be049760 req-7db40938-d098-40b6-bc7c-e80f049bb6c8 service nova] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] No waiting events found dispatching network-vif-plugged-d6cc07c7-ec98-4467-b715-87899cbbe7a1 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:13:12 user nova-compute[72504]: WARNING nova.compute.manager [req-903ea6ac-a7ea-4715-b55e-a404be049760 req-7db40938-d098-40b6-bc7c-e80f049bb6c8 service nova] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Received unexpected event network-vif-plugged-d6cc07c7-ec98-4467-b715-87899cbbe7a1 for instance with vm_state building and task_state spawning.
Aug 01 20:13:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:14 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920794.5974061, 38748b45-c891-4ffb-8326-5ca0b15579f3 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:13:14 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] VM Resumed (Lifecycle Event)
Aug 01 20:13:14 user nova-compute[72504]: DEBUG nova.compute.manager [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:13:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:13:14 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Instance spawned successfully.
Aug 01 20:13:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 20:13:14 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:13:14 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:13:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:13:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:13:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:13:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:13:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:13:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:13:14 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:13:14 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920794.6022763, 38748b45-c891-4ffb-8326-5ca0b15579f3 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:13:14 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] VM Started (Lifecycle Event)
Aug 01 20:13:14 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:13:14 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:13:14 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:13:14 user nova-compute[72504]: INFO nova.compute.manager [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Took 5.35 seconds to spawn the instance on the hypervisor.
Aug 01 20:13:14 user nova-compute[72504]: DEBUG nova.compute.manager [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:13:14 user nova-compute[72504]: INFO nova.compute.manager [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Took 5.91 seconds to build instance.
Aug 01 20:13:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b192cac7-ad48-4af6-a068-32b14e212709 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Lock "38748b45-c891-4ffb-8326-5ca0b15579f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:13:14 user nova-compute[72504]: DEBUG nova.compute.manager [req-a3b272f8-7fc8-40a2-852b-ff27df6f21a3 req-219a15fb-4460-48cc-9e81-ecbce72bc71f service nova] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Received event network-vif-plugged-d6cc07c7-ec98-4467-b715-87899cbbe7a1 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:13:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a3b272f8-7fc8-40a2-852b-ff27df6f21a3 req-219a15fb-4460-48cc-9e81-ecbce72bc71f service nova] Acquiring lock "38748b45-c891-4ffb-8326-5ca0b15579f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:13:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a3b272f8-7fc8-40a2-852b-ff27df6f21a3 req-219a15fb-4460-48cc-9e81-ecbce72bc71f service nova] Lock "38748b45-c891-4ffb-8326-5ca0b15579f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:13:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a3b272f8-7fc8-40a2-852b-ff27df6f21a3 req-219a15fb-4460-48cc-9e81-ecbce72bc71f service nova] Lock "38748b45-c891-4ffb-8326-5ca0b15579f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:13:14 user nova-compute[72504]: DEBUG nova.compute.manager [req-a3b272f8-7fc8-40a2-852b-ff27df6f21a3 req-219a15fb-4460-48cc-9e81-ecbce72bc71f service nova] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] No waiting events found dispatching network-vif-plugged-d6cc07c7-ec98-4467-b715-87899cbbe7a1 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:13:14 user nova-compute[72504]: WARNING nova.compute.manager [req-a3b272f8-7fc8-40a2-852b-ff27df6f21a3 req-219a15fb-4460-48cc-9e81-ecbce72bc71f service nova] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Received unexpected event network-vif-plugged-d6cc07c7-ec98-4467-b715-87899cbbe7a1 for instance with vm_state active and task_state None.
Aug 01 20:13:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:16 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690920781.183047, 612e4609-6881-4373-9da0-ee5d762f7126 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:13:16 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] VM Stopped (Lifecycle Event)
Aug 01 20:13:16 user nova-compute[72504]: DEBUG nova.compute.manager [None req-36d7ce14-a62a-46b5-b485-579b8ad89223 None None] [instance: 612e4609-6881-4373-9da0-ee5d762f7126] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:13:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:26 user nova-compute[72504]: DEBUG nova.compute.manager [req-448ddf56-1eb5-4545-b786-0e14339127ae req-c3ba3369-ddbf-44c4-a3e2-ca835249ead3 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Received event network-changed-b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:13:26 user nova-compute[72504]: DEBUG nova.compute.manager [req-448ddf56-1eb5-4545-b786-0e14339127ae req-c3ba3369-ddbf-44c4-a3e2-ca835249ead3 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Refreshing instance network info cache due to event network-changed-b8f38092-7fe7-4274-8fcb-1e4a2808454e. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:13:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-448ddf56-1eb5-4545-b786-0e14339127ae req-c3ba3369-ddbf-44c4-a3e2-ca835249ead3 service nova] Acquiring lock "refresh_cache-a4f9c59c-cf0b-4216-a194-22712725328d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:13:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-448ddf56-1eb5-4545-b786-0e14339127ae req-c3ba3369-ddbf-44c4-a3e2-ca835249ead3 service nova] Acquired lock "refresh_cache-a4f9c59c-cf0b-4216-a194-22712725328d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:13:26 user nova-compute[72504]: DEBUG nova.network.neutron [req-448ddf56-1eb5-4545-b786-0e14339127ae req-c3ba3369-ddbf-44c4-a3e2-ca835249ead3 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Refreshing network info cache for port b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:13:26 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:13:27 user nova-compute[72504]: DEBUG nova.network.neutron [req-448ddf56-1eb5-4545-b786-0e14339127ae req-c3ba3369-ddbf-44c4-a3e2-ca835249ead3 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Updated VIF entry in instance network info cache for port b8f38092-7fe7-4274-8fcb-1e4a2808454e. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:13:27 user nova-compute[72504]: DEBUG nova.network.neutron [req-448ddf56-1eb5-4545-b786-0e14339127ae req-c3ba3369-ddbf-44c4-a3e2-ca835249ead3 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Updating instance_info_cache with network_info: [{"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:13:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-448ddf56-1eb5-4545-b786-0e14339127ae req-c3ba3369-ddbf-44c4-a3e2-ca835249ead3 service nova] Releasing lock "refresh_cache-a4f9c59c-cf0b-4216-a194-22712725328d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:13:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:28 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:13:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "a4f9c59c-cf0b-4216-a194-22712725328d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:13:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "a4f9c59c-cf0b-4216-a194-22712725328d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:13:30 user nova-compute[72504]: DEBUG nova.objects.instance [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'flavor' on Instance uuid a4f9c59c-cf0b-4216-a194-22712725328d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:13:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "a4f9c59c-cf0b-4216-a194-22712725328d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.046s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:13:30 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:13:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "a4f9c59c-cf0b-4216-a194-22712725328d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:13:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "a4f9c59c-cf0b-4216-a194-22712725328d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:13:30 user nova-compute[72504]: INFO nova.compute.manager [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Attaching volume 5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 to /dev/vdb
Aug 01 20:13:30 user nova-compute[72504]: DEBUG os_brick.utils [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:13:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:31 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6783c72e-fbbb-418b-98f8-9bdcd0b1dbe5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:31 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3aa3070-504d-4acf-8399-4f06e1c4067c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:31 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9f2825-686a-45b4-a44c-2cd43682f041]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:31 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fc6802-0117-41eb-ab6e-6dd271f32eea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:13:31 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:13:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:31 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:13:31 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:13:31 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e36414-06c0-4703-9420-f3f01ec14778]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:31 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:13:31 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:13:31 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:13:31 user nova-compute[72504]: DEBUG os_brick.utils [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:13:31 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Updating existing volume attachment record: 6264930d-9b51-4c78-844a-ec783b873ee1 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:13:32 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:13:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:35 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:13:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:13:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:13:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:13:35 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:13:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38748b45-c891-4ffb-8326-5ca0b15579f3/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38748b45-c891-4ffb-8326-5ca0b15579f3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38748b45-c891-4ffb-8326-5ca0b15579f3/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:36 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38748b45-c891-4ffb-8326-5ca0b15579f3/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:37 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:13:37 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:13:37 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8434MB free_disk=25.230140686035156GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:13:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:13:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:13:37 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:13:37 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance a4f9c59c-cf0b-4216-a194-22712725328d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:13:37 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 38748b45-c891-4ffb-8326-5ca0b15579f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:13:37 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:13:37 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:13:37 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:13:37 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:13:37 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:13:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.266s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuevRMPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:13:38 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:13:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:13:38 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:13:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:13:38 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c14751-621e-4c7a-ab9f-e49d139c3ec5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:13:38 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f691032a-29ae-4ccb-abc3-69596a298af0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8] added
Aug 01 20:13:38 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[42caca69-63b2-43e4-a147-8381a9f5d522]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b23dbba-e497-4498-b2e0-980fbe8297fc]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HuevRMPG {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HuevRMPG" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f6fed8-a548-41ef-b990-af8d4766f845]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HuevRMPG'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c39d9bc-8a8e-4191-b31a-0cf806f7d9a2]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[264ff0ad-e8d6-4edb-b52c-4750a05faadd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 20:13:38 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 20:13:38 user nova-compute[72504]:  {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:13:38 user nova-compute[72504]: WARNING os_brick.initiator.connectors.iscsi [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 20:13:38 user nova-compute[72504]: 
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c7712c-93ea-4b5c-b06e-885a1f4dc531]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8, portal: 172.16.0.220,3260]
Aug 01 20:13:38 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8, portal: 172.16.0.220,3260] successful.
Aug 01 20:13:38 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[caef74d3-5b63-4f02-9817-f091504e6a88]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[28632ecf-cc31-4b76-85fc-de27222ca49c]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)
Aug 01 20:13:38 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)
Aug 01 20:13:38 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc104edc-88c1-4cd6-bc08-ce8dc2eb3217]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuevRMPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-9ac6b63a-2c5a-4f72-9dc3-8f884253e180" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-9ac6b63a-2c5a-4f72-9dc3-8f884253e180" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:13:38 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:13:39 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Updating instance_info_cache with network_info: [{"id": "298ca2cd-b389-42be-bc06-05344f41e0d2", "address": "fa:16:3e:74:2e:28", "network": {"id": "d4bfb5e4-0509-436d-8605-07b850de35b1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1900175842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f084e19e3c674b308d8a566f57bba3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ca2cd-b3", "ovs_interfaceid": "298ca2cd-b389-42be-bc06-05344f41e0d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:13:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-9ac6b63a-2c5a-4f72-9dc3-8f884253e180" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:13:39 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:13:39 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:13:39 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:13:39 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:13:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:13:39 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23932616139306261', 'path': '/dev/sdb'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:13:39 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932616139306261', 'path': '/dev/sdb'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:13:39 user nova-compute[72504]: DEBUG nova.objects.instance [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'flavor' on Instance uuid a4f9c59c-cf0b-4216-a194-22712725328d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:13:39 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 20:13:39 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:13:39 user nova-compute[72504]:   <source dev="/dev/sdb"/>
Aug 01 20:13:39 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:13:39 user nova-compute[72504]:   <serial>5e8f03f7-e75c-424c-b677-9c24d2ee1ff8</serial>
Aug 01 20:13:39 user nova-compute[72504]: </disk>
Aug 01 20:13:39 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 20:13:39 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:13:39 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:13:39 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] No VIF found with MAC fa:16:3e:de:34:ea, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:13:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4de77211-8337-4a34-8e3e-7083bdd815c1 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "a4f9c59c-cf0b-4216-a194-22712725328d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.155s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:13:40 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:13:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3f03bb6a-5fe2-4e39-a327-3d72d5734cd2 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "a4f9c59c-cf0b-4216-a194-22712725328d" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:13:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3f03bb6a-5fe2-4e39-a327-3d72d5734cd2 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "a4f9c59c-cf0b-4216-a194-22712725328d" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:13:40 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3f03bb6a-5fe2-4e39-a327-3d72d5734cd2 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:13:40 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3f03bb6a-5fe2-4e39-a327-3d72d5734cd2 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72504) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 01 20:13:40 user nova-compute[72504]: DEBUG nova.objects.instance [None req-3f03bb6a-5fe2-4e39-a327-3d72d5734cd2 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'flavor' on Instance uuid a4f9c59c-cf0b-4216-a194-22712725328d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:13:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-4fbd7413-424b-4014-b7f9-b54a40038239 req-36ed6915-be1e-4a8f-a087-e3e215d369e7 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Received event network-vif-unplugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:13:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4fbd7413-424b-4014-b7f9-b54a40038239 req-36ed6915-be1e-4a8f-a087-e3e215d369e7 service nova] Acquiring lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:13:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4fbd7413-424b-4014-b7f9-b54a40038239 req-36ed6915-be1e-4a8f-a087-e3e215d369e7 service nova] Lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:13:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4fbd7413-424b-4014-b7f9-b54a40038239 req-36ed6915-be1e-4a8f-a087-e3e215d369e7 service nova] Lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:13:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-4fbd7413-424b-4014-b7f9-b54a40038239 req-36ed6915-be1e-4a8f-a087-e3e215d369e7 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] No waiting events found dispatching network-vif-unplugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:13:41 user nova-compute[72504]: WARNING nova.compute.manager [req-4fbd7413-424b-4014-b7f9-b54a40038239 req-36ed6915-be1e-4a8f-a087-e3e215d369e7 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Received unexpected event network-vif-unplugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e for instance with vm_state active and task_state powering-off.
Aug 01 20:13:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:41 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Instance destroyed successfully.
Aug 01 20:13:41 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3f03bb6a-5fe2-4e39-a327-3d72d5734cd2 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:13:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3f03bb6a-5fe2-4e39-a327-3d72d5734cd2 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "a4f9c59c-cf0b-4216-a194-22712725328d" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.852s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:13:43 user nova-compute[72504]: DEBUG nova.compute.manager [req-253a64af-6625-4b2f-a728-fd09bc2c5ef6 req-613410ac-fdaf-4d1d-aa80-22b45422f0c7 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Received event network-vif-plugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:13:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-253a64af-6625-4b2f-a728-fd09bc2c5ef6 req-613410ac-fdaf-4d1d-aa80-22b45422f0c7 service nova] Acquiring lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:13:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-253a64af-6625-4b2f-a728-fd09bc2c5ef6 req-613410ac-fdaf-4d1d-aa80-22b45422f0c7 service nova] Lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:13:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-253a64af-6625-4b2f-a728-fd09bc2c5ef6 req-613410ac-fdaf-4d1d-aa80-22b45422f0c7 service nova] Lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:13:43 user nova-compute[72504]: DEBUG nova.compute.manager [req-253a64af-6625-4b2f-a728-fd09bc2c5ef6 req-613410ac-fdaf-4d1d-aa80-22b45422f0c7 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] No waiting events found dispatching network-vif-plugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:13:43 user nova-compute[72504]: WARNING nova.compute.manager [req-253a64af-6625-4b2f-a728-fd09bc2c5ef6 req-613410ac-fdaf-4d1d-aa80-22b45422f0c7 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Received unexpected event network-vif-plugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e for instance with vm_state stopped and task_state None.
Aug 01 20:13:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:51 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:13:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Acquiring lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:13:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:13:55 user nova-compute[72504]: DEBUG nova.objects.instance [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lazy-loading 'flavor' on Instance uuid 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:13:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:13:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Acquiring lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:13:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:13:55 user nova-compute[72504]: INFO nova.compute.manager [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Attaching volume 867e1952-6345-47a2-b171-67612cd6fbe6 to /dev/vdb
Aug 01 20:13:55 user nova-compute[72504]: DEBUG os_brick.utils [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:13:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:55 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71941c9-8221-4903-941f-bb7f131505eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:55 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[19eea5fb-faed-4395-b3fc-84ba522936fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:13:55 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b59694-ea1c-409a-95d4-c7ad752005a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:55 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[66aa33a5-7764-45fa-9e12-3aab924a4eb3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:13:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:13:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:13:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:13:55 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:13:55 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7df1a8b-7fd4-4f6f-894e-a812b765b638]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:13:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:13:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:13:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:13:55 user nova-compute[72504]: DEBUG os_brick.utils [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:13:55 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Updating existing volume attachment record: 22b10a15-852f-4b0c-b6a6-3bef77317690 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:13:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:13:56 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690920821.5963185, a4f9c59c-cf0b-4216-a194-22712725328d => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:13:56 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] VM Stopped (Lifecycle Event)
Aug 01 20:13:56 user nova-compute[72504]: DEBUG nova.compute.manager [None req-36520873-9676-4c5a-819e-dae6c9f83fc7 None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:13:56 user nova-compute[72504]: DEBUG nova.compute.manager [None req-36520873-9676-4c5a-819e-dae6c9f83fc7 None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:13:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "da025bc7-bf1a-40a1-8b9b-71ef9b28c01f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:14:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "da025bc7-bf1a-40a1-8b9b-71ef9b28c01f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:14:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 20:14:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:14:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:14:03 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:14:03 user nova-compute[72504]: INFO nova.compute.claims [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Claim successful on node user
Aug 01 20:14:03 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:14:03 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:14:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:14:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 20:14:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 20:14:03 user nova-compute[72504]: DEBUG nova.network.neutron [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 20:14:03 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 20:14:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 20:14:03 user nova-compute[72504]: INFO nova.virt.block_device [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Booting with volume 500a89fd-74ba-4703-83b0-986e7cb06828 at /dev/vda
Aug 01 20:14:03 user nova-compute[72504]: DEBUG nova.policy [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f06381c8a6214ddea7f1b36b623ed4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb59fbc2bf9749f3af7d56435cb37066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.utils [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[37629958-2eb4-4fe4-9b29-7b371327e52f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30eb071-22b9-4970-bba0-6570c1115fc9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43addaa-54bf-41fa-9691-753c215fca35]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7917cb-cb85-4ade-a0b3-974a44f5a3c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:14:04 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[65375b99-464a-48b1-b7b3-82ce05f1cf36]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.utils [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Updating existing volume attachment record: 31759bf4-0959-4d58-b964-885ce35dc246 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BjEscyof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:14:04 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:14:04 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:14:04 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[313ba21a-6c54-4125-8828-229582db313c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:14:04 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2b8b24-39c2-47c7-a404-dd2363baa717]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6] added
Aug 01 20:14:04 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70599ed-9681-4570-a150-ab22e2b17373]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91ca339-5803-4552-9d60-ac3a7a3159a8]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BjEscyof {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BjEscyof" returned: 0 in 0.031s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dd3236-c059-40fa-854d-d628af5b090a]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BjEscyof'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab683f5-f0ac-4efc-b54e-cca07d3b21b2]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[026ea474-7740-4282-bef8-8a7a86dd7ecc]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)
Aug 01 20:14:04 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)
Aug 01 20:14:04 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[65526cb2-89f3-4a78-b220-f6d74b26a99f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6, portal: 172.16.0.220,3260]
Aug 01 20:14:04 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6, portal: 172.16.0.220,3260] successful.
Aug 01 20:14:04 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[14924603-bdae-4362-8eae-42ac0995aba9]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG nova.network.neutron [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Successfully created port: 8d340f05-ed96-4b3e-b0c6-37d191d39d88 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[138415a4-15eb-4310-a5f0-75481fe35b83]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)
Aug 01 20:14:04 user nova-compute[72504]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 (non-flash)
Aug 01 20:14:04 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)
Aug 01 20:14:04 user nova-compute[72504]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 (non-flash)
Aug 01 20:14:04 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[734fa69a-8c31-4b98-8cff-5c27108c29ea]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:14:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BjEscyof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:14:05 user nova-compute[72504]: DEBUG nova.network.neutron [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Successfully updated port: 8d340f05-ed96-4b3e-b0c6-37d191d39d88 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 20:14:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "refresh_cache-da025bc7-bf1a-40a1-8b9b-71ef9b28c01f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:14:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquired lock "refresh_cache-da025bc7-bf1a-40a1-8b9b-71ef9b28c01f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:14:05 user nova-compute[72504]: DEBUG nova.network.neutron [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:14:05 user nova-compute[72504]: DEBUG nova.compute.manager [req-8deccb16-fd75-4323-b9d4-0f549ba173b2 req-b846e3f7-caf8-4c6c-ad8b-0b9b86134c1e service nova] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Received event network-changed-8d340f05-ed96-4b3e-b0c6-37d191d39d88 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:14:05 user nova-compute[72504]: DEBUG nova.compute.manager [req-8deccb16-fd75-4323-b9d4-0f549ba173b2 req-b846e3f7-caf8-4c6c-ad8b-0b9b86134c1e service nova] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Refreshing instance network info cache due to event network-changed-8d340f05-ed96-4b3e-b0c6-37d191d39d88. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:14:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-8deccb16-fd75-4323-b9d4-0f549ba173b2 req-b846e3f7-caf8-4c6c-ad8b-0b9b86134c1e service nova] Acquiring lock "refresh_cache-da025bc7-bf1a-40a1-8b9b-71ef9b28c01f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:14:05 user nova-compute[72504]: DEBUG nova.network.neutron [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:14:05 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:14:05 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23035363761376236', 'path': '/dev/sdc'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:14:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035363761376236', 'path': '/dev/sdc'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:14:05 user nova-compute[72504]: DEBUG nova.objects.instance [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lazy-loading 'flavor' on Instance uuid 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:14:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 20:14:05 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:14:05 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 20:14:05 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:14:05 user nova-compute[72504]:   <serial>867e1952-6345-47a2-b171-67612cd6fbe6</serial>
Aug 01 20:14:05 user nova-compute[72504]: </disk>
Aug 01 20:14:05 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 20:14:05 user nova-compute[72504]: DEBUG nova.network.neutron [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Updating instance_info_cache with network_info: [{"id": "8d340f05-ed96-4b3e-b0c6-37d191d39d88", "address": "fa:16:3e:31:94:3b", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d340f05-ed", "ovs_interfaceid": "8d340f05-ed96-4b3e-b0c6-37d191d39d88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:14:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Releasing lock "refresh_cache-da025bc7-bf1a-40a1-8b9b-71ef9b28c01f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:14:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Instance network_info: |[{"id": "8d340f05-ed96-4b3e-b0c6-37d191d39d88", "address": "fa:16:3e:31:94:3b", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d340f05-ed", "ovs_interfaceid": "8d340f05-ed96-4b3e-b0c6-37d191d39d88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 20:14:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-8deccb16-fd75-4323-b9d4-0f549ba173b2 req-b846e3f7-caf8-4c6c-ad8b-0b9b86134c1e service nova] Acquired lock "refresh_cache-da025bc7-bf1a-40a1-8b9b-71ef9b28c01f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:14:05 user nova-compute[72504]: DEBUG nova.network.neutron [req-8deccb16-fd75-4323-b9d4-0f549ba173b2 req-b846e3f7-caf8-4c6c-ad8b-0b9b86134c1e service nova] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Refreshing network info cache for port 8d340f05-ed96-4b3e-b0c6-37d191d39d88 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:14:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:14:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:14:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:14:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] No VIF found with MAC fa:16:3e:74:2e:28, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:14:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-22debf43-82ba-4ba9-abca-4bcfa1cf4ab4 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.880s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:14:06 user nova-compute[72504]: DEBUG nova.network.neutron [req-8deccb16-fd75-4323-b9d4-0f549ba173b2 req-b846e3f7-caf8-4c6c-ad8b-0b9b86134c1e service nova] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Updated VIF entry in instance network info cache for port 8d340f05-ed96-4b3e-b0c6-37d191d39d88. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:14:06 user nova-compute[72504]: DEBUG nova.network.neutron [req-8deccb16-fd75-4323-b9d4-0f549ba173b2 req-b846e3f7-caf8-4c6c-ad8b-0b9b86134c1e service nova] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Updating instance_info_cache with network_info: [{"id": "8d340f05-ed96-4b3e-b0c6-37d191d39d88", "address": "fa:16:3e:31:94:3b", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d340f05-ed", "ovs_interfaceid": "8d340f05-ed96-4b3e-b0c6-37d191d39d88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:14:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-8deccb16-fd75-4323-b9d4-0f549ba173b2 req-b846e3f7-caf8-4c6c-ad8b-0b9b86134c1e service nova] Releasing lock "refresh_cache-da025bc7-bf1a-40a1-8b9b-71ef9b28c01f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:14:07 user nova-compute[72504]: INFO nova.compute.manager [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Rescuing
Aug 01 20:14:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Acquiring lock "refresh_cache-9ac6b63a-2c5a-4f72-9dc3-8f884253e180" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:14:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Acquired lock "refresh_cache-9ac6b63a-2c5a-4f72-9dc3-8f884253e180" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:14:07 user nova-compute[72504]: DEBUG nova.network.neutron [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:14:08 user nova-compute[72504]: DEBUG nova.network.neutron [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Updating instance_info_cache with network_info: [{"id": "298ca2cd-b389-42be-bc06-05344f41e0d2", "address": "fa:16:3e:74:2e:28", "network": {"id": "d4bfb5e4-0509-436d-8605-07b850de35b1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1900175842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f084e19e3c674b308d8a566f57bba3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ca2cd-b3", "ovs_interfaceid": "298ca2cd-b389-42be-bc06-05344f41e0d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:14:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Releasing lock "refresh_cache-9ac6b63a-2c5a-4f72-9dc3-8f884253e180" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:14:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:08 user nova-compute[72504]: DEBUG nova.compute.manager [req-91f5f34f-eea8-4d44-a3d9-5cfc9ae00fd7 req-a566fdfe-12dc-40ea-83d3-3dd122cbcea1 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received event network-vif-unplugged-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:14:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-91f5f34f-eea8-4d44-a3d9-5cfc9ae00fd7 req-a566fdfe-12dc-40ea-83d3-3dd122cbcea1 service nova] Acquiring lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:14:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-91f5f34f-eea8-4d44-a3d9-5cfc9ae00fd7 req-a566fdfe-12dc-40ea-83d3-3dd122cbcea1 service nova] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:14:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-91f5f34f-eea8-4d44-a3d9-5cfc9ae00fd7 req-a566fdfe-12dc-40ea-83d3-3dd122cbcea1 service nova] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:14:08 user nova-compute[72504]: DEBUG nova.compute.manager [req-91f5f34f-eea8-4d44-a3d9-5cfc9ae00fd7 req-a566fdfe-12dc-40ea-83d3-3dd122cbcea1 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] No waiting events found dispatching network-vif-unplugged-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:14:08 user nova-compute[72504]: WARNING nova.compute.manager [req-91f5f34f-eea8-4d44-a3d9-5cfc9ae00fd7 req-a566fdfe-12dc-40ea-83d3-3dd122cbcea1 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received unexpected event network-vif-unplugged-298ca2cd-b389-42be-bc06-05344f41e0d2 for instance with vm_state active and task_state rescuing.
Aug 01 20:14:09 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Instance destroyed successfully.
Aug 01 20:14:09 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Attempting a stable device rescue
Aug 01 20:14:09 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72504) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 20:14:09 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Instance directory exists: not creating {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 20:14:09 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Creating image(s)
Aug 01 20:14:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:14:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "/opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:14:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "/opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:14:09 user nova-compute[72504]: DEBUG nova.objects.instance [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:14:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Acquiring lock "217f7c5d9190b28be6caf01eaa96e865da8fcd22" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:14:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "217f7c5d9190b28be6caf01eaa96e865da8fcd22" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:14:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/217f7c5d9190b28be6caf01eaa96e865da8fcd22.part --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/217f7c5d9190b28be6caf01eaa96e865da8fcd22.part --force-share --output=json" returned: 0 in 0.152s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:10 user nova-compute[72504]: DEBUG nova.virt.images [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] ec6c6f60-7296-4883-8206-baec8dd7e8ad was qcow2, converting to raw {{(pid=72504) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 20:14:10 user nova-compute[72504]: DEBUG nova.privsep.utils [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72504) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 20:14:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/217f7c5d9190b28be6caf01eaa96e865da8fcd22.part /opt/stack/data/nova/instances/_base/217f7c5d9190b28be6caf01eaa96e865da8fcd22.converted {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:10 user nova-compute[72504]: DEBUG nova.compute.manager [req-4dcb9571-745c-43a7-bc03-bf4ded5c29ee req-425dfa7d-5fdf-4a48-a1c8-da533d43e3f9 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received event network-vif-plugged-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:14:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4dcb9571-745c-43a7-bc03-bf4ded5c29ee req-425dfa7d-5fdf-4a48-a1c8-da533d43e3f9 service nova] Acquiring lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:14:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4dcb9571-745c-43a7-bc03-bf4ded5c29ee req-425dfa7d-5fdf-4a48-a1c8-da533d43e3f9 service nova] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:14:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4dcb9571-745c-43a7-bc03-bf4ded5c29ee req-425dfa7d-5fdf-4a48-a1c8-da533d43e3f9 service nova] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:14:10 user nova-compute[72504]: DEBUG nova.compute.manager [req-4dcb9571-745c-43a7-bc03-bf4ded5c29ee req-425dfa7d-5fdf-4a48-a1c8-da533d43e3f9 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] No waiting events found dispatching network-vif-plugged-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:14:10 user nova-compute[72504]: WARNING nova.compute.manager [req-4dcb9571-745c-43a7-bc03-bf4ded5c29ee req-425dfa7d-5fdf-4a48-a1c8-da533d43e3f9 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received unexpected event network-vif-plugged-298ca2cd-b389-42be-bc06-05344f41e0d2 for instance with vm_state active and task_state rescuing.
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/217f7c5d9190b28be6caf01eaa96e865da8fcd22.part /opt/stack/data/nova/instances/_base/217f7c5d9190b28be6caf01eaa96e865da8fcd22.converted" returned: 0 in 0.589s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/217f7c5d9190b28be6caf01eaa96e865da8fcd22.converted --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/217f7c5d9190b28be6caf01eaa96e865da8fcd22.converted --force-share --output=json" returned: 0 in 0.148s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "217f7c5d9190b28be6caf01eaa96e865da8fcd22" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.175s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Acquiring lock "217f7c5d9190b28be6caf01eaa96e865da8fcd22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "217f7c5d9190b28be6caf01eaa96e865da8fcd22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/217f7c5d9190b28be6caf01eaa96e865da8fcd22 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/217f7c5d9190b28be6caf01eaa96e865da8fcd22 --force-share --output=json" returned: 0 in 0.160s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/217f7c5d9190b28be6caf01eaa96e865da8fcd22,backing_fmt=raw /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk.rescue {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/217f7c5d9190b28be6caf01eaa96e865da8fcd22,backing_fmt=raw /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk.rescue" returned: 0 in 0.052s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "217f7c5d9190b28be6caf01eaa96e865da8fcd22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.objects.instance [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lazy-loading 'migration_context' on Instance uuid 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Start _get_guest_xml network_info=[{"id": "298ca2cd-b389-42be-bc06-05344f41e0d2", "address": "fa:16:3e:74:2e:28", "network": {"id": "d4bfb5e4-0509-436d-8605-07b850de35b1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1900175842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1900175842-network", "vif_mac": "fa:16:3e:74:2e:28"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f084e19e3c674b308d8a566f57bba3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ca2cd-b3", "ovs_interfaceid": "298ca2cd-b389-42be-bc06-05344f41e0d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ec6c6f60-7296-4883-8206-baec8dd7e8ad', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BjEscyof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '9ac6b63a-2c5a-4f72-9dc3-8f884253e180', 'attached_at': '', 'detached_at': '', 'volume_id': '867e1952-6345-47a2-b171-67612cd6fbe6', 'serial': '867e1952-6345-47a2-b171-67612cd6fbe6'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': '22b10a15-852f-4b0c-b6a6-3bef77317690', 'volume_type': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.objects.instance [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lazy-loading 'resources' on Instance uuid 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.objects.instance [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lazy-loading 'numa_topology' on Instance uuid 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:14:11 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:14:11 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.objects.instance [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BjEscyof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:14:11 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:14:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:14:11 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:14:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:14:11 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5809cb4-bfd1-40ff-b0da-60db816ddacd]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = BjEscyof\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 01 20:14:11 user nova-compute[72504]: node.name = iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6
Aug 01 20:14:11 user nova-compute[72504]: node.tpgt = -1
Aug 01 20:14:11 user nova-compute[72504]: node.startup = automatic
Aug 01 20:14:11 user nova-compute[72504]: node.leading_login = No
Aug 01 20:14:11 user nova-compute[72504]: iface.iscsi_ifacename = default
Aug 01 20:14:11 user nova-compute[72504]: iface.net_ifacename = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.ipaddress = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.prefix_len = 0
Aug 01 20:14:11 user nova-compute[72504]: iface.hwaddress = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.transport_name = tcp
Aug 01 20:14:11 user nova-compute[72504]: iface.initiatorname = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.state = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.vlan_id = 0
Aug 01 20:14:11 user nova-compute[72504]: iface.vlan_priority = 0
Aug 01 20:14:11 user nova-compute[72504]: iface.vlan_state = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.iface_num = 0
Aug 01 20:14:11 user nova-compute[72504]: iface.mtu = 0
Aug 01 20:14:11 user nova-compute[72504]: iface.port = 0
Aug 01 20:14:11 user nova-compute[72504]: iface.bootproto = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.subnet_mask = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.gateway = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.dhcp_alt_client_id_state = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.dhcp_alt_client_id = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.dhcp_dns = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.dhcp_learn_iqn = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.dhcp_req_vendor_id_state = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.dhcp_vendor_id_state = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.dhcp_vendor_id = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.dhcp_slp_da = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.fragmentation = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.gratuitous_arp = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.incoming_forwarding = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.tos_state = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.tos = 0
Aug 01 20:14:11 user nova-compute[72504]: iface.ttl = 0
Aug 01 20:14:11 user nova-compute[72504]: iface.delayed_ack = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.tcp_nagle = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.tcp_wsf_state = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.tcp_wsf = 0
Aug 01 20:14:11 user nova-compute[72504]: iface.tcp_timer_scale = 0
Aug 01 20:14:11 user nova-compute[72504]: iface.tcp_timestamp = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.redirect = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.def_task_mgmt_timeout = 0
Aug 01 20:14:11 user nova-compute[72504]: iface.header_digest = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.data_digest = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.immediate_data = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.initial_r2t = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.data_seq_inorder = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.data_pdu_inorder = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.erl = 0
Aug 01 20:14:11 user nova-compute[72504]: iface.max_receive_data_len = 0
Aug 01 20:14:11 user nova-compute[72504]: iface.first_burst_len = 0
Aug 01 20:14:11 user nova-compute[72504]: iface.max_outstanding_r2t = 0
Aug 01 20:14:11 user nova-compute[72504]: iface.max_burst_len = 0
Aug 01 20:14:11 user nova-compute[72504]: iface.chap_auth = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.bidi_chap = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.strict_login_compliance = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.discovery_auth = <empty>
Aug 01 20:14:11 user nova-compute[72504]: iface.discovery_logout = <empty>
Aug 01 20:14:11 user nova-compute[72504]: node.discovery_address = <empty>
Aug 01 20:14:11 user nova-compute[72504]: node.discovery_port = 0
Aug 01 20:14:11 user nova-compute[72504]: node.discovery_type = static
Aug 01 20:14:11 user nova-compute[72504]: node.session.initial_cmdsn = 0
Aug 01 20:14:11 user nova-compute[72504]: node.session.initial_login_retry_max = 8
Aug 01 20:14:11 user nova-compute[72504]: node.session.xmit_thread_priority = -20
Aug 01 20:14:11 user nova-compute[72504]: node.session.cmds_max = 128
Aug 01 20:14:11 user nova-compute[72504]: node.session.queue_depth = 32
Aug 01 20:14:11 user nova-compute[72504]: node.session.nr_sessions = 1
Aug 01 20:14:11 user nova-compute[72504]: node.session.auth.authmethod = CHAP
Aug 01 20:14:11 user nova-compute[72504]: node.session.auth.username = BjEscyof
Aug 01 20:14:11 user nova-compute[72504]: node.session.auth.password = ***
Aug 01 20:14:11 user nova-compute[72504]: node.session.auth.username_in = <empty>
Aug 01 20:14:11 user nova-compute[72504]: node.session.auth.password_in = <empty>
Aug 01 20:14:11 user nova-compute[72504]: node.session.auth.chap_algs = MD5
Aug 01 20:14:11 user nova-compute[72504]: node.session.timeo.replacement_timeout = 120
Aug 01 20:14:11 user nova-compute[72504]: node.session.err_timeo.abort_timeout = 15
Aug 01 20:14:11 user nova-compute[72504]: node.session.err_timeo.lu_reset_timeout = 30
Aug 01 20:14:11 user nova-compute[72504]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 01 20:14:11 user nova-compute[72504]: node.session.err_timeo.host_reset_timeout = 60
Aug 01 20:14:11 user nova-compute[72504]: node.session.iscsi.FastAbort = Yes
Aug 01 20:14:11 user nova-compute[72504]: node.session.iscsi.InitialR2T = No
Aug 01 20:14:11 user nova-compute[72504]: node.session.iscsi.ImmediateData = Yes
Aug 01 20:14:11 user nova-compute[72504]: node.session.iscsi.FirstBurstLength = 262144
Aug 01 20:14:11 user nova-compute[72504]: node.session.iscsi.MaxBurstLength = 16776192
Aug 01 20:14:11 user nova-compute[72504]: node.session.iscsi.DefaultTime2Retain = 0
Aug 01 20:14:11 user nova-compute[72504]: node.session.iscsi.DefaultTime2Wait = 2
Aug 01 20:14:11 user nova-compute[72504]: node.session.iscsi.MaxConnections = 1
Aug 01 20:14:11 user nova-compute[72504]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 01 20:14:11 user nova-compute[72504]: node.session.iscsi.ERL = 0
Aug 01 20:14:11 user nova-compute[72504]: node.session.scan = manual
Aug 01 20:14:11 user nova-compute[72504]: node.session.reopen_max = 0
Aug 01 20:14:11 user nova-compute[72504]: node.conn[0].address = 172.16.0.220
Aug 01 20:14:11 user nova-compute[72504]: node.conn[0].port = 3260
Aug 01 20:14:11 user nova-compute[72504]: node.conn[0].startup = manual
Aug 01 20:14:11 user nova-compute[72504]: node.conn[0].tcp.window_size = 524288
Aug 01 20:14:11 user nova-compute[72504]: node.conn[0].tcp.type_of_service = 0
Aug 01 20:14:11 user nova-compute[72504]: node.conn[0].timeo.logout_timeout = 15
Aug 01 20:14:11 user nova-compute[72504]: node.conn[0].timeo.login_timeout = 15
Aug 01 20:14:11 user nova-compute[72504]: node.conn[0].timeo.auth_timeout = 45
Aug 01 20:14:11 user nova-compute[72504]: node.conn[0].timeo.noop_out_interval = 5
Aug 01 20:14:11 user nova-compute[72504]: node.conn[0].timeo.noop_out_timeout = 5
Aug 01 20:14:11 user nova-compute[72504]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 01 20:14:11 user nova-compute[72504]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 01 20:14:11 user nova-compute[72504]: node.conn[0].iscsi.HeaderDigest = None
Aug 01 20:14:11 user nova-compute[72504]: node.conn[0].iscsi.DataDigest = None
Aug 01 20:14:11 user nova-compute[72504]: node.conn[0].iscsi.IFMarker = No
Aug 01 20:14:11 user nova-compute[72504]: node.conn[0].iscsi.OFMarker = No
Aug 01 20:14:11 user nova-compute[72504]: # END RECORD
Aug 01 20:14:11 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc87038-517c-4f0c-abab-6e4ca7d0a653]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30ae0a8-bf98-4b31-a75a-25d94e0f2598]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BjEscyof {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BjEscyof" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9c7e8c-6987-4940-9536-96a78d91b535]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BjEscyof'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b3b1c9-4cbb-475c-9c84-a55c7361dbc8]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[03178abb-b33f-45ef-9edf-553aac3c2dd0]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)
Aug 01 20:14:11 user nova-compute[72504]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 (non-flash)
Aug 01 20:14:11 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)
Aug 01 20:14:11 user nova-compute[72504]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 (non-flash)
Aug 01 20:14:11 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.133s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] HCTL ('34', '0', '0', 0) found on session 46 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a776e7-a275-40f4-bbf0-8c7782065987]: (4, ('0 0 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Searching for a device in session 46 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BjEscyof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.157s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] <== connect_volume: return (159ms) {'type': 'block', 'scsi_wwn': '23035363761376236', 'path': '/dev/sdc'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035363761376236', 'path': '/dev/sdc'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:10:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1381056158',display_name='tempest-ServerStableDeviceRescueTest-server-1381056158',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1381056158',id=37,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIVwp+tuXO6c8kD785Zo2XEHfC7u/nN/LRbpKentZruUp4OEarQSWw3qwP7r5vGpF4yfsIPZn6vwvxtuEVuQxxzjzDEY61CEq1/sMW/n2rGFZLUFfYrKgriISxcduSjrQ==',key_name='tempest-keypair-982487004',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:10:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f084e19e3c674b308d8a566f57bba3f2',ramdisk_id='',reservation_id='r-dv3t3ab9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1470200004',owner_user_name='tempest-ServerStableDeviceRescueTest-1470200004-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:12:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e77534532ab04a699a69ee9d2ef6f5b1',uuid=9ac6b63a-2c5a-4f72-9dc3-8f884253e180,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "298ca2cd-b389-42be-bc06-05344f41e0d2", "address": "fa:16:3e:74:2e:28", "network": {"id": "d4bfb5e4-0509-436d-8605-07b850de35b1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1900175842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1900175842-network", "vif_mac": "fa:16:3e:74:2e:28"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f084e19e3c674b308d8a566f57bba3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ca2cd-b3", "ovs_interfaceid": "298ca2cd-b389-42be-bc06-05344f41e0d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Converting VIF {"id": "298ca2cd-b389-42be-bc06-05344f41e0d2", "address": "fa:16:3e:74:2e:28", "network": {"id": "d4bfb5e4-0509-436d-8605-07b850de35b1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1900175842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1900175842-network", "vif_mac": "fa:16:3e:74:2e:28"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f084e19e3c674b308d8a566f57bba3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ca2cd-b3", "ovs_interfaceid": "298ca2cd-b389-42be-bc06-05344f41e0d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:2e:28,bridge_name='br-int',has_traffic_filtering=True,id=298ca2cd-b389-42be-bc06-05344f41e0d2,network=Network(d4bfb5e4-0509-436d-8605-07b850de35b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap298ca2cd-b3') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.objects.instance [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:14:11 user nova-compute[72504]:   <uuid>9ac6b63a-2c5a-4f72-9dc3-8f884253e180</uuid>
Aug 01 20:14:11 user nova-compute[72504]:   <name>instance-00000025</name>
Aug 01 20:14:11 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:14:11 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:14:11 user nova-compute[72504]:   <metadata>
Aug 01 20:14:11 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:14:11 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:14:11 user nova-compute[72504]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1381056158</nova:name>
Aug 01 20:14:11 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:14:11</nova:creationTime>
Aug 01 20:14:11 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:14:11 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:14:11 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:14:11 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:14:11 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:14:11 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:14:11 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:14:11 user nova-compute[72504]:       <nova:owner>
Aug 01 20:14:11 user nova-compute[72504]:         <nova:user uuid="e77534532ab04a699a69ee9d2ef6f5b1">tempest-ServerStableDeviceRescueTest-1470200004-project-member</nova:user>
Aug 01 20:14:11 user nova-compute[72504]:         <nova:project uuid="f084e19e3c674b308d8a566f57bba3f2">tempest-ServerStableDeviceRescueTest-1470200004</nova:project>
Aug 01 20:14:11 user nova-compute[72504]:       </nova:owner>
Aug 01 20:14:11 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 20:14:11 user nova-compute[72504]:       <nova:ports>
Aug 01 20:14:11 user nova-compute[72504]:         <nova:port uuid="298ca2cd-b389-42be-bc06-05344f41e0d2">
Aug 01 20:14:11 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 20:14:11 user nova-compute[72504]:         </nova:port>
Aug 01 20:14:11 user nova-compute[72504]:       </nova:ports>
Aug 01 20:14:11 user nova-compute[72504]:     </nova:instance>
Aug 01 20:14:11 user nova-compute[72504]:   </metadata>
Aug 01 20:14:11 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:14:11 user nova-compute[72504]:     <system>
Aug 01 20:14:11 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:14:11 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:14:11 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:14:11 user nova-compute[72504]:       <entry name="serial">9ac6b63a-2c5a-4f72-9dc3-8f884253e180</entry>
Aug 01 20:14:11 user nova-compute[72504]:       <entry name="uuid">9ac6b63a-2c5a-4f72-9dc3-8f884253e180</entry>
Aug 01 20:14:11 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:14:11 user nova-compute[72504]:     </system>
Aug 01 20:14:11 user nova-compute[72504]:   </sysinfo>
Aug 01 20:14:11 user nova-compute[72504]:   <os>
Aug 01 20:14:11 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:14:11 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:14:11 user nova-compute[72504]:   </os>
Aug 01 20:14:11 user nova-compute[72504]:   <features>
Aug 01 20:14:11 user nova-compute[72504]:     <acpi/>
Aug 01 20:14:11 user nova-compute[72504]:     <apic/>
Aug 01 20:14:11 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:14:11 user nova-compute[72504]:   </features>
Aug 01 20:14:11 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:14:11 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:14:11 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:14:11 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:14:11 user nova-compute[72504]:   </clock>
Aug 01 20:14:11 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:14:11 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:14:11 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:14:11 user nova-compute[72504]:   </cpu>
Aug 01 20:14:11 user nova-compute[72504]:   <devices>
Aug 01 20:14:11 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 20:14:11 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 20:14:11 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk"/>
Aug 01 20:14:11 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:14:11 user nova-compute[72504]:     </disk>
Aug 01 20:14:11 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 20:14:11 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:14:11 user nova-compute[72504]:       <source dev="/dev/sdc"/>
Aug 01 20:14:11 user nova-compute[72504]:       <target dev="vdb" bus="virtio"/>
Aug 01 20:14:11 user nova-compute[72504]:       <serial>867e1952-6345-47a2-b171-67612cd6fbe6</serial>
Aug 01 20:14:11 user nova-compute[72504]:     </disk>
Aug 01 20:14:11 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 20:14:11 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 20:14:11 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk.rescue"/>
Aug 01 20:14:11 user nova-compute[72504]:       <target dev="vdc" bus="virtio"/>
Aug 01 20:14:11 user nova-compute[72504]:       <boot order="1"/>
Aug 01 20:14:11 user nova-compute[72504]:     </disk>
Aug 01 20:14:11 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:14:11 user nova-compute[72504]:       <mac address="fa:16:3e:74:2e:28"/>
Aug 01 20:14:11 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:14:11 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:14:11 user nova-compute[72504]:       <target dev="tap298ca2cd-b3"/>
Aug 01 20:14:11 user nova-compute[72504]:     </interface>
Aug 01 20:14:11 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:14:11 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/console.log" append="off"/>
Aug 01 20:14:11 user nova-compute[72504]:     </serial>
Aug 01 20:14:11 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:14:11 user nova-compute[72504]:     <video>
Aug 01 20:14:11 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:14:11 user nova-compute[72504]:     </video>
Aug 01 20:14:11 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:14:11 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:14:11 user nova-compute[72504]:     </rng>
Aug 01 20:14:11 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:14:11 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:14:11 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:14:11 user nova-compute[72504]:     </memballoon>
Aug 01 20:14:11 user nova-compute[72504]:   </devices>
Aug 01 20:14:11 user nova-compute[72504]: </domain>
Aug 01 20:14:11 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:14:11 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Instance destroyed successfully.
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:14:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] No VIF found with MAC fa:16:3e:74:2e:28, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:14:12 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Creating image(s)
Aug 01 20:14:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Did not create local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Ensure instance console log exists: /opt/stack/data/nova/instances/da025bc7-bf1a-40a1-8b9b-71ef9b28c01f/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Start _get_guest_xml network_info=[{"id": "8d340f05-ed96-4b3e-b0c6-37d191d39d88", "address": "fa:16:3e:31:94:3b", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d340f05-ed", "ovs_interfaceid": "8d340f05-ed96-4b3e-b0c6-37d191d39d88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkHGEOcj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'da025bc7-bf1a-40a1-8b9b-71ef9b28c01f', 'attached_at': '', 'detached_at': '', 'volume_id': '500a89fd-74ba-4703-83b0-986e7cb06828', 'serial': '500a89fd-74ba-4703-83b0-986e7cb06828'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': '31759bf4-0959-4d58-b964-885ce35dc246', 'volume_type': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:14:12 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:14:12 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:14:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkHGEOcj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:14:12 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:14:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:14:12 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:14:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:14:12 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1b25cc-d6b4-4cfa-b4fe-50d9aba0cafd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:14:12 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b21b76-1915-475c-b632-8b7da26c66a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828] added
Aug 01 20:14:12 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4f6560-8e0e-4542-b5b2-14da85994ea4]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a81842b-cf0b-4797-84a0-f3c694843ede]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vkHGEOcj {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vkHGEOcj" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[90894af1-c566-4915-a086-ff2ee2d59a88]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vkHGEOcj'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a638cb16-3e9a-4300-92fc-9ec306176e8f]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5bca90-04d8-4c0a-aa17-2b631a38bd59]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)
Aug 01 20:14:12 user nova-compute[72504]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 (non-flash)
Aug 01 20:14:12 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)
Aug 01 20:14:12 user nova-compute[72504]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 (non-flash)
Aug 01 20:14:12 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a97b88-8a6f-4dd0-bebb-3cdeac7d5e21]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828, portal: 172.16.0.220,3260]
Aug 01 20:14:12 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828, portal: 172.16.0.220,3260] successful.
Aug 01 20:14:12 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e548d5-43de-477a-b815-515c81690497]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ae7b47-30db-45e4-8acc-7999e7cf15f0]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)
Aug 01 20:14:12 user nova-compute[72504]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 (non-flash)
Aug 01 20:14:12 user nova-compute[72504]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:14:12 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)
Aug 01 20:14:12 user nova-compute[72504]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 (non-flash)
Aug 01 20:14:12 user nova-compute[72504]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:14:12 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a409e2-24f6-427e-9c33-7e7a82b6b807]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:14:12 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: None {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkHGEOcj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23632323266393031', 'path': '/dev/sdd'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632323266393031', 'path': '/dev/sdd'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:14:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1248209100',display_name='tempest-TestVolumeBootPattern-server-1248209100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1248209100',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrKan85Goqo8Jv0VkDYyshQTMQ59f3rUyYronrtEBxVKZjCUMR9BmiZNw9TY8Sa/UvzfiwIaZSAr04+rYB06rxcAkBTQWOBWsdwofE2ksnZ+I8hLlgBMpWvgtrRSAHuwA==',key_name='tempest-TestVolumeBootPattern-1138255315',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb59fbc2bf9749f3af7d56435cb37066',ramdisk_id='',reservation_id='r-ib463juz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-685885098',owner_user_name='tempest-TestVolumeBootPattern-685885098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:14:04Z,user_data=None,user_id='f06381c8a6214ddea7f1b36b623ed4d5',uuid=da025bc7-bf1a-40a1-8b9b-71ef9b28c01f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d340f05-ed96-4b3e-b0c6-37d191d39d88", "address": "fa:16:3e:31:94:3b", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d340f05-ed", "ovs_interfaceid": "8d340f05-ed96-4b3e-b0c6-37d191d39d88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converting VIF {"id": "8d340f05-ed96-4b3e-b0c6-37d191d39d88", "address": "fa:16:3e:31:94:3b", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d340f05-ed", "ovs_interfaceid": "8d340f05-ed96-4b3e-b0c6-37d191d39d88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:94:3b,bridge_name='br-int',has_traffic_filtering=True,id=8d340f05-ed96-4b3e-b0c6-37d191d39d88,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d340f05-ed') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG nova.objects.instance [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lazy-loading 'pci_devices' on Instance uuid da025bc7-bf1a-40a1-8b9b-71ef9b28c01f {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:14:13 user nova-compute[72504]:   <uuid>da025bc7-bf1a-40a1-8b9b-71ef9b28c01f</uuid>
Aug 01 20:14:13 user nova-compute[72504]:   <name>instance-00000029</name>
Aug 01 20:14:13 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:14:13 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:14:13 user nova-compute[72504]:   <metadata>
Aug 01 20:14:13 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:14:13 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:14:13 user nova-compute[72504]:       <nova:name>tempest-TestVolumeBootPattern-server-1248209100</nova:name>
Aug 01 20:14:13 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:14:12</nova:creationTime>
Aug 01 20:14:13 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:14:13 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:14:13 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:14:13 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:14:13 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:14:13 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:14:13 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:14:13 user nova-compute[72504]:       <nova:owner>
Aug 01 20:14:13 user nova-compute[72504]:         <nova:user uuid="f06381c8a6214ddea7f1b36b623ed4d5">tempest-TestVolumeBootPattern-685885098-project-member</nova:user>
Aug 01 20:14:13 user nova-compute[72504]:         <nova:project uuid="eb59fbc2bf9749f3af7d56435cb37066">tempest-TestVolumeBootPattern-685885098</nova:project>
Aug 01 20:14:13 user nova-compute[72504]:       </nova:owner>
Aug 01 20:14:13 user nova-compute[72504]:       <nova:ports>
Aug 01 20:14:13 user nova-compute[72504]:         <nova:port uuid="8d340f05-ed96-4b3e-b0c6-37d191d39d88">
Aug 01 20:14:13 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 20:14:13 user nova-compute[72504]:         </nova:port>
Aug 01 20:14:13 user nova-compute[72504]:       </nova:ports>
Aug 01 20:14:13 user nova-compute[72504]:     </nova:instance>
Aug 01 20:14:13 user nova-compute[72504]:   </metadata>
Aug 01 20:14:13 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:14:13 user nova-compute[72504]:     <system>
Aug 01 20:14:13 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:14:13 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:14:13 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:14:13 user nova-compute[72504]:       <entry name="serial">da025bc7-bf1a-40a1-8b9b-71ef9b28c01f</entry>
Aug 01 20:14:13 user nova-compute[72504]:       <entry name="uuid">da025bc7-bf1a-40a1-8b9b-71ef9b28c01f</entry>
Aug 01 20:14:13 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:14:13 user nova-compute[72504]:     </system>
Aug 01 20:14:13 user nova-compute[72504]:   </sysinfo>
Aug 01 20:14:13 user nova-compute[72504]:   <os>
Aug 01 20:14:13 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:14:13 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:14:13 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:14:13 user nova-compute[72504]:   </os>
Aug 01 20:14:13 user nova-compute[72504]:   <features>
Aug 01 20:14:13 user nova-compute[72504]:     <acpi/>
Aug 01 20:14:13 user nova-compute[72504]:     <apic/>
Aug 01 20:14:13 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:14:13 user nova-compute[72504]:   </features>
Aug 01 20:14:13 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:14:13 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:14:13 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:14:13 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:14:13 user nova-compute[72504]:   </clock>
Aug 01 20:14:13 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:14:13 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:14:13 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:14:13 user nova-compute[72504]:   </cpu>
Aug 01 20:14:13 user nova-compute[72504]:   <devices>
Aug 01 20:14:13 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 20:14:13 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:14:13 user nova-compute[72504]:       <source dev="/dev/sdd"/>
Aug 01 20:14:13 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:14:13 user nova-compute[72504]:       <serial>500a89fd-74ba-4703-83b0-986e7cb06828</serial>
Aug 01 20:14:13 user nova-compute[72504]:     </disk>
Aug 01 20:14:13 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:14:13 user nova-compute[72504]:       <mac address="fa:16:3e:31:94:3b"/>
Aug 01 20:14:13 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:14:13 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:14:13 user nova-compute[72504]:       <target dev="tap8d340f05-ed"/>
Aug 01 20:14:13 user nova-compute[72504]:     </interface>
Aug 01 20:14:13 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:14:13 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/da025bc7-bf1a-40a1-8b9b-71ef9b28c01f/console.log" append="off"/>
Aug 01 20:14:13 user nova-compute[72504]:     </serial>
Aug 01 20:14:13 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:14:13 user nova-compute[72504]:     <video>
Aug 01 20:14:13 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:14:13 user nova-compute[72504]:     </video>
Aug 01 20:14:13 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:14:13 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:14:13 user nova-compute[72504]:     </rng>
Aug 01 20:14:13 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:14:13 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:14:13 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:14:13 user nova-compute[72504]:     </memballoon>
Aug 01 20:14:13 user nova-compute[72504]:   </devices>
Aug 01 20:14:13 user nova-compute[72504]: </domain>
Aug 01 20:14:13 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:14:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1248209100',display_name='tempest-TestVolumeBootPattern-server-1248209100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1248209100',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrKan85Goqo8Jv0VkDYyshQTMQ59f3rUyYronrtEBxVKZjCUMR9BmiZNw9TY8Sa/UvzfiwIaZSAr04+rYB06rxcAkBTQWOBWsdwofE2ksnZ+I8hLlgBMpWvgtrRSAHuwA==',key_name='tempest-TestVolumeBootPattern-1138255315',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb59fbc2bf9749f3af7d56435cb37066',ramdisk_id='',reservation_id='r-ib463juz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-685885098',owner_user_name='tempest-TestVolumeBootPattern-685885098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:14:04Z,user_data=None,user_id='f06381c8a6214ddea7f1b36b623ed4d5',uuid=da025bc7-bf1a-40a1-8b9b-71ef9b28c01f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d340f05-ed96-4b3e-b0c6-37d191d39d88", "address": "fa:16:3e:31:94:3b", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d340f05-ed", "ovs_interfaceid": "8d340f05-ed96-4b3e-b0c6-37d191d39d88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converting VIF {"id": "8d340f05-ed96-4b3e-b0c6-37d191d39d88", "address": "fa:16:3e:31:94:3b", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d340f05-ed", "ovs_interfaceid": "8d340f05-ed96-4b3e-b0c6-37d191d39d88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:94:3b,bridge_name='br-int',has_traffic_filtering=True,id=8d340f05-ed96-4b3e-b0c6-37d191d39d88,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d340f05-ed') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG os_vif [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:94:3b,bridge_name='br-int',has_traffic_filtering=True,id=8d340f05-ed96-4b3e-b0c6-37d191d39d88,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d340f05-ed') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d340f05-ed, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8d340f05-ed, col_values=(('external_ids', {'iface-id': '8d340f05-ed96-4b3e-b0c6-37d191d39d88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:94:3b', 'vm-uuid': 'da025bc7-bf1a-40a1-8b9b-71ef9b28c01f'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG nova.compute.manager [req-bd8cbf4e-b95a-49ca-8536-5526ec6082b8 req-fa3abb96-e993-45e7-8b6b-667b357ed061 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received event network-vif-plugged-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-bd8cbf4e-b95a-49ca-8536-5526ec6082b8 req-fa3abb96-e993-45e7-8b6b-667b357ed061 service nova] Acquiring lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-bd8cbf4e-b95a-49ca-8536-5526ec6082b8 req-fa3abb96-e993-45e7-8b6b-667b357ed061 service nova] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-bd8cbf4e-b95a-49ca-8536-5526ec6082b8 req-fa3abb96-e993-45e7-8b6b-667b357ed061 service nova] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG nova.compute.manager [req-bd8cbf4e-b95a-49ca-8536-5526ec6082b8 req-fa3abb96-e993-45e7-8b6b-667b357ed061 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] No waiting events found dispatching network-vif-plugged-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:14:13 user nova-compute[72504]: WARNING nova.compute.manager [req-bd8cbf4e-b95a-49ca-8536-5526ec6082b8 req-fa3abb96-e993-45e7-8b6b-667b357ed061 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received unexpected event network-vif-plugged-298ca2cd-b389-42be-bc06-05344f41e0d2 for instance with vm_state active and task_state rescuing.
Aug 01 20:14:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:13 user nova-compute[72504]: INFO os_vif [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:94:3b,bridge_name='br-int',has_traffic_filtering=True,id=8d340f05-ed96-4b3e-b0c6-37d191d39d88,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d340f05-ed')
Aug 01 20:14:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] No VIF found with MAC fa:16:3e:31:94:3b, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:15 user nova-compute[72504]: DEBUG nova.compute.manager [req-e7b25e29-e54f-4ea5-a06d-4ffe191020c8 req-ce502ad2-27ac-4c00-9d37-fae1efccfea8 service nova] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Received event network-vif-plugged-8d340f05-ed96-4b3e-b0c6-37d191d39d88 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:14:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e7b25e29-e54f-4ea5-a06d-4ffe191020c8 req-ce502ad2-27ac-4c00-9d37-fae1efccfea8 service nova] Acquiring lock "da025bc7-bf1a-40a1-8b9b-71ef9b28c01f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:14:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e7b25e29-e54f-4ea5-a06d-4ffe191020c8 req-ce502ad2-27ac-4c00-9d37-fae1efccfea8 service nova] Lock "da025bc7-bf1a-40a1-8b9b-71ef9b28c01f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:14:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e7b25e29-e54f-4ea5-a06d-4ffe191020c8 req-ce502ad2-27ac-4c00-9d37-fae1efccfea8 service nova] Lock "da025bc7-bf1a-40a1-8b9b-71ef9b28c01f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:14:15 user nova-compute[72504]: DEBUG nova.compute.manager [req-e7b25e29-e54f-4ea5-a06d-4ffe191020c8 req-ce502ad2-27ac-4c00-9d37-fae1efccfea8 service nova] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] No waiting events found dispatching network-vif-plugged-8d340f05-ed96-4b3e-b0c6-37d191d39d88 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:14:15 user nova-compute[72504]: WARNING nova.compute.manager [req-e7b25e29-e54f-4ea5-a06d-4ffe191020c8 req-ce502ad2-27ac-4c00-9d37-fae1efccfea8 service nova] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Received unexpected event network-vif-plugged-8d340f05-ed96-4b3e-b0c6-37d191d39d88 for instance with vm_state building and task_state spawning.
Aug 01 20:14:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:15 user nova-compute[72504]: DEBUG nova.compute.manager [req-a68b543a-326c-44ec-9f41-a710c711905d req-707ae124-14cc-42d1-85d6-94ce287ba02a service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received event network-vif-plugged-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:14:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a68b543a-326c-44ec-9f41-a710c711905d req-707ae124-14cc-42d1-85d6-94ce287ba02a service nova] Acquiring lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:14:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a68b543a-326c-44ec-9f41-a710c711905d req-707ae124-14cc-42d1-85d6-94ce287ba02a service nova] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:14:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a68b543a-326c-44ec-9f41-a710c711905d req-707ae124-14cc-42d1-85d6-94ce287ba02a service nova] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:14:15 user nova-compute[72504]: DEBUG nova.compute.manager [req-a68b543a-326c-44ec-9f41-a710c711905d req-707ae124-14cc-42d1-85d6-94ce287ba02a service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] No waiting events found dispatching network-vif-plugged-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:14:15 user nova-compute[72504]: WARNING nova.compute.manager [req-a68b543a-326c-44ec-9f41-a710c711905d req-707ae124-14cc-42d1-85d6-94ce287ba02a service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received unexpected event network-vif-plugged-298ca2cd-b389-42be-bc06-05344f41e0d2 for instance with vm_state active and task_state rescuing.
Aug 01 20:14:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Removed pending event for 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 due to event {{(pid=72504) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 20:14:16 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920856.2254193, 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:14:16 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] VM Resumed (Lifecycle Event)
Aug 01 20:14:16 user nova-compute[72504]: DEBUG nova.compute.manager [None req-53293c15-7646-48d8-8513-16654f81fe5c tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:14:16 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:14:16 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:14:16 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 20:14:16 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920856.2277877, 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:14:16 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] VM Started (Lifecycle Event)
Aug 01 20:14:16 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:14:16 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:14:17 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920857.0345635, da025bc7-bf1a-40a1-8b9b-71ef9b28c01f => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:14:17 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] VM Resumed (Lifecycle Event)
Aug 01 20:14:17 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:14:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:14:17 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Instance spawned successfully.
Aug 01 20:14:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 20:14:17 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:14:17 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:14:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:14:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:14:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:14:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:14:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:14:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:14:17 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:14:17 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920857.035633, da025bc7-bf1a-40a1-8b9b-71ef9b28c01f => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:14:17 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] VM Started (Lifecycle Event)
Aug 01 20:14:17 user nova-compute[72504]: DEBUG nova.compute.manager [req-6edfc52f-41e4-4e9e-97fc-7c940dce1bf6 req-c37804fb-4e5e-4ca3-8590-b3b74c6d9b57 service nova] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Received event network-vif-plugged-8d340f05-ed96-4b3e-b0c6-37d191d39d88 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:14:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6edfc52f-41e4-4e9e-97fc-7c940dce1bf6 req-c37804fb-4e5e-4ca3-8590-b3b74c6d9b57 service nova] Acquiring lock "da025bc7-bf1a-40a1-8b9b-71ef9b28c01f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:14:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6edfc52f-41e4-4e9e-97fc-7c940dce1bf6 req-c37804fb-4e5e-4ca3-8590-b3b74c6d9b57 service nova] Lock "da025bc7-bf1a-40a1-8b9b-71ef9b28c01f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:14:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6edfc52f-41e4-4e9e-97fc-7c940dce1bf6 req-c37804fb-4e5e-4ca3-8590-b3b74c6d9b57 service nova] Lock "da025bc7-bf1a-40a1-8b9b-71ef9b28c01f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:14:17 user nova-compute[72504]: DEBUG nova.compute.manager [req-6edfc52f-41e4-4e9e-97fc-7c940dce1bf6 req-c37804fb-4e5e-4ca3-8590-b3b74c6d9b57 service nova] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] No waiting events found dispatching network-vif-plugged-8d340f05-ed96-4b3e-b0c6-37d191d39d88 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:14:17 user nova-compute[72504]: WARNING nova.compute.manager [req-6edfc52f-41e4-4e9e-97fc-7c940dce1bf6 req-c37804fb-4e5e-4ca3-8590-b3b74c6d9b57 service nova] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Received unexpected event network-vif-plugged-8d340f05-ed96-4b3e-b0c6-37d191d39d88 for instance with vm_state building and task_state spawning.
Aug 01 20:14:17 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:14:17 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:14:17 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:14:17 user nova-compute[72504]: INFO nova.compute.manager [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Took 5.09 seconds to spawn the instance on the hypervisor.
Aug 01 20:14:17 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:14:17 user nova-compute[72504]: INFO nova.compute.manager [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Took 13.88 seconds to build instance.
Aug 01 20:14:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1ef89022-d069-4f03-ad8e-fe30610ec22b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "da025bc7-bf1a-40a1-8b9b-71ef9b28c01f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.029s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:14:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:27 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:14:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:14:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:14:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:14:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:14:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:29 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:14:32 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:14:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:14:34 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:14:36 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:14:36 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:14:37 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:14:37 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:14:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-a4f9c59c-cf0b-4216-a194-22712725328d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:14:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-a4f9c59c-cf0b-4216-a194-22712725328d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:14:38 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:14:38 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Updating instance_info_cache with network_info: [{"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:14:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-a4f9c59c-cf0b-4216-a194-22712725328d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:14:38 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:14:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:38 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:14:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:14:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:14:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:14:38 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:14:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:14:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:14:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:39 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:14:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38748b45-c891-4ffb-8326-5ca0b15579f3/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38748b45-c891-4ffb-8326-5ca0b15579f3/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38748b45-c891-4ffb-8326-5ca0b15579f3/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:14:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38748b45-c891-4ffb-8326-5ca0b15579f3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:14:40 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:14:40 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:14:40 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8344MB free_disk=25.121326446533203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:14:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:14:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:14:40 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:14:40 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance a4f9c59c-cf0b-4216-a194-22712725328d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:14:40 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 38748b45-c891-4ffb-8326-5ca0b15579f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:14:40 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance da025bc7-bf1a-40a1-8b9b-71ef9b28c01f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:14:40 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:14:40 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:14:40 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:14:40 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:14:40 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:14:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.403s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:14:40 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:14:41 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:14:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:14:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:14:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:14:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:14:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:14:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:14:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:14:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:14:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:15:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:15:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:15:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:15:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6f3e2394-9e53-417a-b5dd-1b2bbb5c2863 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Acquiring lock "38748b45-c891-4ffb-8326-5ca0b15579f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:15:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6f3e2394-9e53-417a-b5dd-1b2bbb5c2863 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Lock "38748b45-c891-4ffb-8326-5ca0b15579f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:15:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6f3e2394-9e53-417a-b5dd-1b2bbb5c2863 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Acquiring lock "38748b45-c891-4ffb-8326-5ca0b15579f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:15:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6f3e2394-9e53-417a-b5dd-1b2bbb5c2863 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Lock "38748b45-c891-4ffb-8326-5ca0b15579f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:15:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6f3e2394-9e53-417a-b5dd-1b2bbb5c2863 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Lock "38748b45-c891-4ffb-8326-5ca0b15579f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:15:07 user nova-compute[72504]: INFO nova.compute.manager [None req-6f3e2394-9e53-417a-b5dd-1b2bbb5c2863 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Terminating instance
Aug 01 20:15:07 user nova-compute[72504]: DEBUG nova.compute.manager [None req-6f3e2394-9e53-417a-b5dd-1b2bbb5c2863 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:15:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:08 user nova-compute[72504]: DEBUG nova.compute.manager [req-72e88ed5-8825-465c-84d6-565382a91f77 req-81da597d-792b-4a01-9478-526bf6a3f4d6 service nova] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Received event network-vif-unplugged-d6cc07c7-ec98-4467-b715-87899cbbe7a1 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:15:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-72e88ed5-8825-465c-84d6-565382a91f77 req-81da597d-792b-4a01-9478-526bf6a3f4d6 service nova] Acquiring lock "38748b45-c891-4ffb-8326-5ca0b15579f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:15:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-72e88ed5-8825-465c-84d6-565382a91f77 req-81da597d-792b-4a01-9478-526bf6a3f4d6 service nova] Lock "38748b45-c891-4ffb-8326-5ca0b15579f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:15:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-72e88ed5-8825-465c-84d6-565382a91f77 req-81da597d-792b-4a01-9478-526bf6a3f4d6 service nova] Lock "38748b45-c891-4ffb-8326-5ca0b15579f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:15:08 user nova-compute[72504]: DEBUG nova.compute.manager [req-72e88ed5-8825-465c-84d6-565382a91f77 req-81da597d-792b-4a01-9478-526bf6a3f4d6 service nova] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] No waiting events found dispatching network-vif-unplugged-d6cc07c7-ec98-4467-b715-87899cbbe7a1 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:15:08 user nova-compute[72504]: DEBUG nova.compute.manager [req-72e88ed5-8825-465c-84d6-565382a91f77 req-81da597d-792b-4a01-9478-526bf6a3f4d6 service nova] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Received event network-vif-unplugged-d6cc07c7-ec98-4467-b715-87899cbbe7a1 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:15:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:08 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Instance destroyed successfully.
Aug 01 20:15:08 user nova-compute[72504]: DEBUG nova.objects.instance [None req-6f3e2394-9e53-417a-b5dd-1b2bbb5c2863 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Lazy-loading 'resources' on Instance uuid 38748b45-c891-4ffb-8326-5ca0b15579f3 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:15:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-6f3e2394-9e53-417a-b5dd-1b2bbb5c2863 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:13:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1816069911',display_name='tempest-VolumesActionsTest-instance-1816069911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1816069911',id=40,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:13:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f5e5932c09a4ea68e896ec7e1fd2b42',ramdisk_id='',reservation_id='r-psecg8ow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1392877926',owner_user_name='tempest-VolumesActionsTest-1392877926-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:13:15Z,user_data=None,user_id='ffa16ee272b74ead854fe1b332d57a18',uuid=38748b45-c891-4ffb-8326-5ca0b15579f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6cc07c7-ec98-4467-b715-87899cbbe7a1", "address": "fa:16:3e:f7:7d:5d", "network": {"id": "2bf9d6e2-fadf-430f-9412-07dd349c174c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-715845787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f5e5932c09a4ea68e896ec7e1fd2b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6cc07c7-ec", "ovs_interfaceid": "d6cc07c7-ec98-4467-b715-87899cbbe7a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:15:08 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-6f3e2394-9e53-417a-b5dd-1b2bbb5c2863 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Converting VIF {"id": "d6cc07c7-ec98-4467-b715-87899cbbe7a1", "address": "fa:16:3e:f7:7d:5d", "network": {"id": "2bf9d6e2-fadf-430f-9412-07dd349c174c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-715845787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f5e5932c09a4ea68e896ec7e1fd2b42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6cc07c7-ec", "ovs_interfaceid": "d6cc07c7-ec98-4467-b715-87899cbbe7a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:15:08 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-6f3e2394-9e53-417a-b5dd-1b2bbb5c2863 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:7d:5d,bridge_name='br-int',has_traffic_filtering=True,id=d6cc07c7-ec98-4467-b715-87899cbbe7a1,network=Network(2bf9d6e2-fadf-430f-9412-07dd349c174c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6cc07c7-ec') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:15:08 user nova-compute[72504]: DEBUG os_vif [None req-6f3e2394-9e53-417a-b5dd-1b2bbb5c2863 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:7d:5d,bridge_name='br-int',has_traffic_filtering=True,id=d6cc07c7-ec98-4467-b715-87899cbbe7a1,network=Network(2bf9d6e2-fadf-430f-9412-07dd349c174c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6cc07c7-ec') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:15:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6cc07c7-ec, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:15:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:15:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:08 user nova-compute[72504]: INFO os_vif [None req-6f3e2394-9e53-417a-b5dd-1b2bbb5c2863 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:7d:5d,bridge_name='br-int',has_traffic_filtering=True,id=d6cc07c7-ec98-4467-b715-87899cbbe7a1,network=Network(2bf9d6e2-fadf-430f-9412-07dd349c174c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6cc07c7-ec')
Aug 01 20:15:08 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-6f3e2394-9e53-417a-b5dd-1b2bbb5c2863 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Deleting instance files /opt/stack/data/nova/instances/38748b45-c891-4ffb-8326-5ca0b15579f3_del
Aug 01 20:15:08 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-6f3e2394-9e53-417a-b5dd-1b2bbb5c2863 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Deletion of /opt/stack/data/nova/instances/38748b45-c891-4ffb-8326-5ca0b15579f3_del complete
Aug 01 20:15:08 user nova-compute[72504]: INFO nova.compute.manager [None req-6f3e2394-9e53-417a-b5dd-1b2bbb5c2863 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 01 20:15:08 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-6f3e2394-9e53-417a-b5dd-1b2bbb5c2863 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:15:08 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:15:08 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:15:09 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:15:09 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Took 0.46 seconds to deallocate network for instance.
Aug 01 20:15:09 user nova-compute[72504]: DEBUG nova.compute.manager [req-e15c7c98-4f07-4de3-a668-826788d33e39 req-fe5a63be-5a36-42a5-aa42-2f23da163ed5 service nova] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Received event network-vif-deleted-d6cc07c7-ec98-4467-b715-87899cbbe7a1 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:15:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6f3e2394-9e53-417a-b5dd-1b2bbb5c2863 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:15:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6f3e2394-9e53-417a-b5dd-1b2bbb5c2863 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:15:09 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-6f3e2394-9e53-417a-b5dd-1b2bbb5c2863 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:15:09 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-6f3e2394-9e53-417a-b5dd-1b2bbb5c2863 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:15:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6f3e2394-9e53-417a-b5dd-1b2bbb5c2863 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:15:09 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-6f3e2394-9e53-417a-b5dd-1b2bbb5c2863 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Deleted allocations for instance 38748b45-c891-4ffb-8326-5ca0b15579f3
Aug 01 20:15:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6f3e2394-9e53-417a-b5dd-1b2bbb5c2863 tempest-VolumesActionsTest-1392877926 tempest-VolumesActionsTest-1392877926-project-member] Lock "38748b45-c891-4ffb-8326-5ca0b15579f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.881s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:15:10 user nova-compute[72504]: DEBUG nova.compute.manager [req-c7946797-bbe8-4802-85d3-e0e08997e5d3 req-d7a54199-b209-4619-878f-6d3c0d2a3d78 service nova] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Received event network-vif-plugged-d6cc07c7-ec98-4467-b715-87899cbbe7a1 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:15:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c7946797-bbe8-4802-85d3-e0e08997e5d3 req-d7a54199-b209-4619-878f-6d3c0d2a3d78 service nova] Acquiring lock "38748b45-c891-4ffb-8326-5ca0b15579f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:15:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c7946797-bbe8-4802-85d3-e0e08997e5d3 req-d7a54199-b209-4619-878f-6d3c0d2a3d78 service nova] Lock "38748b45-c891-4ffb-8326-5ca0b15579f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:15:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c7946797-bbe8-4802-85d3-e0e08997e5d3 req-d7a54199-b209-4619-878f-6d3c0d2a3d78 service nova] Lock "38748b45-c891-4ffb-8326-5ca0b15579f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:15:10 user nova-compute[72504]: DEBUG nova.compute.manager [req-c7946797-bbe8-4802-85d3-e0e08997e5d3 req-d7a54199-b209-4619-878f-6d3c0d2a3d78 service nova] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] No waiting events found dispatching network-vif-plugged-d6cc07c7-ec98-4467-b715-87899cbbe7a1 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:15:10 user nova-compute[72504]: WARNING nova.compute.manager [req-c7946797-bbe8-4802-85d3-e0e08997e5d3 req-d7a54199-b209-4619-878f-6d3c0d2a3d78 service nova] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Received unexpected event network-vif-plugged-d6cc07c7-ec98-4467-b715-87899cbbe7a1 for instance with vm_state deleted and task_state None.
Aug 01 20:15:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:15:23 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690920908.690064, 38748b45-c891-4ffb-8326-5ca0b15579f3 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:15:23 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] VM Stopped (Lifecycle Event)
Aug 01 20:15:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-121483dc-8553-414f-9110-a1bc829d234b None None] [instance: 38748b45-c891-4ffb-8326-5ca0b15579f3] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:15:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:15:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:15:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:15:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:15:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:25 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:15:25 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Cleaning up deleted instances {{(pid=72504) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 20:15:25 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] There are 0 instances to clean {{(pid=72504) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 20:15:27 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:15:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:15:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:15:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:15:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:15:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:31 user nova-compute[72504]: DEBUG nova.objects.instance [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'flavor' on Instance uuid a4f9c59c-cf0b-4216-a194-22712725328d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:15:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "refresh_cache-a4f9c59c-cf0b-4216-a194-22712725328d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:15:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquired lock "refresh_cache-a4f9c59c-cf0b-4216-a194-22712725328d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:15:31 user nova-compute[72504]: DEBUG nova.network.neutron [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:15:31 user nova-compute[72504]: DEBUG nova.objects.instance [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'info_cache' on Instance uuid a4f9c59c-cf0b-4216-a194-22712725328d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:15:31 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG nova.network.neutron [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Updating instance_info_cache with network_info: [{"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Releasing lock "refresh_cache-a4f9c59c-cf0b-4216-a194-22712725328d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:15:32 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Instance destroyed successfully.
Aug 01 20:15:32 user nova-compute[72504]: DEBUG nova.objects.instance [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'resources' on Instance uuid a4f9c59c-cf0b-4216-a194-22712725328d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-61706399',display_name='tempest-AttachVolumeTestJSON-server-61706399',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-61706399',id=39,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkLGKKoGI8XVsLxOaZh71hKpWONiOBrT0aje+GastgHoLyKuLQKlYfDXp3OwjC4WlZ28DTo1JlEqCpYnSgt/d2rMN3aO60eaUVx+bzZGYhJZWV5gQhPPIA8s7t5AmK8sA==',key_name='tempest-keypair-1070424172',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:11:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8ef67b412883421f949be025bdc1cf38',ramdisk_id='',reservation_id='r-1eu867rc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1031917511',owner_user_name='tempest-AttachVolumeTestJSON-1031917511-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:13:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90bea00e45b541baa6f98812cce770f8',uuid=a4f9c59c-cf0b-4216-a194-22712725328d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Converting VIF {"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:34:ea,bridge_name='br-int',has_traffic_filtering=True,id=b8f38092-7fe7-4274-8fcb-1e4a2808454e,network=Network(253a3888-9ae8-47b5-8875-9e4b823ac978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8f38092-7f') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_vif [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:34:ea,bridge_name='br-int',has_traffic_filtering=True,id=b8f38092-7fe7-4274-8fcb-1e4a2808454e,network=Network(253a3888-9ae8-47b5-8875-9e4b823ac978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8f38092-7f') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8f38092-7f, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:15:32 user nova-compute[72504]: INFO os_vif [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:34:ea,bridge_name='br-int',has_traffic_filtering=True,id=b8f38092-7fe7-4274-8fcb-1e4a2808454e,network=Network(253a3888-9ae8-47b5-8875-9e4b823ac978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8f38092-7f')
Aug 01 20:15:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuevRMPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:15:32 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e41c87-3ab2-480b-907f-ca883f7ca592]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd20df3-fda6-4680-b2e5-b39c16ecede2]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)
Aug 01 20:15:32 user nova-compute[72504]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 (non-flash)
Aug 01 20:15:32 user nova-compute[72504]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:15:32 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)
Aug 01 20:15:32 user nova-compute[72504]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 (non-flash)
Aug 01 20:15:32 user nova-compute[72504]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:15:32 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3f45c2e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8'): ({'sdb'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Removing single pathed devices sdb {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb0ff75-565b-4008-b8ef-289d31e16847]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9733b57f-c8bc-4cac-b03a-956a9c04cec0]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Flushing IO for device /dev/sdb {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[294d14e8-53ed-4314-9bfd-f2950d53ed47]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d25951-0cc0-41fe-a8e7-d6ef12de743b]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1b90a3-f7a2-4544-8c4f-415518715c15]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9ae351-047e-4e05-a179-cb9e33587874]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8, portal: 172.16.0.220,3260]
Aug 01 20:15:32 user nova-compute[72504]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8, portal: 172.16.0.220,3260] successful.
Aug 01 20:15:32 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc940960-38b1-460e-a578-b5a614a3fdcc]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] <== disconnect_volume: return (271ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Start _get_guest_xml network_info=[{"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuevRMPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'a4f9c59c-cf0b-4216-a194-22712725328d', 'attached_at': '', 'detached_at': '', 'volume_id': '5e8f03f7-e75c-424c-b677-9c24d2ee1ff8', 'serial': '5e8f03f7-e75c-424c-b677-9c24d2ee1ff8'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': '6264930d-9b51-4c78-844a-ec783b873ee1', 'volume_type': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG nova.objects.instance [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'numa_topology' on Instance uuid a4f9c59c-cf0b-4216-a194-22712725328d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:15:32 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:15:32 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:15:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG nova.objects.instance [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'vcpu_model' on Instance uuid a4f9c59c-cf0b-4216-a194-22712725328d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuevRMPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:15:32 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:15:32 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:15:32 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b65f3d1-d360-42c6-ac42-8213884a6073]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:15:32 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e094abd-0927-4219-a124-3b59de8662ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8] added
Aug 01 20:15:32 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cc2ae2-9301-4424-87de-ae8077bcd153]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b520599-e877-495a-a244-80f1781d25cb]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HuevRMPG {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HuevRMPG" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa4f2b3-4291-41b9-8650-df1c50a78236]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HuevRMPG'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f7f5d7-26c1-4e07-b5a2-45cf4cbb64eb]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a684ffaf-4395-4c89-a370-9beec12462ed]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 (non-flash)
Aug 01 20:15:32 user nova-compute[72504]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:15:32 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 (non-flash)
Aug 01 20:15:32 user nova-compute[72504]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:15:32 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5581536-3b28-4757-b721-352f98022825]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8, portal: 172.16.0.220,3260]
Aug 01 20:15:32 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8, portal: 172.16.0.220,3260] successful.
Aug 01 20:15:32 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d1c473-06f4-4489-b526-310f6d3606c2]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:15:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cdee82-297c-4f1e-8e23-0f1be5bac855]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 (non-flash)
Aug 01 20:15:33 user nova-compute[72504]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:15:33 user nova-compute[72504]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)
Aug 01 20:15:33 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:15:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 (non-flash)
Aug 01 20:15:33 user nova-compute[72504]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:15:33 user nova-compute[72504]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)
Aug 01 20:15:33 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:15:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:15:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:15:33 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:15:33 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:15:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a098b9b7-0f1a-4d1e-85b7-e782f974cc5f]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:33 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuevRMPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23932616139306261', 'path': '/dev/sdb'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932616139306261', 'path': '/dev/sdb'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-61706399',display_name='tempest-AttachVolumeTestJSON-server-61706399',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-61706399',id=39,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkLGKKoGI8XVsLxOaZh71hKpWONiOBrT0aje+GastgHoLyKuLQKlYfDXp3OwjC4WlZ28DTo1JlEqCpYnSgt/d2rMN3aO60eaUVx+bzZGYhJZWV5gQhPPIA8s7t5AmK8sA==',key_name='tempest-keypair-1070424172',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:11:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8ef67b412883421f949be025bdc1cf38',ramdisk_id='',reservation_id='r-1eu867rc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1031917511',owner_user_name='tempest-AttachVolumeTestJSON-1031917511-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:13:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90bea00e45b541baa6f98812cce770f8',uuid=a4f9c59c-cf0b-4216-a194-22712725328d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Converting VIF {"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:34:ea,bridge_name='br-int',has_traffic_filtering=True,id=b8f38092-7fe7-4274-8fcb-1e4a2808454e,network=Network(253a3888-9ae8-47b5-8875-9e4b823ac978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8f38092-7f') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG nova.objects.instance [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'pci_devices' on Instance uuid a4f9c59c-cf0b-4216-a194-22712725328d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:15:34 user nova-compute[72504]:   <uuid>a4f9c59c-cf0b-4216-a194-22712725328d</uuid>
Aug 01 20:15:34 user nova-compute[72504]:   <name>instance-00000027</name>
Aug 01 20:15:34 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:15:34 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:15:34 user nova-compute[72504]:   <metadata>
Aug 01 20:15:34 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:15:34 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:15:34 user nova-compute[72504]:       <nova:name>tempest-AttachVolumeTestJSON-server-61706399</nova:name>
Aug 01 20:15:34 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:15:32</nova:creationTime>
Aug 01 20:15:34 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:15:34 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:15:34 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:15:34 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:15:34 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:15:34 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:15:34 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:15:34 user nova-compute[72504]:       <nova:owner>
Aug 01 20:15:34 user nova-compute[72504]:         <nova:user uuid="90bea00e45b541baa6f98812cce770f8">tempest-AttachVolumeTestJSON-1031917511-project-member</nova:user>
Aug 01 20:15:34 user nova-compute[72504]:         <nova:project uuid="8ef67b412883421f949be025bdc1cf38">tempest-AttachVolumeTestJSON-1031917511</nova:project>
Aug 01 20:15:34 user nova-compute[72504]:       </nova:owner>
Aug 01 20:15:34 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 20:15:34 user nova-compute[72504]:       <nova:ports>
Aug 01 20:15:34 user nova-compute[72504]:         <nova:port uuid="b8f38092-7fe7-4274-8fcb-1e4a2808454e">
Aug 01 20:15:34 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 20:15:34 user nova-compute[72504]:         </nova:port>
Aug 01 20:15:34 user nova-compute[72504]:       </nova:ports>
Aug 01 20:15:34 user nova-compute[72504]:     </nova:instance>
Aug 01 20:15:34 user nova-compute[72504]:   </metadata>
Aug 01 20:15:34 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:15:34 user nova-compute[72504]:     <system>
Aug 01 20:15:34 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:15:34 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:15:34 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:15:34 user nova-compute[72504]:       <entry name="serial">a4f9c59c-cf0b-4216-a194-22712725328d</entry>
Aug 01 20:15:34 user nova-compute[72504]:       <entry name="uuid">a4f9c59c-cf0b-4216-a194-22712725328d</entry>
Aug 01 20:15:34 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:15:34 user nova-compute[72504]:     </system>
Aug 01 20:15:34 user nova-compute[72504]:   </sysinfo>
Aug 01 20:15:34 user nova-compute[72504]:   <os>
Aug 01 20:15:34 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:15:34 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:15:34 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:15:34 user nova-compute[72504]:   </os>
Aug 01 20:15:34 user nova-compute[72504]:   <features>
Aug 01 20:15:34 user nova-compute[72504]:     <acpi/>
Aug 01 20:15:34 user nova-compute[72504]:     <apic/>
Aug 01 20:15:34 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:15:34 user nova-compute[72504]:   </features>
Aug 01 20:15:34 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:15:34 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:15:34 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:15:34 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:15:34 user nova-compute[72504]:   </clock>
Aug 01 20:15:34 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:15:34 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:15:34 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:15:34 user nova-compute[72504]:   </cpu>
Aug 01 20:15:34 user nova-compute[72504]:   <devices>
Aug 01 20:15:34 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 20:15:34 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 20:15:34 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk"/>
Aug 01 20:15:34 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:15:34 user nova-compute[72504]:     </disk>
Aug 01 20:15:34 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 20:15:34 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:15:34 user nova-compute[72504]:       <source dev="/dev/sdb"/>
Aug 01 20:15:34 user nova-compute[72504]:       <target dev="vdb" bus="virtio"/>
Aug 01 20:15:34 user nova-compute[72504]:       <serial>5e8f03f7-e75c-424c-b677-9c24d2ee1ff8</serial>
Aug 01 20:15:34 user nova-compute[72504]:     </disk>
Aug 01 20:15:34 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:15:34 user nova-compute[72504]:       <mac address="fa:16:3e:de:34:ea"/>
Aug 01 20:15:34 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:15:34 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:15:34 user nova-compute[72504]:       <target dev="tapb8f38092-7f"/>
Aug 01 20:15:34 user nova-compute[72504]:     </interface>
Aug 01 20:15:34 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:15:34 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/console.log" append="off"/>
Aug 01 20:15:34 user nova-compute[72504]:     </serial>
Aug 01 20:15:34 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:15:34 user nova-compute[72504]:     <video>
Aug 01 20:15:34 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:15:34 user nova-compute[72504]:     </video>
Aug 01 20:15:34 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:15:34 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:15:34 user nova-compute[72504]:     </rng>
Aug 01 20:15:34 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:15:34 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:15:34 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:15:34 user nova-compute[72504]:     </memballoon>
Aug 01 20:15:34 user nova-compute[72504]:   </devices>
Aug 01 20:15:34 user nova-compute[72504]: </domain>
Aug 01 20:15:34 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG nova.objects.instance [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'trusted_certs' on Instance uuid a4f9c59c-cf0b-4216-a194-22712725328d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.130s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Cannot resize image /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG nova.objects.instance [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'migration_context' on Instance uuid a4f9c59c-cf0b-4216-a194-22712725328d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-61706399',display_name='tempest-AttachVolumeTestJSON-server-61706399',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-61706399',id=39,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkLGKKoGI8XVsLxOaZh71hKpWONiOBrT0aje+GastgHoLyKuLQKlYfDXp3OwjC4WlZ28DTo1JlEqCpYnSgt/d2rMN3aO60eaUVx+bzZGYhJZWV5gQhPPIA8s7t5AmK8sA==',key_name='tempest-keypair-1070424172',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:11:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='8ef67b412883421f949be025bdc1cf38',ramdisk_id='',reservation_id='r-1eu867rc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1031917511',owner_user_name='tempest-AttachVolumeTestJSON-1031917511-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:13:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90bea00e45b541baa6f98812cce770f8',uuid=a4f9c59c-cf0b-4216-a194-22712725328d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Converting VIF {"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:34:ea,bridge_name='br-int',has_traffic_filtering=True,id=b8f38092-7fe7-4274-8fcb-1e4a2808454e,network=Network(253a3888-9ae8-47b5-8875-9e4b823ac978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8f38092-7f') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG os_vif [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:34:ea,bridge_name='br-int',has_traffic_filtering=True,id=b8f38092-7fe7-4274-8fcb-1e4a2808454e,network=Network(253a3888-9ae8-47b5-8875-9e4b823ac978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8f38092-7f') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8f38092-7f, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb8f38092-7f, col_values=(('external_ids', {'iface-id': 'b8f38092-7fe7-4274-8fcb-1e4a2808454e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:34:ea', 'vm-uuid': 'a4f9c59c-cf0b-4216-a194-22712725328d'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:15:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:34 user nova-compute[72504]: INFO os_vif [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:34:ea,bridge_name='br-int',has_traffic_filtering=True,id=b8f38092-7fe7-4274-8fcb-1e4a2808454e,network=Network(253a3888-9ae8-47b5-8875-9e4b823ac978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8f38092-7f')
Aug 01 20:15:34 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:15:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:36 user nova-compute[72504]: DEBUG nova.compute.manager [req-c78445e8-8d8a-4f0c-9e70-487f667c224c req-ef30205c-f2a1-431e-a87e-d92c68c334ae service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Received event network-vif-plugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:15:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c78445e8-8d8a-4f0c-9e70-487f667c224c req-ef30205c-f2a1-431e-a87e-d92c68c334ae service nova] Acquiring lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:15:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c78445e8-8d8a-4f0c-9e70-487f667c224c req-ef30205c-f2a1-431e-a87e-d92c68c334ae service nova] Lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:15:36 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c78445e8-8d8a-4f0c-9e70-487f667c224c req-ef30205c-f2a1-431e-a87e-d92c68c334ae service nova] Lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:15:36 user nova-compute[72504]: DEBUG nova.compute.manager [req-c78445e8-8d8a-4f0c-9e70-487f667c224c req-ef30205c-f2a1-431e-a87e-d92c68c334ae service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] No waiting events found dispatching network-vif-plugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:15:36 user nova-compute[72504]: WARNING nova.compute.manager [req-c78445e8-8d8a-4f0c-9e70-487f667c224c req-ef30205c-f2a1-431e-a87e-d92c68c334ae service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Received unexpected event network-vif-plugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e for instance with vm_state stopped and task_state powering-on.
Aug 01 20:15:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:37 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:15:37 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:15:37 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 20:15:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-9ac6b63a-2c5a-4f72-9dc3-8f884253e180" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:15:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-9ac6b63a-2c5a-4f72-9dc3-8f884253e180" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:15:37 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:15:37 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lazy-loading 'info_cache' on Instance uuid 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:15:38 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920938.048748, a4f9c59c-cf0b-4216-a194-22712725328d => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:15:38 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] VM Resumed (Lifecycle Event)
Aug 01 20:15:38 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:15:38 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Instance rebooted successfully.
Aug 01 20:15:38 user nova-compute[72504]: DEBUG nova.compute.manager [None req-3e0b04d6-bab3-44ef-b4de-d6402dd7bfd6 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:15:38 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:15:38 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:15:38 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 01 20:15:38 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920938.0521357, a4f9c59c-cf0b-4216-a194-22712725328d => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:15:38 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] VM Started (Lifecycle Event)
Aug 01 20:15:38 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:15:38 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:15:38 user nova-compute[72504]: DEBUG nova.compute.manager [req-954bc53e-b3cb-41d5-a39e-6644e6eed290 req-df48ce03-75d1-474a-bb74-b2e15ada8622 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Received event network-vif-plugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:15:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-954bc53e-b3cb-41d5-a39e-6644e6eed290 req-df48ce03-75d1-474a-bb74-b2e15ada8622 service nova] Acquiring lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:15:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-954bc53e-b3cb-41d5-a39e-6644e6eed290 req-df48ce03-75d1-474a-bb74-b2e15ada8622 service nova] Lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:15:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-954bc53e-b3cb-41d5-a39e-6644e6eed290 req-df48ce03-75d1-474a-bb74-b2e15ada8622 service nova] Lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:15:38 user nova-compute[72504]: DEBUG nova.compute.manager [req-954bc53e-b3cb-41d5-a39e-6644e6eed290 req-df48ce03-75d1-474a-bb74-b2e15ada8622 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] No waiting events found dispatching network-vif-plugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:15:38 user nova-compute[72504]: WARNING nova.compute.manager [req-954bc53e-b3cb-41d5-a39e-6644e6eed290 req-df48ce03-75d1-474a-bb74-b2e15ada8622 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Received unexpected event network-vif-plugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e for instance with vm_state active and task_state None.
Aug 01 20:15:38 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Updating instance_info_cache with network_info: [{"id": "298ca2cd-b389-42be-bc06-05344f41e0d2", "address": "fa:16:3e:74:2e:28", "network": {"id": "d4bfb5e4-0509-436d-8605-07b850de35b1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1900175842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f084e19e3c674b308d8a566f57bba3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ca2cd-b3", "ovs_interfaceid": "298ca2cd-b389-42be-bc06-05344f41e0d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:15:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-9ac6b63a-2c5a-4f72-9dc3-8f884253e180" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:15:38 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:15:38 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:15:38 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:15:38 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:15:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:15:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:15:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:15:38 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:15:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:15:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:38 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:15:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:39 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:15:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk.rescue --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:39 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:15:39 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:15:39 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8535MB free_disk=25.14715576171875GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:15:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:15:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:15:39 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:15:39 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance a4f9c59c-cf0b-4216-a194-22712725328d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:15:39 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance da025bc7-bf1a-40a1-8b9b-71ef9b28c01f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:15:39 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:15:39 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:15:40 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:15:40 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:15:40 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:15:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:15:40 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:15:40 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:15:42 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:15:42 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:15:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:15:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:15:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:15:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:15:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-b3f33ce5-8981-45f3-83b8-b2aab445b167 req-fc3582dc-3440-4259-9c1c-4bfddab9d3f0 service nova] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Received event network-changed-8d340f05-ed96-4b3e-b0c6-37d191d39d88 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:15:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-b3f33ce5-8981-45f3-83b8-b2aab445b167 req-fc3582dc-3440-4259-9c1c-4bfddab9d3f0 service nova] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Refreshing instance network info cache due to event network-changed-8d340f05-ed96-4b3e-b0c6-37d191d39d88. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:15:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b3f33ce5-8981-45f3-83b8-b2aab445b167 req-fc3582dc-3440-4259-9c1c-4bfddab9d3f0 service nova] Acquiring lock "refresh_cache-da025bc7-bf1a-40a1-8b9b-71ef9b28c01f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:15:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b3f33ce5-8981-45f3-83b8-b2aab445b167 req-fc3582dc-3440-4259-9c1c-4bfddab9d3f0 service nova] Acquired lock "refresh_cache-da025bc7-bf1a-40a1-8b9b-71ef9b28c01f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:15:55 user nova-compute[72504]: DEBUG nova.network.neutron [req-b3f33ce5-8981-45f3-83b8-b2aab445b167 req-fc3582dc-3440-4259-9c1c-4bfddab9d3f0 service nova] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Refreshing network info cache for port 8d340f05-ed96-4b3e-b0c6-37d191d39d88 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:15:56 user nova-compute[72504]: DEBUG nova.network.neutron [req-b3f33ce5-8981-45f3-83b8-b2aab445b167 req-fc3582dc-3440-4259-9c1c-4bfddab9d3f0 service nova] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Updated VIF entry in instance network info cache for port 8d340f05-ed96-4b3e-b0c6-37d191d39d88. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:15:56 user nova-compute[72504]: DEBUG nova.network.neutron [req-b3f33ce5-8981-45f3-83b8-b2aab445b167 req-fc3582dc-3440-4259-9c1c-4bfddab9d3f0 service nova] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Updating instance_info_cache with network_info: [{"id": "8d340f05-ed96-4b3e-b0c6-37d191d39d88", "address": "fa:16:3e:31:94:3b", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d340f05-ed", "ovs_interfaceid": "8d340f05-ed96-4b3e-b0c6-37d191d39d88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:15:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b3f33ce5-8981-45f3-83b8-b2aab445b167 req-fc3582dc-3440-4259-9c1c-4bfddab9d3f0 service nova] Releasing lock "refresh_cache-da025bc7-bf1a-40a1-8b9b-71ef9b28c01f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:15:56 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "da025bc7-bf1a-40a1-8b9b-71ef9b28c01f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "da025bc7-bf1a-40a1-8b9b-71ef9b28c01f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "da025bc7-bf1a-40a1-8b9b-71ef9b28c01f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "da025bc7-bf1a-40a1-8b9b-71ef9b28c01f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "da025bc7-bf1a-40a1-8b9b-71ef9b28c01f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:15:57 user nova-compute[72504]: INFO nova.compute.manager [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Terminating instance
Aug 01 20:15:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-08fdba96-c0a5-456b-ae79-41b7db97766f req-4f062aa3-efe7-41d8-a148-1f0c18a59566 service nova] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Received event network-vif-unplugged-8d340f05-ed96-4b3e-b0c6-37d191d39d88 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-08fdba96-c0a5-456b-ae79-41b7db97766f req-4f062aa3-efe7-41d8-a148-1f0c18a59566 service nova] Acquiring lock "da025bc7-bf1a-40a1-8b9b-71ef9b28c01f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-08fdba96-c0a5-456b-ae79-41b7db97766f req-4f062aa3-efe7-41d8-a148-1f0c18a59566 service nova] Lock "da025bc7-bf1a-40a1-8b9b-71ef9b28c01f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-08fdba96-c0a5-456b-ae79-41b7db97766f req-4f062aa3-efe7-41d8-a148-1f0c18a59566 service nova] Lock "da025bc7-bf1a-40a1-8b9b-71ef9b28c01f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-08fdba96-c0a5-456b-ae79-41b7db97766f req-4f062aa3-efe7-41d8-a148-1f0c18a59566 service nova] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] No waiting events found dispatching network-vif-unplugged-8d340f05-ed96-4b3e-b0c6-37d191d39d88 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-08fdba96-c0a5-456b-ae79-41b7db97766f req-4f062aa3-efe7-41d8-a148-1f0c18a59566 service nova] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Received event network-vif-unplugged-8d340f05-ed96-4b3e-b0c6-37d191d39d88 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-08fdba96-c0a5-456b-ae79-41b7db97766f req-4f062aa3-efe7-41d8-a148-1f0c18a59566 service nova] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Received event network-vif-plugged-8d340f05-ed96-4b3e-b0c6-37d191d39d88 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-08fdba96-c0a5-456b-ae79-41b7db97766f req-4f062aa3-efe7-41d8-a148-1f0c18a59566 service nova] Acquiring lock "da025bc7-bf1a-40a1-8b9b-71ef9b28c01f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-08fdba96-c0a5-456b-ae79-41b7db97766f req-4f062aa3-efe7-41d8-a148-1f0c18a59566 service nova] Lock "da025bc7-bf1a-40a1-8b9b-71ef9b28c01f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-08fdba96-c0a5-456b-ae79-41b7db97766f req-4f062aa3-efe7-41d8-a148-1f0c18a59566 service nova] Lock "da025bc7-bf1a-40a1-8b9b-71ef9b28c01f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-08fdba96-c0a5-456b-ae79-41b7db97766f req-4f062aa3-efe7-41d8-a148-1f0c18a59566 service nova] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] No waiting events found dispatching network-vif-plugged-8d340f05-ed96-4b3e-b0c6-37d191d39d88 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:15:57 user nova-compute[72504]: WARNING nova.compute.manager [req-08fdba96-c0a5-456b-ae79-41b7db97766f req-4f062aa3-efe7-41d8-a148-1f0c18a59566 service nova] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Received unexpected event network-vif-plugged-8d340f05-ed96-4b3e-b0c6-37d191d39d88 for instance with vm_state active and task_state deleting.
Aug 01 20:15:57 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Instance destroyed successfully.
Aug 01 20:15:57 user nova-compute[72504]: DEBUG nova.objects.instance [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lazy-loading 'resources' on Instance uuid da025bc7-bf1a-40a1-8b9b-71ef9b28c01f {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:14:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1248209100',display_name='tempest-TestVolumeBootPattern-server-1248209100',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1248209100',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrKan85Goqo8Jv0VkDYyshQTMQ59f3rUyYronrtEBxVKZjCUMR9BmiZNw9TY8Sa/UvzfiwIaZSAr04+rYB06rxcAkBTQWOBWsdwofE2ksnZ+I8hLlgBMpWvgtrRSAHuwA==',key_name='tempest-TestVolumeBootPattern-1138255315',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:14:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb59fbc2bf9749f3af7d56435cb37066',ramdisk_id='',reservation_id='r-ib463juz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-685885098',owner_user_name='tempest-TestVolumeBootPattern-685885098-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:14:17Z,user_data=None,user_id='f06381c8a6214ddea7f1b36b623ed4d5',uuid=da025bc7-bf1a-40a1-8b9b-71ef9b28c01f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d340f05-ed96-4b3e-b0c6-37d191d39d88", "address": "fa:16:3e:31:94:3b", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d340f05-ed", "ovs_interfaceid": "8d340f05-ed96-4b3e-b0c6-37d191d39d88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converting VIF {"id": "8d340f05-ed96-4b3e-b0c6-37d191d39d88", "address": "fa:16:3e:31:94:3b", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d340f05-ed", "ovs_interfaceid": "8d340f05-ed96-4b3e-b0c6-37d191d39d88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:94:3b,bridge_name='br-int',has_traffic_filtering=True,id=8d340f05-ed96-4b3e-b0c6-37d191d39d88,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d340f05-ed') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG os_vif [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:94:3b,bridge_name='br-int',has_traffic_filtering=True,id=8d340f05-ed96-4b3e-b0c6-37d191d39d88,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d340f05-ed') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d340f05-ed, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:57 user nova-compute[72504]: INFO os_vif [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:94:3b,bridge_name='br-int',has_traffic_filtering=True,id=8d340f05-ed96-4b3e-b0c6-37d191d39d88,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d340f05-ed')
Aug 01 20:15:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:15:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkHGEOcj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:15:57 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:15:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a95bce-9fbc-4870-bb97-d0206cc20623]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d56b502-2785-4fdb-8959-7b01c1e3fc73]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 (non-flash)
Aug 01 20:15:58 user nova-compute[72504]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:15:58 user nova-compute[72504]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)
Aug 01 20:15:58 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 (non-flash)
Aug 01 20:15:58 user nova-compute[72504]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:15:58 user nova-compute[72504]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)
Aug 01 20:15:58 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3f437cc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828'): ({'sdd'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Removing single pathed devices sdd {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c31507c-fbc1-46da-9c34-546b11d2d38f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1807bb96-5fc7-432a-94ba-bc0655d5483f]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Flushing IO for device /dev/sdd {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb19fe0f-9452-40af-ac1d-b8ac28365a22]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[48146037-4747-4533-ad7b-7c83c041b2df]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] SCSI volumes sdd have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_d33a9d7', '/dev/disk/by-id/scsi-1SCST_BIOd33a9d7-6222f901d039d919', '/dev/disk/by-id/scsi-23632323266393031') {{(pid=83379) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8feea8b3-3c18-45d3-9886-d23802622c5d]: (4, None) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f40f25-0dd4-44e8-b137-eab69e3a88c3]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cd57b5-c1ca-4b0e-97a2-5e737e150754]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828, portal: 172.16.0.220,3260]
Aug 01 20:15:58 user nova-compute[72504]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828, portal: 172.16.0.220,3260] successful.
Aug 01 20:15:58 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fbf891-93fb-42af-a9bc-8e046038657b]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] <== disconnect_volume: return (284ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:15:58 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Deleting instance files /opt/stack/data/nova/instances/da025bc7-bf1a-40a1-8b9b-71ef9b28c01f_del
Aug 01 20:15:58 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Deletion of /opt/stack/data/nova/instances/da025bc7-bf1a-40a1-8b9b-71ef9b28c01f_del complete
Aug 01 20:15:58 user nova-compute[72504]: INFO nova.compute.manager [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:15:58 user nova-compute[72504]: INFO nova.compute.manager [None req-4418fec4-3a84-4cfd-a35a-90821abdb700 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Unrescuing
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4418fec4-3a84-4cfd-a35a-90821abdb700 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Acquiring lock "refresh_cache-9ac6b63a-2c5a-4f72-9dc3-8f884253e180" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4418fec4-3a84-4cfd-a35a-90821abdb700 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Acquired lock "refresh_cache-9ac6b63a-2c5a-4f72-9dc3-8f884253e180" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG nova.network.neutron [None req-4418fec4-3a84-4cfd-a35a-90821abdb700 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:15:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:59 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:15:59 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Took 0.83 seconds to deallocate network for instance.
Aug 01 20:15:59 user nova-compute[72504]: DEBUG nova.network.neutron [None req-4418fec4-3a84-4cfd-a35a-90821abdb700 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Updating instance_info_cache with network_info: [{"id": "298ca2cd-b389-42be-bc06-05344f41e0d2", "address": "fa:16:3e:74:2e:28", "network": {"id": "d4bfb5e4-0509-436d-8605-07b850de35b1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1900175842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f084e19e3c674b308d8a566f57bba3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ca2cd-b3", "ovs_interfaceid": "298ca2cd-b389-42be-bc06-05344f41e0d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:15:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4418fec4-3a84-4cfd-a35a-90821abdb700 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Releasing lock "refresh_cache-9ac6b63a-2c5a-4f72-9dc3-8f884253e180" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:15:59 user nova-compute[72504]: DEBUG nova.objects.instance [None req-4418fec4-3a84-4cfd-a35a-90821abdb700 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lazy-loading 'flavor' on Instance uuid 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:15:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:15:59 user nova-compute[72504]: DEBUG nova.compute.manager [req-ac31e5ef-22e0-496c-86ec-b19ba43226d2 req-2cb4312e-e3e8-43b7-9855-7eb8325182c0 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received event network-vif-unplugged-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:15:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ac31e5ef-22e0-496c-86ec-b19ba43226d2 req-2cb4312e-e3e8-43b7-9855-7eb8325182c0 service nova] Acquiring lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:15:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ac31e5ef-22e0-496c-86ec-b19ba43226d2 req-2cb4312e-e3e8-43b7-9855-7eb8325182c0 service nova] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:15:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ac31e5ef-22e0-496c-86ec-b19ba43226d2 req-2cb4312e-e3e8-43b7-9855-7eb8325182c0 service nova] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:15:59 user nova-compute[72504]: DEBUG nova.compute.manager [req-ac31e5ef-22e0-496c-86ec-b19ba43226d2 req-2cb4312e-e3e8-43b7-9855-7eb8325182c0 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] No waiting events found dispatching network-vif-unplugged-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:15:59 user nova-compute[72504]: WARNING nova.compute.manager [req-ac31e5ef-22e0-496c-86ec-b19ba43226d2 req-2cb4312e-e3e8-43b7-9855-7eb8325182c0 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received unexpected event network-vif-unplugged-298ca2cd-b389-42be-bc06-05344f41e0d2 for instance with vm_state rescued and task_state unrescuing.
Aug 01 20:15:59 user nova-compute[72504]: DEBUG nova.compute.manager [req-21b1cf43-5719-49c7-81f7-9d83b2eb0af7 req-fa9fdbca-79bb-4abf-9f63-51872da74db9 service nova] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Received event network-vif-deleted-8d340f05-ed96-4b3e-b0c6-37d191d39d88 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:15:59 user nova-compute[72504]: INFO nova.compute.manager [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Took 0.81 seconds to detach 1 volumes for instance.
Aug 01 20:16:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:16:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:16:00 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Instance destroyed successfully.
Aug 01 20:16:00 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:16:00 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:16:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.204s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:16:00 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Deleted allocations for instance da025bc7-bf1a-40a1-8b9b-71ef9b28c01f
Aug 01 20:16:00 user nova-compute[72504]: DEBUG nova.compute.manager [req-1250f3ea-bb8d-48ba-a450-d82ec977d5e5 req-2eab6e05-cc89-453a-83f2-75d710e8ca05 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received event network-changed-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:16:00 user nova-compute[72504]: DEBUG nova.compute.manager [req-1250f3ea-bb8d-48ba-a450-d82ec977d5e5 req-2eab6e05-cc89-453a-83f2-75d710e8ca05 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Refreshing instance network info cache due to event network-changed-298ca2cd-b389-42be-bc06-05344f41e0d2. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:16:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1250f3ea-bb8d-48ba-a450-d82ec977d5e5 req-2eab6e05-cc89-453a-83f2-75d710e8ca05 service nova] Acquiring lock "refresh_cache-9ac6b63a-2c5a-4f72-9dc3-8f884253e180" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:16:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1250f3ea-bb8d-48ba-a450-d82ec977d5e5 req-2eab6e05-cc89-453a-83f2-75d710e8ca05 service nova] Acquired lock "refresh_cache-9ac6b63a-2c5a-4f72-9dc3-8f884253e180" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:16:00 user nova-compute[72504]: DEBUG nova.network.neutron [req-1250f3ea-bb8d-48ba-a450-d82ec977d5e5 req-2eab6e05-cc89-453a-83f2-75d710e8ca05 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Refreshing network info cache for port 298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:16:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6bd6e75e-cd57-4712-abd9-8ccf5c39876b tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "da025bc7-bf1a-40a1-8b9b-71ef9b28c01f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.236s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:16:00 user nova-compute[72504]: DEBUG nova.network.neutron [req-1250f3ea-bb8d-48ba-a450-d82ec977d5e5 req-2eab6e05-cc89-453a-83f2-75d710e8ca05 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Updated VIF entry in instance network info cache for port 298ca2cd-b389-42be-bc06-05344f41e0d2. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:16:00 user nova-compute[72504]: DEBUG nova.network.neutron [req-1250f3ea-bb8d-48ba-a450-d82ec977d5e5 req-2eab6e05-cc89-453a-83f2-75d710e8ca05 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Updating instance_info_cache with network_info: [{"id": "298ca2cd-b389-42be-bc06-05344f41e0d2", "address": "fa:16:3e:74:2e:28", "network": {"id": "d4bfb5e4-0509-436d-8605-07b850de35b1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1900175842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f084e19e3c674b308d8a566f57bba3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ca2cd-b3", "ovs_interfaceid": "298ca2cd-b389-42be-bc06-05344f41e0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:16:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1250f3ea-bb8d-48ba-a450-d82ec977d5e5 req-2eab6e05-cc89-453a-83f2-75d710e8ca05 service nova] Releasing lock "refresh_cache-9ac6b63a-2c5a-4f72-9dc3-8f884253e180" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:16:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:01 user nova-compute[72504]: DEBUG nova.compute.manager [req-71d6ca6c-6790-4f20-b9db-1f301192ba8b req-c460407c-cf60-4384-9916-a6e2819e937f service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received event network-vif-plugged-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:16:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-71d6ca6c-6790-4f20-b9db-1f301192ba8b req-c460407c-cf60-4384-9916-a6e2819e937f service nova] Acquiring lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:16:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-71d6ca6c-6790-4f20-b9db-1f301192ba8b req-c460407c-cf60-4384-9916-a6e2819e937f service nova] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:16:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-71d6ca6c-6790-4f20-b9db-1f301192ba8b req-c460407c-cf60-4384-9916-a6e2819e937f service nova] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:16:01 user nova-compute[72504]: DEBUG nova.compute.manager [req-71d6ca6c-6790-4f20-b9db-1f301192ba8b req-c460407c-cf60-4384-9916-a6e2819e937f service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] No waiting events found dispatching network-vif-plugged-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:16:01 user nova-compute[72504]: WARNING nova.compute.manager [req-71d6ca6c-6790-4f20-b9db-1f301192ba8b req-c460407c-cf60-4384-9916-a6e2819e937f service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received unexpected event network-vif-plugged-298ca2cd-b389-42be-bc06-05344f41e0d2 for instance with vm_state rescued and task_state unrescuing.
Aug 01 20:16:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:02 user nova-compute[72504]: DEBUG nova.compute.manager [req-1175d61e-f416-4fb4-865b-cc11e5170b69 req-e9a42447-db75-4663-92bb-62cb61500570 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received event network-changed-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:16:02 user nova-compute[72504]: DEBUG nova.compute.manager [req-1175d61e-f416-4fb4-865b-cc11e5170b69 req-e9a42447-db75-4663-92bb-62cb61500570 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Refreshing instance network info cache due to event network-changed-298ca2cd-b389-42be-bc06-05344f41e0d2. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:16:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1175d61e-f416-4fb4-865b-cc11e5170b69 req-e9a42447-db75-4663-92bb-62cb61500570 service nova] Acquiring lock "refresh_cache-9ac6b63a-2c5a-4f72-9dc3-8f884253e180" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:16:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1175d61e-f416-4fb4-865b-cc11e5170b69 req-e9a42447-db75-4663-92bb-62cb61500570 service nova] Acquired lock "refresh_cache-9ac6b63a-2c5a-4f72-9dc3-8f884253e180" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:16:02 user nova-compute[72504]: DEBUG nova.network.neutron [req-1175d61e-f416-4fb4-865b-cc11e5170b69 req-e9a42447-db75-4663-92bb-62cb61500570 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Refreshing network info cache for port 298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:16:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:03 user nova-compute[72504]: DEBUG nova.network.neutron [req-1175d61e-f416-4fb4-865b-cc11e5170b69 req-e9a42447-db75-4663-92bb-62cb61500570 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Updated VIF entry in instance network info cache for port 298ca2cd-b389-42be-bc06-05344f41e0d2. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:16:03 user nova-compute[72504]: DEBUG nova.network.neutron [req-1175d61e-f416-4fb4-865b-cc11e5170b69 req-e9a42447-db75-4663-92bb-62cb61500570 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Updating instance_info_cache with network_info: [{"id": "298ca2cd-b389-42be-bc06-05344f41e0d2", "address": "fa:16:3e:74:2e:28", "network": {"id": "d4bfb5e4-0509-436d-8605-07b850de35b1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1900175842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f084e19e3c674b308d8a566f57bba3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ca2cd-b3", "ovs_interfaceid": "298ca2cd-b389-42be-bc06-05344f41e0d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:16:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1175d61e-f416-4fb4-865b-cc11e5170b69 req-e9a42447-db75-4663-92bb-62cb61500570 service nova] Releasing lock "refresh_cache-9ac6b63a-2c5a-4f72-9dc3-8f884253e180" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:16:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-3b875b99-ab79-422b-8d9e-9376a170bb55 req-e9801468-da1d-4584-937b-bc9c09f73bd6 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received event network-vif-plugged-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:16:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3b875b99-ab79-422b-8d9e-9376a170bb55 req-e9801468-da1d-4584-937b-bc9c09f73bd6 service nova] Acquiring lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:16:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3b875b99-ab79-422b-8d9e-9376a170bb55 req-e9801468-da1d-4584-937b-bc9c09f73bd6 service nova] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:16:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3b875b99-ab79-422b-8d9e-9376a170bb55 req-e9801468-da1d-4584-937b-bc9c09f73bd6 service nova] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:16:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-3b875b99-ab79-422b-8d9e-9376a170bb55 req-e9801468-da1d-4584-937b-bc9c09f73bd6 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] No waiting events found dispatching network-vif-plugged-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:16:03 user nova-compute[72504]: WARNING nova.compute.manager [req-3b875b99-ab79-422b-8d9e-9376a170bb55 req-e9801468-da1d-4584-937b-bc9c09f73bd6 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received unexpected event network-vif-plugged-298ca2cd-b389-42be-bc06-05344f41e0d2 for instance with vm_state rescued and task_state unrescuing.
Aug 01 20:16:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-3b875b99-ab79-422b-8d9e-9376a170bb55 req-e9801468-da1d-4584-937b-bc9c09f73bd6 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received event network-vif-plugged-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:16:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3b875b99-ab79-422b-8d9e-9376a170bb55 req-e9801468-da1d-4584-937b-bc9c09f73bd6 service nova] Acquiring lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:16:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3b875b99-ab79-422b-8d9e-9376a170bb55 req-e9801468-da1d-4584-937b-bc9c09f73bd6 service nova] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:16:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3b875b99-ab79-422b-8d9e-9376a170bb55 req-e9801468-da1d-4584-937b-bc9c09f73bd6 service nova] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:16:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-3b875b99-ab79-422b-8d9e-9376a170bb55 req-e9801468-da1d-4584-937b-bc9c09f73bd6 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] No waiting events found dispatching network-vif-plugged-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:16:03 user nova-compute[72504]: WARNING nova.compute.manager [req-3b875b99-ab79-422b-8d9e-9376a170bb55 req-e9801468-da1d-4584-937b-bc9c09f73bd6 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received unexpected event network-vif-plugged-298ca2cd-b389-42be-bc06-05344f41e0d2 for instance with vm_state rescued and task_state unrescuing.
Aug 01 20:16:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Removed pending event for 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 due to event {{(pid=72504) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 20:16:04 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920964.0705054, 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:16:04 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] VM Resumed (Lifecycle Event)
Aug 01 20:16:04 user nova-compute[72504]: DEBUG nova.compute.manager [None req-4418fec4-3a84-4cfd-a35a-90821abdb700 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:16:04 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:16:04 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:16:04 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 20:16:04 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690920964.0747871, 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:16:04 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] VM Started (Lifecycle Event)
Aug 01 20:16:04 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:16:04 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:16:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:08 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:16:08 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72504) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 20:16:12 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690920957.9549687, da025bc7-bf1a-40a1-8b9b-71ef9b28c01f => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:16:12 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] VM Stopped (Lifecycle Event)
Aug 01 20:16:12 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e76f39bb-7a95-421b-8396-6aaa6cc9dcf2 None None] [instance: da025bc7-bf1a-40a1-8b9b-71ef9b28c01f] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:16:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:27 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:16:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Acquiring lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:16:32 user nova-compute[72504]: INFO nova.compute.manager [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Detaching volume 867e1952-6345-47a2-b171-67612cd6fbe6
Aug 01 20:16:32 user nova-compute[72504]: INFO nova.virt.block_device [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Attempting to driver detach volume 867e1952-6345-47a2-b171-67612cd6fbe6 from mountpoint /dev/vdb
Aug 01 20:16:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Attempting to detach device vdb from instance 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:16:32 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:16:32 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 20:16:32 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:16:32 user nova-compute[72504]:   <serial>867e1952-6345-47a2-b171-67612cd6fbe6</serial>
Aug 01 20:16:32 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:16:32 user nova-compute[72504]: </disk>
Aug 01 20:16:32 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:16:32 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Successfully detached device vdb from instance 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 from the persistent domain config.
Aug 01 20:16:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:16:32 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:16:32 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 20:16:32 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:16:32 user nova-compute[72504]:   <serial>867e1952-6345-47a2-b171-67612cd6fbe6</serial>
Aug 01 20:16:32 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:16:32 user nova-compute[72504]: </disk>
Aug 01 20:16:32 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690920992.7259784, 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 20:16:32 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Successfully detached device vdb from instance 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 from the live domain config.
Aug 01 20:16:32 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BjEscyof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:16:32 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:16:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e23df5-4434-461e-9d54-9d0076c54d9a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d97ef5-fcf4-470e-94f3-7e16f45ad43a]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 (non-flash)
Aug 01 20:16:32 user nova-compute[72504]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)
Aug 01 20:16:32 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 (non-flash)
Aug 01 20:16:32 user nova-compute[72504]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)
Aug 01 20:16:32 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff40c3c8af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6'): ({'sdc'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Removing single pathed devices sdc {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e079894-9ee6-48bb-a713-173b3f9d03bb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6ecf68-4720-4353-b78e-6b87251cdb11]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Flushing IO for device /dev/sdc {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7da6490-99cf-44bd-881a-79e27d33d82e]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e50bc98-4aeb-4202-af06-65bc9efe1567]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7b8587-ea1c-4e49-b2b3-2183668919c2]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61c1c0e-ee3f-4fbc-9034-5ef913ab94e7]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6, portal: 172.16.0.220,3260]
Aug 01 20:16:32 user nova-compute[72504]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6, portal: 172.16.0.220,3260] successful.
Aug 01 20:16:32 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:16:32 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:33 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:867e1952-6345-47a2-b171-67612cd6fbe6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:16:33 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc28906-30a1-4681-a9d9-e0c5108d65c9]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:16:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:16:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:16:33 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] <== disconnect_volume: return (269ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:16:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:16:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:33 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:16:33 user nova-compute[72504]: DEBUG nova.objects.instance [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lazy-loading 'flavor' on Instance uuid 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:16:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-33be2d11-a545-4ce4-9afc-6802d3de1684 tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.739s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:16:34 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:16:35 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:16:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:38 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:16:38 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:16:38 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:16:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:16:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:16:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:16:38 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:16:38 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:16:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:16:39 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:16:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:16:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:39 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:16:39 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:16:39 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:16:39 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8575MB free_disk=25.14531707763672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:16:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:16:39 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:16:40 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:16:40 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance a4f9c59c-cf0b-4216-a194-22712725328d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:16:40 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:16:40 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:16:40 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Refreshing inventories for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 20:16:40 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Updating ProviderTree inventory for provider b951a798-e88c-472c-8347-2c5f6a05d47c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 20:16:40 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Updating inventory in ProviderTree for provider b951a798-e88c-472c-8347-2c5f6a05d47c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 20:16:40 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Refreshing aggregate associations for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c, aggregates: None {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 20:16:40 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Refreshing trait associations for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c, traits: HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 20:16:40 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:16:40 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:16:40 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:16:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.532s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:16:41 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:16:41 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:16:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-a4f9c59c-cf0b-4216-a194-22712725328d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:16:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-a4f9c59c-cf0b-4216-a194-22712725328d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:16:41 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:16:42 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Updating instance_info_cache with network_info: [{"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:16:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-a4f9c59c-cf0b-4216-a194-22712725328d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:16:42 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:16:42 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:16:42 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:16:42 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 20:16:42 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid a4f9c59c-cf0b-4216-a194-22712725328d {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 20:16:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:16:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:16:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "a4f9c59c-cf0b-4216-a194-22712725328d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:16:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "a4f9c59c-cf0b-4216-a194-22712725328d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:16:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "a4f9c59c-cf0b-4216-a194-22712725328d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:16:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:16:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:43 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:16:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "95c7da6a-c9a5-4441-9819-1219f7d6793f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:16:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "95c7da6a-c9a5-4441-9819-1219f7d6793f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:16:49 user nova-compute[72504]: DEBUG nova.compute.manager [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 20:16:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:16:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:16:49 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:16:49 user nova-compute[72504]: INFO nova.compute.claims [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Claim successful on node user
Aug 01 20:16:49 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:16:49 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:16:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:16:49 user nova-compute[72504]: DEBUG nova.compute.manager [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 20:16:49 user nova-compute[72504]: DEBUG nova.compute.manager [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 20:16:49 user nova-compute[72504]: DEBUG nova.network.neutron [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 20:16:49 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 20:16:49 user nova-compute[72504]: DEBUG nova.compute.manager [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 20:16:49 user nova-compute[72504]: INFO nova.virt.block_device [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Booting with volume 500a89fd-74ba-4703-83b0-986e7cb06828 at /dev/vda
Aug 01 20:16:49 user nova-compute[72504]: DEBUG nova.policy [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f06381c8a6214ddea7f1b36b623ed4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb59fbc2bf9749f3af7d56435cb37066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 20:16:49 user nova-compute[72504]: DEBUG os_brick.utils [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:16:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:16:50 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc398156-863f-44bd-9527-8af6e2fbe456]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:16:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:16:50 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c080abb2-2acd-4f5f-a931-e3e36f9e149c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:16:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:16:50 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7474c74c-29ac-4ba4-816f-1e6377439635]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:16:50 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[499bec83-8723-44ef-9861-0cbd2155d794]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:16:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:16:50 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:16:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:16:50 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:16:50 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[59136215-839c-4e28-a2b8-c620891160dc]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:16:50 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:16:50 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:16:50 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:16:50 user nova-compute[72504]: DEBUG os_brick.utils [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:16:50 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Updating existing volume attachment record: 1776f8e4-66ca-4d9f-9abd-ce2bb29f9cd6 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:16:50 user nova-compute[72504]: DEBUG nova.network.neutron [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Successfully created port: e6acb053-8365-45b0-ac25-1f27f42162ff {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 20:16:51 user nova-compute[72504]: DEBUG nova.network.neutron [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Successfully updated port: e6acb053-8365-45b0-ac25-1f27f42162ff {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 20:16:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "refresh_cache-95c7da6a-c9a5-4441-9819-1219f7d6793f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:16:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquired lock "refresh_cache-95c7da6a-c9a5-4441-9819-1219f7d6793f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:16:51 user nova-compute[72504]: DEBUG nova.network.neutron [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:16:51 user nova-compute[72504]: DEBUG nova.compute.manager [req-b3399542-2bf4-42e9-90ba-90ea96c7cabe req-c22b58de-4d7a-4e4f-82b0-6640ff8af224 service nova] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Received event network-changed-e6acb053-8365-45b0-ac25-1f27f42162ff {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:16:51 user nova-compute[72504]: DEBUG nova.compute.manager [req-b3399542-2bf4-42e9-90ba-90ea96c7cabe req-c22b58de-4d7a-4e4f-82b0-6640ff8af224 service nova] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Refreshing instance network info cache due to event network-changed-e6acb053-8365-45b0-ac25-1f27f42162ff. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:16:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b3399542-2bf4-42e9-90ba-90ea96c7cabe req-c22b58de-4d7a-4e4f-82b0-6640ff8af224 service nova] Acquiring lock "refresh_cache-95c7da6a-c9a5-4441-9819-1219f7d6793f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:16:51 user nova-compute[72504]: DEBUG nova.network.neutron [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:16:52 user nova-compute[72504]: DEBUG nova.network.neutron [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Updating instance_info_cache with network_info: [{"id": "e6acb053-8365-45b0-ac25-1f27f42162ff", "address": "fa:16:3e:01:7a:65", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acb053-83", "ovs_interfaceid": "e6acb053-8365-45b0-ac25-1f27f42162ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:16:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Releasing lock "refresh_cache-95c7da6a-c9a5-4441-9819-1219f7d6793f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:16:52 user nova-compute[72504]: DEBUG nova.compute.manager [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Instance network_info: |[{"id": "e6acb053-8365-45b0-ac25-1f27f42162ff", "address": "fa:16:3e:01:7a:65", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acb053-83", "ovs_interfaceid": "e6acb053-8365-45b0-ac25-1f27f42162ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 20:16:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b3399542-2bf4-42e9-90ba-90ea96c7cabe req-c22b58de-4d7a-4e4f-82b0-6640ff8af224 service nova] Acquired lock "refresh_cache-95c7da6a-c9a5-4441-9819-1219f7d6793f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:16:52 user nova-compute[72504]: DEBUG nova.network.neutron [req-b3399542-2bf4-42e9-90ba-90ea96c7cabe req-c22b58de-4d7a-4e4f-82b0-6640ff8af224 service nova] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Refreshing network info cache for port e6acb053-8365-45b0-ac25-1f27f42162ff {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:16:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:52 user nova-compute[72504]: DEBUG nova.network.neutron [req-b3399542-2bf4-42e9-90ba-90ea96c7cabe req-c22b58de-4d7a-4e4f-82b0-6640ff8af224 service nova] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Updated VIF entry in instance network info cache for port e6acb053-8365-45b0-ac25-1f27f42162ff. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:16:52 user nova-compute[72504]: DEBUG nova.network.neutron [req-b3399542-2bf4-42e9-90ba-90ea96c7cabe req-c22b58de-4d7a-4e4f-82b0-6640ff8af224 service nova] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Updating instance_info_cache with network_info: [{"id": "e6acb053-8365-45b0-ac25-1f27f42162ff", "address": "fa:16:3e:01:7a:65", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acb053-83", "ovs_interfaceid": "e6acb053-8365-45b0-ac25-1f27f42162ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:16:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b3399542-2bf4-42e9-90ba-90ea96c7cabe req-c22b58de-4d7a-4e4f-82b0-6640ff8af224 service nova] Releasing lock "refresh_cache-95c7da6a-c9a5-4441-9819-1219f7d6793f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:16:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:16:57 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Creating image(s)
Aug 01 20:16:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Did not create local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Ensure instance console log exists: /opt/stack/data/nova/instances/95c7da6a-c9a5-4441-9819-1219f7d6793f/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Start _get_guest_xml network_info=[{"id": "e6acb053-8365-45b0-ac25-1f27f42162ff", "address": "fa:16:3e:01:7a:65", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acb053-83", "ovs_interfaceid": "e6acb053-8365-45b0-ac25-1f27f42162ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkHGEOcj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '95c7da6a-c9a5-4441-9819-1219f7d6793f', 'attached_at': '', 'detached_at': '', 'volume_id': '500a89fd-74ba-4703-83b0-986e7cb06828', 'serial': '500a89fd-74ba-4703-83b0-986e7cb06828'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': '1776f8e4-66ca-4d9f-9abd-ce2bb29f9cd6', 'volume_type': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:16:57 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:16:57 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:16:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkHGEOcj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:16:57 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:16:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:16:57 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:16:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:16:57 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:16:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5701c8c6-dce0-44cf-96cf-e1cba59bfb9b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:16:57 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ad0638-ffea-4f6f-aaa2-15d30e2ccb2d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828] added
Aug 01 20:16:57 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d140f144-d503-4a12-b434-2ac1202667f4]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76ef23b-7cba-4bc9-8717-b57286d44677]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vkHGEOcj {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vkHGEOcj" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[46951c72-f34e-4851-bbfb-b0ba24e1fc2f]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vkHGEOcj'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1498c68e-370f-499f-a1c9-cb9e00de98f8]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[72eb20eb-7023-428f-98d4-ed67373f5bb6]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)
Aug 01 20:16:57 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)
Aug 01 20:16:57 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:16:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:16:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a144682-b394-4d7b-a948-3e3a5b4aae9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:16:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828, portal: 172.16.0.220,3260]
Aug 01 20:16:58 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828, portal: 172.16.0.220,3260] successful.
Aug 01 20:16:58 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:16:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:16:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc417e4c-ea2f-4ff3-a90a-060e97a3cfdb]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:16:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:16:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:16:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[272dc826-ea64-41c6-a055-d67144b851ad]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:16:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)
Aug 01 20:16:58 user nova-compute[72504]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:16:58 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:16:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)
Aug 01 20:16:58 user nova-compute[72504]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:16:58 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:16:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:16:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:16:58 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:16:58 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:16:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:16:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:16:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c6c2a9-4371-4f67-a779-a89dd441acc4]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:16:58 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:16:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkHGEOcj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:16:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:59 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:16:59 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23632323266393031', 'path': '/dev/sdc'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:16:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632323266393031', 'path': '/dev/sdc'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:16:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:16:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1857669648',display_name='tempest-TestVolumeBootPattern-server-1857669648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1857669648',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrKan85Goqo8Jv0VkDYyshQTMQ59f3rUyYronrtEBxVKZjCUMR9BmiZNw9TY8Sa/UvzfiwIaZSAr04+rYB06rxcAkBTQWOBWsdwofE2ksnZ+I8hLlgBMpWvgtrRSAHuwA==',key_name='tempest-TestVolumeBootPattern-1138255315',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb59fbc2bf9749f3af7d56435cb37066',ramdisk_id='',reservation_id='r-0nrv4j37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-685885098',owner_user_name='tempest-TestVolumeBootPattern-685885098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:16:50Z,user_data=None,user_id='f06381c8a6214ddea7f1b36b623ed4d5',uuid=95c7da6a-c9a5-4441-9819-1219f7d6793f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6acb053-8365-45b0-ac25-1f27f42162ff", "address": "fa:16:3e:01:7a:65", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acb053-83", "ovs_interfaceid": "e6acb053-8365-45b0-ac25-1f27f42162ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:16:59 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converting VIF {"id": "e6acb053-8365-45b0-ac25-1f27f42162ff", "address": "fa:16:3e:01:7a:65", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acb053-83", "ovs_interfaceid": "e6acb053-8365-45b0-ac25-1f27f42162ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:16:59 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:7a:65,bridge_name='br-int',has_traffic_filtering=True,id=e6acb053-8365-45b0-ac25-1f27f42162ff,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6acb053-83') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:16:59 user nova-compute[72504]: DEBUG nova.objects.instance [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lazy-loading 'pci_devices' on Instance uuid 95c7da6a-c9a5-4441-9819-1219f7d6793f {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:16:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:16:59 user nova-compute[72504]:   <uuid>95c7da6a-c9a5-4441-9819-1219f7d6793f</uuid>
Aug 01 20:16:59 user nova-compute[72504]:   <name>instance-0000002a</name>
Aug 01 20:16:59 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:16:59 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:16:59 user nova-compute[72504]:   <metadata>
Aug 01 20:16:59 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:16:59 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:16:59 user nova-compute[72504]:       <nova:name>tempest-TestVolumeBootPattern-server-1857669648</nova:name>
Aug 01 20:16:59 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:16:57</nova:creationTime>
Aug 01 20:16:59 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:16:59 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:16:59 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:16:59 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:16:59 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:16:59 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:16:59 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:16:59 user nova-compute[72504]:       <nova:owner>
Aug 01 20:16:59 user nova-compute[72504]:         <nova:user uuid="f06381c8a6214ddea7f1b36b623ed4d5">tempest-TestVolumeBootPattern-685885098-project-member</nova:user>
Aug 01 20:16:59 user nova-compute[72504]:         <nova:project uuid="eb59fbc2bf9749f3af7d56435cb37066">tempest-TestVolumeBootPattern-685885098</nova:project>
Aug 01 20:16:59 user nova-compute[72504]:       </nova:owner>
Aug 01 20:16:59 user nova-compute[72504]:       <nova:ports>
Aug 01 20:16:59 user nova-compute[72504]:         <nova:port uuid="e6acb053-8365-45b0-ac25-1f27f42162ff">
Aug 01 20:16:59 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 20:16:59 user nova-compute[72504]:         </nova:port>
Aug 01 20:16:59 user nova-compute[72504]:       </nova:ports>
Aug 01 20:16:59 user nova-compute[72504]:     </nova:instance>
Aug 01 20:16:59 user nova-compute[72504]:   </metadata>
Aug 01 20:16:59 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:16:59 user nova-compute[72504]:     <system>
Aug 01 20:16:59 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:16:59 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:16:59 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:16:59 user nova-compute[72504]:       <entry name="serial">95c7da6a-c9a5-4441-9819-1219f7d6793f</entry>
Aug 01 20:16:59 user nova-compute[72504]:       <entry name="uuid">95c7da6a-c9a5-4441-9819-1219f7d6793f</entry>
Aug 01 20:16:59 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:16:59 user nova-compute[72504]:     </system>
Aug 01 20:16:59 user nova-compute[72504]:   </sysinfo>
Aug 01 20:16:59 user nova-compute[72504]:   <os>
Aug 01 20:16:59 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:16:59 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:16:59 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:16:59 user nova-compute[72504]:   </os>
Aug 01 20:16:59 user nova-compute[72504]:   <features>
Aug 01 20:16:59 user nova-compute[72504]:     <acpi/>
Aug 01 20:16:59 user nova-compute[72504]:     <apic/>
Aug 01 20:16:59 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:16:59 user nova-compute[72504]:   </features>
Aug 01 20:16:59 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:16:59 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:16:59 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:16:59 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:16:59 user nova-compute[72504]:   </clock>
Aug 01 20:16:59 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:16:59 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:16:59 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:16:59 user nova-compute[72504]:   </cpu>
Aug 01 20:16:59 user nova-compute[72504]:   <devices>
Aug 01 20:16:59 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 20:16:59 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:16:59 user nova-compute[72504]:       <source dev="/dev/sdc"/>
Aug 01 20:16:59 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:16:59 user nova-compute[72504]:       <serial>500a89fd-74ba-4703-83b0-986e7cb06828</serial>
Aug 01 20:16:59 user nova-compute[72504]:     </disk>
Aug 01 20:16:59 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:16:59 user nova-compute[72504]:       <mac address="fa:16:3e:01:7a:65"/>
Aug 01 20:16:59 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:16:59 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:16:59 user nova-compute[72504]:       <target dev="tape6acb053-83"/>
Aug 01 20:16:59 user nova-compute[72504]:     </interface>
Aug 01 20:16:59 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:16:59 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/95c7da6a-c9a5-4441-9819-1219f7d6793f/console.log" append="off"/>
Aug 01 20:16:59 user nova-compute[72504]:     </serial>
Aug 01 20:16:59 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:16:59 user nova-compute[72504]:     <video>
Aug 01 20:16:59 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:16:59 user nova-compute[72504]:     </video>
Aug 01 20:16:59 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:16:59 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:16:59 user nova-compute[72504]:     </rng>
Aug 01 20:16:59 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:16:59 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:16:59 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:16:59 user nova-compute[72504]:     </memballoon>
Aug 01 20:16:59 user nova-compute[72504]:   </devices>
Aug 01 20:16:59 user nova-compute[72504]: </domain>
Aug 01 20:16:59 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:16:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:16:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1857669648',display_name='tempest-TestVolumeBootPattern-server-1857669648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1857669648',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrKan85Goqo8Jv0VkDYyshQTMQ59f3rUyYronrtEBxVKZjCUMR9BmiZNw9TY8Sa/UvzfiwIaZSAr04+rYB06rxcAkBTQWOBWsdwofE2ksnZ+I8hLlgBMpWvgtrRSAHuwA==',key_name='tempest-TestVolumeBootPattern-1138255315',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb59fbc2bf9749f3af7d56435cb37066',ramdisk_id='',reservation_id='r-0nrv4j37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-685885098',owner_user_name='tempest-TestVolumeBootPattern-685885098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:16:50Z,user_data=None,user_id='f06381c8a6214ddea7f1b36b623ed4d5',uuid=95c7da6a-c9a5-4441-9819-1219f7d6793f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6acb053-8365-45b0-ac25-1f27f42162ff", "address": "fa:16:3e:01:7a:65", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acb053-83", "ovs_interfaceid": "e6acb053-8365-45b0-ac25-1f27f42162ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:16:59 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converting VIF {"id": "e6acb053-8365-45b0-ac25-1f27f42162ff", "address": "fa:16:3e:01:7a:65", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acb053-83", "ovs_interfaceid": "e6acb053-8365-45b0-ac25-1f27f42162ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:16:59 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:7a:65,bridge_name='br-int',has_traffic_filtering=True,id=e6acb053-8365-45b0-ac25-1f27f42162ff,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6acb053-83') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:16:59 user nova-compute[72504]: DEBUG os_vif [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:7a:65,bridge_name='br-int',has_traffic_filtering=True,id=e6acb053-8365-45b0-ac25-1f27f42162ff,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6acb053-83') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:16:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:16:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:16:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6acb053-83, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:16:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape6acb053-83, col_values=(('external_ids', {'iface-id': 'e6acb053-8365-45b0-ac25-1f27f42162ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:7a:65', 'vm-uuid': '95c7da6a-c9a5-4441-9819-1219f7d6793f'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:16:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:16:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:16:59 user nova-compute[72504]: INFO os_vif [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:7a:65,bridge_name='br-int',has_traffic_filtering=True,id=e6acb053-8365-45b0-ac25-1f27f42162ff,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6acb053-83')
Aug 01 20:16:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:16:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] No VIF found with MAC fa:16:3e:01:7a:65, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:17:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:00 user nova-compute[72504]: DEBUG nova.compute.manager [req-fe60c226-5a67-4ca6-b33b-09694bde4631 req-9733131d-72ce-4c32-aced-b350d3e76eeb service nova] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Received event network-vif-plugged-e6acb053-8365-45b0-ac25-1f27f42162ff {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:17:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-fe60c226-5a67-4ca6-b33b-09694bde4631 req-9733131d-72ce-4c32-aced-b350d3e76eeb service nova] Acquiring lock "95c7da6a-c9a5-4441-9819-1219f7d6793f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:17:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-fe60c226-5a67-4ca6-b33b-09694bde4631 req-9733131d-72ce-4c32-aced-b350d3e76eeb service nova] Lock "95c7da6a-c9a5-4441-9819-1219f7d6793f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:17:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-fe60c226-5a67-4ca6-b33b-09694bde4631 req-9733131d-72ce-4c32-aced-b350d3e76eeb service nova] Lock "95c7da6a-c9a5-4441-9819-1219f7d6793f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:17:00 user nova-compute[72504]: DEBUG nova.compute.manager [req-fe60c226-5a67-4ca6-b33b-09694bde4631 req-9733131d-72ce-4c32-aced-b350d3e76eeb service nova] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] No waiting events found dispatching network-vif-plugged-e6acb053-8365-45b0-ac25-1f27f42162ff {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:17:00 user nova-compute[72504]: WARNING nova.compute.manager [req-fe60c226-5a67-4ca6-b33b-09694bde4631 req-9733131d-72ce-4c32-aced-b350d3e76eeb service nova] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Received unexpected event network-vif-plugged-e6acb053-8365-45b0-ac25-1f27f42162ff for instance with vm_state building and task_state spawning.
Aug 01 20:17:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:02 user nova-compute[72504]: DEBUG nova.compute.manager [req-5aed3b6b-3750-4959-ae3c-658e03ef18a8 req-de1b8c9b-82e8-43a7-a6e5-12e5e747baf9 service nova] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Received event network-vif-plugged-e6acb053-8365-45b0-ac25-1f27f42162ff {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:17:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5aed3b6b-3750-4959-ae3c-658e03ef18a8 req-de1b8c9b-82e8-43a7-a6e5-12e5e747baf9 service nova] Acquiring lock "95c7da6a-c9a5-4441-9819-1219f7d6793f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:17:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5aed3b6b-3750-4959-ae3c-658e03ef18a8 req-de1b8c9b-82e8-43a7-a6e5-12e5e747baf9 service nova] Lock "95c7da6a-c9a5-4441-9819-1219f7d6793f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:17:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5aed3b6b-3750-4959-ae3c-658e03ef18a8 req-de1b8c9b-82e8-43a7-a6e5-12e5e747baf9 service nova] Lock "95c7da6a-c9a5-4441-9819-1219f7d6793f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:17:02 user nova-compute[72504]: DEBUG nova.compute.manager [req-5aed3b6b-3750-4959-ae3c-658e03ef18a8 req-de1b8c9b-82e8-43a7-a6e5-12e5e747baf9 service nova] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] No waiting events found dispatching network-vif-plugged-e6acb053-8365-45b0-ac25-1f27f42162ff {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:17:02 user nova-compute[72504]: WARNING nova.compute.manager [req-5aed3b6b-3750-4959-ae3c-658e03ef18a8 req-de1b8c9b-82e8-43a7-a6e5-12e5e747baf9 service nova] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Received unexpected event network-vif-plugged-e6acb053-8365-45b0-ac25-1f27f42162ff for instance with vm_state building and task_state spawning.
Aug 01 20:17:02 user nova-compute[72504]: DEBUG nova.compute.manager [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:17:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:17:02 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690921022.9744234, 95c7da6a-c9a5-4441-9819-1219f7d6793f => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:17:02 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] VM Resumed (Lifecycle Event)
Aug 01 20:17:02 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Instance spawned successfully.
Aug 01 20:17:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 20:17:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:17:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:17:03 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:17:03 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690921022.9809527, 95c7da6a-c9a5-4441-9819-1219f7d6793f => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:17:03 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] VM Started (Lifecycle Event)
Aug 01 20:17:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:17:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:17:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:17:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:17:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:17:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:17:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:17:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:17:03 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:17:03 user nova-compute[72504]: INFO nova.compute.manager [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Took 5.39 seconds to spawn the instance on the hypervisor.
Aug 01 20:17:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:17:03 user nova-compute[72504]: INFO nova.compute.manager [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Took 13.92 seconds to build instance.
Aug 01 20:17:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4d606adc-5eb2-4e3b-a4b3-37bccf8c8e95 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "95c7da6a-c9a5-4441-9819-1219f7d6793f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.013s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:17:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:17:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:17:09 user nova-compute[72504]: DEBUG nova.compute.manager [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 20:17:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:17:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:17:09 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:17:09 user nova-compute[72504]: INFO nova.compute.claims [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Claim successful on node user
Aug 01 20:17:10 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.291s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG nova.compute.manager [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG nova.compute.manager [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG nova.network.neutron [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 20:17:10 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 20:17:10 user nova-compute[72504]: DEBUG nova.compute.manager [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG nova.policy [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93aee9c4331d46aab83b73dfe0584fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6047793ecc44519667cf55e090296e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG nova.compute.manager [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:17:10 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Creating image(s)
Aug 01 20:17:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb3228ce-ea4b-4393-a7b4-2d401ad314de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "/opt/stack/data/nova/instances/bb3228ce-ea4b-4393-a7b4-2d401ad314de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "/opt/stack/data/nova/instances/bb3228ce-ea4b-4393-a7b4-2d401ad314de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.145s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/bb3228ce-ea4b-4393-a7b4-2d401ad314de/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/bb3228ce-ea4b-4393-a7b4-2d401ad314de/disk 1073741824" returned: 0 in 0.067s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.134s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb3228ce-ea4b-4393-a7b4-2d401ad314de/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb3228ce-ea4b-4393-a7b4-2d401ad314de/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb3228ce-ea4b-4393-a7b4-2d401ad314de/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Cannot resize image /opt/stack/data/nova/instances/bb3228ce-ea4b-4393-a7b4-2d401ad314de/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG nova.objects.instance [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lazy-loading 'migration_context' on Instance uuid bb3228ce-ea4b-4393-a7b4-2d401ad314de {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG nova.network.neutron [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Successfully created port: ba94e20c-dd80-4acb-a307-0ed565731890 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Ensure instance console log exists: /opt/stack/data/nova/instances/bb3228ce-ea4b-4393-a7b4-2d401ad314de/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:17:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:17:11 user nova-compute[72504]: DEBUG nova.network.neutron [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Successfully updated port: ba94e20c-dd80-4acb-a307-0ed565731890 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 20:17:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "refresh_cache-bb3228ce-ea4b-4393-a7b4-2d401ad314de" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:17:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquired lock "refresh_cache-bb3228ce-ea4b-4393-a7b4-2d401ad314de" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:17:11 user nova-compute[72504]: DEBUG nova.network.neutron [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:17:11 user nova-compute[72504]: DEBUG nova.compute.manager [req-0584c608-6796-46af-a597-d6da6c227768 req-b6beb831-2324-413c-b44c-3a2c95141d8f service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Received event network-changed-ba94e20c-dd80-4acb-a307-0ed565731890 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:17:11 user nova-compute[72504]: DEBUG nova.compute.manager [req-0584c608-6796-46af-a597-d6da6c227768 req-b6beb831-2324-413c-b44c-3a2c95141d8f service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Refreshing instance network info cache due to event network-changed-ba94e20c-dd80-4acb-a307-0ed565731890. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:17:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0584c608-6796-46af-a597-d6da6c227768 req-b6beb831-2324-413c-b44c-3a2c95141d8f service nova] Acquiring lock "refresh_cache-bb3228ce-ea4b-4393-a7b4-2d401ad314de" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:17:11 user nova-compute[72504]: DEBUG nova.network.neutron [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.network.neutron [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Updating instance_info_cache with network_info: [{"id": "ba94e20c-dd80-4acb-a307-0ed565731890", "address": "fa:16:3e:f9:35:24", "network": {"id": "ec191814-d9f8-4a40-a775-07b50423cec5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1317992461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf6047793ecc44519667cf55e090296e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba94e20c-dd", "ovs_interfaceid": "ba94e20c-dd80-4acb-a307-0ed565731890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Releasing lock "refresh_cache-bb3228ce-ea4b-4393-a7b4-2d401ad314de" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.compute.manager [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Instance network_info: |[{"id": "ba94e20c-dd80-4acb-a307-0ed565731890", "address": "fa:16:3e:f9:35:24", "network": {"id": "ec191814-d9f8-4a40-a775-07b50423cec5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1317992461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf6047793ecc44519667cf55e090296e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba94e20c-dd", "ovs_interfaceid": "ba94e20c-dd80-4acb-a307-0ed565731890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0584c608-6796-46af-a597-d6da6c227768 req-b6beb831-2324-413c-b44c-3a2c95141d8f service nova] Acquired lock "refresh_cache-bb3228ce-ea4b-4393-a7b4-2d401ad314de" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.network.neutron [req-0584c608-6796-46af-a597-d6da6c227768 req-b6beb831-2324-413c-b44c-3a2c95141d8f service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Refreshing network info cache for port ba94e20c-dd80-4acb-a307-0ed565731890 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Start _get_guest_xml network_info=[{"id": "ba94e20c-dd80-4acb-a307-0ed565731890", "address": "fa:16:3e:f9:35:24", "network": {"id": "ec191814-d9f8-4a40-a775-07b50423cec5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1317992461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf6047793ecc44519667cf55e090296e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba94e20c-dd", "ovs_interfaceid": "ba94e20c-dd80-4acb-a307-0ed565731890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:17:12 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:17:12 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-810728448',display_name='tempest-VolumesSnapshotTestJSON-instance-810728448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-810728448',id=43,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImwNBAQvlp6lw5EW+0791NYM0ZvrL3+marDJ0FPz/Q+of70OudmeGTGsdmmTFI3KZurhztTxwe88QIWb1lJ1ZG5EidGtWsbIC8DRTmEu60U6p67stb/kLldDX+sB9bFRw==',key_name='tempest-keypair-1682650510',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf6047793ecc44519667cf55e090296e',ramdisk_id='',reservation_id='r-x0ybjcsk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2122802409',owner_user_name='tempest-VolumesSnapshotTestJSON-2122802409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:17:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93aee9c4331d46aab83b73dfe0584fa0',uuid=bb3228ce-ea4b-4393-a7b4-2d401ad314de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba94e20c-dd80-4acb-a307-0ed565731890", "address": "fa:16:3e:f9:35:24", "network": {"id": "ec191814-d9f8-4a40-a775-07b50423cec5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1317992461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf6047793ecc44519667cf55e090296e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba94e20c-dd", "ovs_interfaceid": "ba94e20c-dd80-4acb-a307-0ed565731890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Converting VIF {"id": "ba94e20c-dd80-4acb-a307-0ed565731890", "address": "fa:16:3e:f9:35:24", "network": {"id": "ec191814-d9f8-4a40-a775-07b50423cec5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1317992461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf6047793ecc44519667cf55e090296e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba94e20c-dd", "ovs_interfaceid": "ba94e20c-dd80-4acb-a307-0ed565731890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:35:24,bridge_name='br-int',has_traffic_filtering=True,id=ba94e20c-dd80-4acb-a307-0ed565731890,network=Network(ec191814-d9f8-4a40-a775-07b50423cec5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba94e20c-dd') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.objects.instance [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lazy-loading 'pci_devices' on Instance uuid bb3228ce-ea4b-4393-a7b4-2d401ad314de {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:17:12 user nova-compute[72504]:   <uuid>bb3228ce-ea4b-4393-a7b4-2d401ad314de</uuid>
Aug 01 20:17:12 user nova-compute[72504]:   <name>instance-0000002b</name>
Aug 01 20:17:12 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:17:12 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:17:12 user nova-compute[72504]:   <metadata>
Aug 01 20:17:12 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:17:12 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:17:12 user nova-compute[72504]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-810728448</nova:name>
Aug 01 20:17:12 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:17:12</nova:creationTime>
Aug 01 20:17:12 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:17:12 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:17:12 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:17:12 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:17:12 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:17:12 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:17:12 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:17:12 user nova-compute[72504]:       <nova:owner>
Aug 01 20:17:12 user nova-compute[72504]:         <nova:user uuid="93aee9c4331d46aab83b73dfe0584fa0">tempest-VolumesSnapshotTestJSON-2122802409-project-member</nova:user>
Aug 01 20:17:12 user nova-compute[72504]:         <nova:project uuid="cf6047793ecc44519667cf55e090296e">tempest-VolumesSnapshotTestJSON-2122802409</nova:project>
Aug 01 20:17:12 user nova-compute[72504]:       </nova:owner>
Aug 01 20:17:12 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 20:17:12 user nova-compute[72504]:       <nova:ports>
Aug 01 20:17:12 user nova-compute[72504]:         <nova:port uuid="ba94e20c-dd80-4acb-a307-0ed565731890">
Aug 01 20:17:12 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 20:17:12 user nova-compute[72504]:         </nova:port>
Aug 01 20:17:12 user nova-compute[72504]:       </nova:ports>
Aug 01 20:17:12 user nova-compute[72504]:     </nova:instance>
Aug 01 20:17:12 user nova-compute[72504]:   </metadata>
Aug 01 20:17:12 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:17:12 user nova-compute[72504]:     <system>
Aug 01 20:17:12 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:17:12 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:17:12 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:17:12 user nova-compute[72504]:       <entry name="serial">bb3228ce-ea4b-4393-a7b4-2d401ad314de</entry>
Aug 01 20:17:12 user nova-compute[72504]:       <entry name="uuid">bb3228ce-ea4b-4393-a7b4-2d401ad314de</entry>
Aug 01 20:17:12 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:17:12 user nova-compute[72504]:     </system>
Aug 01 20:17:12 user nova-compute[72504]:   </sysinfo>
Aug 01 20:17:12 user nova-compute[72504]:   <os>
Aug 01 20:17:12 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:17:12 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:17:12 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:17:12 user nova-compute[72504]:   </os>
Aug 01 20:17:12 user nova-compute[72504]:   <features>
Aug 01 20:17:12 user nova-compute[72504]:     <acpi/>
Aug 01 20:17:12 user nova-compute[72504]:     <apic/>
Aug 01 20:17:12 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:17:12 user nova-compute[72504]:   </features>
Aug 01 20:17:12 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:17:12 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:17:12 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:17:12 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:17:12 user nova-compute[72504]:   </clock>
Aug 01 20:17:12 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:17:12 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:17:12 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:17:12 user nova-compute[72504]:   </cpu>
Aug 01 20:17:12 user nova-compute[72504]:   <devices>
Aug 01 20:17:12 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 20:17:12 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 20:17:12 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/bb3228ce-ea4b-4393-a7b4-2d401ad314de/disk"/>
Aug 01 20:17:12 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:17:12 user nova-compute[72504]:     </disk>
Aug 01 20:17:12 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:17:12 user nova-compute[72504]:       <mac address="fa:16:3e:f9:35:24"/>
Aug 01 20:17:12 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:17:12 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:17:12 user nova-compute[72504]:       <target dev="tapba94e20c-dd"/>
Aug 01 20:17:12 user nova-compute[72504]:     </interface>
Aug 01 20:17:12 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:17:12 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/bb3228ce-ea4b-4393-a7b4-2d401ad314de/console.log" append="off"/>
Aug 01 20:17:12 user nova-compute[72504]:     </serial>
Aug 01 20:17:12 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:17:12 user nova-compute[72504]:     <video>
Aug 01 20:17:12 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:17:12 user nova-compute[72504]:     </video>
Aug 01 20:17:12 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:17:12 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:17:12 user nova-compute[72504]:     </rng>
Aug 01 20:17:12 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:17:12 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:17:12 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:17:12 user nova-compute[72504]:     </memballoon>
Aug 01 20:17:12 user nova-compute[72504]:   </devices>
Aug 01 20:17:12 user nova-compute[72504]: </domain>
Aug 01 20:17:12 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-810728448',display_name='tempest-VolumesSnapshotTestJSON-instance-810728448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-810728448',id=43,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImwNBAQvlp6lw5EW+0791NYM0ZvrL3+marDJ0FPz/Q+of70OudmeGTGsdmmTFI3KZurhztTxwe88QIWb1lJ1ZG5EidGtWsbIC8DRTmEu60U6p67stb/kLldDX+sB9bFRw==',key_name='tempest-keypair-1682650510',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf6047793ecc44519667cf55e090296e',ramdisk_id='',reservation_id='r-x0ybjcsk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2122802409',owner_user_name='tempest-VolumesSnapshotTestJSON-2122802409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:17:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93aee9c4331d46aab83b73dfe0584fa0',uuid=bb3228ce-ea4b-4393-a7b4-2d401ad314de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba94e20c-dd80-4acb-a307-0ed565731890", "address": "fa:16:3e:f9:35:24", "network": {"id": "ec191814-d9f8-4a40-a775-07b50423cec5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1317992461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf6047793ecc44519667cf55e090296e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba94e20c-dd", "ovs_interfaceid": "ba94e20c-dd80-4acb-a307-0ed565731890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Converting VIF {"id": "ba94e20c-dd80-4acb-a307-0ed565731890", "address": "fa:16:3e:f9:35:24", "network": {"id": "ec191814-d9f8-4a40-a775-07b50423cec5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1317992461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf6047793ecc44519667cf55e090296e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba94e20c-dd", "ovs_interfaceid": "ba94e20c-dd80-4acb-a307-0ed565731890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:35:24,bridge_name='br-int',has_traffic_filtering=True,id=ba94e20c-dd80-4acb-a307-0ed565731890,network=Network(ec191814-d9f8-4a40-a775-07b50423cec5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba94e20c-dd') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG os_vif [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:35:24,bridge_name='br-int',has_traffic_filtering=True,id=ba94e20c-dd80-4acb-a307-0ed565731890,network=Network(ec191814-d9f8-4a40-a775-07b50423cec5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba94e20c-dd') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba94e20c-dd, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba94e20c-dd, col_values=(('external_ids', {'iface-id': 'ba94e20c-dd80-4acb-a307-0ed565731890', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:35:24', 'vm-uuid': 'bb3228ce-ea4b-4393-a7b4-2d401ad314de'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:12 user nova-compute[72504]: INFO os_vif [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:35:24,bridge_name='br-int',has_traffic_filtering=True,id=ba94e20c-dd80-4acb-a307-0ed565731890,network=Network(ec191814-d9f8-4a40-a775-07b50423cec5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba94e20c-dd')
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] No VIF found with MAC fa:16:3e:f9:35:24, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.network.neutron [req-0584c608-6796-46af-a597-d6da6c227768 req-b6beb831-2324-413c-b44c-3a2c95141d8f service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Updated VIF entry in instance network info cache for port ba94e20c-dd80-4acb-a307-0ed565731890. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG nova.network.neutron [req-0584c608-6796-46af-a597-d6da6c227768 req-b6beb831-2324-413c-b44c-3a2c95141d8f service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Updating instance_info_cache with network_info: [{"id": "ba94e20c-dd80-4acb-a307-0ed565731890", "address": "fa:16:3e:f9:35:24", "network": {"id": "ec191814-d9f8-4a40-a775-07b50423cec5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1317992461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf6047793ecc44519667cf55e090296e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba94e20c-dd", "ovs_interfaceid": "ba94e20c-dd80-4acb-a307-0ed565731890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:17:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0584c608-6796-46af-a597-d6da6c227768 req-b6beb831-2324-413c-b44c-3a2c95141d8f service nova] Releasing lock "refresh_cache-bb3228ce-ea4b-4393-a7b4-2d401ad314de" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:17:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:13 user nova-compute[72504]: DEBUG nova.compute.manager [req-40a68a3e-9f68-4360-96f4-baef89eee01e req-bd0982c9-a702-46ad-a41c-35fb052861d6 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Received event network-vif-plugged-ba94e20c-dd80-4acb-a307-0ed565731890 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:17:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-40a68a3e-9f68-4360-96f4-baef89eee01e req-bd0982c9-a702-46ad-a41c-35fb052861d6 service nova] Acquiring lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:17:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-40a68a3e-9f68-4360-96f4-baef89eee01e req-bd0982c9-a702-46ad-a41c-35fb052861d6 service nova] Lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:17:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-40a68a3e-9f68-4360-96f4-baef89eee01e req-bd0982c9-a702-46ad-a41c-35fb052861d6 service nova] Lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:17:13 user nova-compute[72504]: DEBUG nova.compute.manager [req-40a68a3e-9f68-4360-96f4-baef89eee01e req-bd0982c9-a702-46ad-a41c-35fb052861d6 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] No waiting events found dispatching network-vif-plugged-ba94e20c-dd80-4acb-a307-0ed565731890 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:17:13 user nova-compute[72504]: WARNING nova.compute.manager [req-40a68a3e-9f68-4360-96f4-baef89eee01e req-bd0982c9-a702-46ad-a41c-35fb052861d6 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Received unexpected event network-vif-plugged-ba94e20c-dd80-4acb-a307-0ed565731890 for instance with vm_state building and task_state spawning.
Aug 01 20:17:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:15 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690921035.56311, bb3228ce-ea4b-4393-a7b4-2d401ad314de => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:17:15 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] VM Resumed (Lifecycle Event)
Aug 01 20:17:15 user nova-compute[72504]: DEBUG nova.compute.manager [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:17:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:17:15 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Instance spawned successfully.
Aug 01 20:17:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 20:17:15 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:17:15 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:17:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:17:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:17:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:17:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:17:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:17:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:17:15 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:17:15 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690921035.5736566, bb3228ce-ea4b-4393-a7b4-2d401ad314de => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:17:15 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] VM Started (Lifecycle Event)
Aug 01 20:17:15 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:17:15 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:17:15 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:17:15 user nova-compute[72504]: INFO nova.compute.manager [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Took 5.42 seconds to spawn the instance on the hypervisor.
Aug 01 20:17:15 user nova-compute[72504]: DEBUG nova.compute.manager [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:17:15 user nova-compute[72504]: INFO nova.compute.manager [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Took 6.02 seconds to build instance.
Aug 01 20:17:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-69d2f491-5cfa-43fb-909f-b988a6bc09b4 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.217s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:17:15 user nova-compute[72504]: DEBUG nova.compute.manager [req-0aa39074-6d63-4f07-be9c-3436fc15d0ff req-2f40710f-f402-4197-a98b-bd76dadac373 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Received event network-vif-plugged-ba94e20c-dd80-4acb-a307-0ed565731890 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:17:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0aa39074-6d63-4f07-be9c-3436fc15d0ff req-2f40710f-f402-4197-a98b-bd76dadac373 service nova] Acquiring lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:17:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0aa39074-6d63-4f07-be9c-3436fc15d0ff req-2f40710f-f402-4197-a98b-bd76dadac373 service nova] Lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:17:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-0aa39074-6d63-4f07-be9c-3436fc15d0ff req-2f40710f-f402-4197-a98b-bd76dadac373 service nova] Lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:17:15 user nova-compute[72504]: DEBUG nova.compute.manager [req-0aa39074-6d63-4f07-be9c-3436fc15d0ff req-2f40710f-f402-4197-a98b-bd76dadac373 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] No waiting events found dispatching network-vif-plugged-ba94e20c-dd80-4acb-a307-0ed565731890 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:17:15 user nova-compute[72504]: WARNING nova.compute.manager [req-0aa39074-6d63-4f07-be9c-3436fc15d0ff req-2f40710f-f402-4197-a98b-bd76dadac373 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Received unexpected event network-vif-plugged-ba94e20c-dd80-4acb-a307-0ed565731890 for instance with vm_state active and task_state None.
Aug 01 20:17:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a909e501-6882-402a-9667-69965435230a tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Acquiring lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a909e501-6882-402a-9667-69965435230a tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a909e501-6882-402a-9667-69965435230a tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Acquiring lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a909e501-6882-402a-9667-69965435230a tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a909e501-6882-402a-9667-69965435230a tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:17:23 user nova-compute[72504]: INFO nova.compute.manager [None req-a909e501-6882-402a-9667-69965435230a tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Terminating instance
Aug 01 20:17:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-a909e501-6882-402a-9667-69965435230a tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "a4f9c59c-cf0b-4216-a194-22712725328d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "a4f9c59c-cf0b-4216-a194-22712725328d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:17:23 user nova-compute[72504]: INFO nova.compute.manager [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Detaching volume 5e8f03f7-e75c-424c-b677-9c24d2ee1ff8
Aug 01 20:17:23 user nova-compute[72504]: INFO nova.virt.block_device [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Attempting to driver detach volume 5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 from mountpoint /dev/vdb
Aug 01 20:17:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Attempting to detach device vdb from instance a4f9c59c-cf0b-4216-a194-22712725328d from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:17:23 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:17:23 user nova-compute[72504]:   <source dev="/dev/sdb"/>
Aug 01 20:17:23 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:17:23 user nova-compute[72504]:   <serial>5e8f03f7-e75c-424c-b677-9c24d2ee1ff8</serial>
Aug 01 20:17:23 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 20:17:23 user nova-compute[72504]: </disk>
Aug 01 20:17:23 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:17:23 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Successfully detached device vdb from instance a4f9c59c-cf0b-4216-a194-22712725328d from the persistent domain config.
Aug 01 20:17:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a4f9c59c-cf0b-4216-a194-22712725328d from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:17:23 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:17:23 user nova-compute[72504]:   <source dev="/dev/sdb"/>
Aug 01 20:17:23 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:17:23 user nova-compute[72504]:   <serial>5e8f03f7-e75c-424c-b677-9c24d2ee1ff8</serial>
Aug 01 20:17:23 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 20:17:23 user nova-compute[72504]: </disk>
Aug 01 20:17:23 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG nova.compute.manager [req-d30abdb4-1833-407e-9354-9d97502beab9 req-2f7add59-1d2a-4918-a34a-fa4b7d84e496 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received event network-vif-unplugged-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d30abdb4-1833-407e-9354-9d97502beab9 req-2f7add59-1d2a-4918-a34a-fa4b7d84e496 service nova] Acquiring lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d30abdb4-1833-407e-9354-9d97502beab9 req-2f7add59-1d2a-4918-a34a-fa4b7d84e496 service nova] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d30abdb4-1833-407e-9354-9d97502beab9 req-2f7add59-1d2a-4918-a34a-fa4b7d84e496 service nova] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG nova.compute.manager [req-d30abdb4-1833-407e-9354-9d97502beab9 req-2f7add59-1d2a-4918-a34a-fa4b7d84e496 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] No waiting events found dispatching network-vif-unplugged-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG nova.compute.manager [req-d30abdb4-1833-407e-9354-9d97502beab9 req-2f7add59-1d2a-4918-a34a-fa4b7d84e496 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received event network-vif-unplugged-298ca2cd-b389-42be-bc06-05344f41e0d2 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690921043.843567, a4f9c59c-cf0b-4216-a194-22712725328d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a4f9c59c-cf0b-4216-a194-22712725328d {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 20:17:23 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Successfully detached device vdb from instance a4f9c59c-cf0b-4216-a194-22712725328d from the live domain config.
Aug 01 20:17:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuevRMPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:17:23 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:17:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1394c743-456e-4510-b9cf-1a88512eb496]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8343e110-b732-4302-8394-279c57790295]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)
Aug 01 20:17:23 user nova-compute[72504]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:17:23 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 (non-flash)
Aug 01 20:17:23 user nova-compute[72504]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:17:23 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff40c195fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8'): ({'sdb'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Removing single pathed devices sdb {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f17a7df-fc5c-4e6e-b0b9-97448116d137]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab75f5b-4f55-49c4-a2fc-9cff7cbc125c]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Flushing IO for device /dev/sdb {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b472b65-c817-44b8-9031-d91c15ff1987]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:17:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5015914-742d-4262-80a8-378340423e76]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83f6579-6264-4edf-95ec-f1b6cfe8c7c4]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce3f257-bafb-4ce8-985a-0983d403c530]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8, portal: 172.16.0.220,3260]
Aug 01 20:17:24 user nova-compute[72504]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8, portal: 172.16.0.220,3260] successful.
Aug 01 20:17:24 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e8f03f7-e75c-424c-b677-9c24d2ee1ff8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[295b658c-392a-419d-8efd-528a9b0e9987]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] <== disconnect_volume: return (306ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:17:24 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Instance destroyed successfully.
Aug 01 20:17:24 user nova-compute[72504]: DEBUG nova.objects.instance [None req-a909e501-6882-402a-9667-69965435230a tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lazy-loading 'resources' on Instance uuid 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-a909e501-6882-402a-9667-69965435230a tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:10:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1381056158',display_name='tempest-ServerStableDeviceRescueTest-server-1381056158',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1381056158',id=37,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIVwp+tuXO6c8kD785Zo2XEHfC7u/nN/LRbpKentZruUp4OEarQSWw3qwP7r5vGpF4yfsIPZn6vwvxtuEVuQxxzjzDEY61CEq1/sMW/n2rGFZLUFfYrKgriISxcduSjrQ==',key_name='tempest-keypair-982487004',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:14:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f084e19e3c674b308d8a566f57bba3f2',ramdisk_id='',reservation_id='r-dv3t3ab9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1470200004',owner_user_name='tempest-ServerStableDeviceRescueTest-1470200004-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:16:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e77534532ab04a699a69ee9d2ef6f5b1',uuid=9ac6b63a-2c5a-4f72-9dc3-8f884253e180,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "298ca2cd-b389-42be-bc06-05344f41e0d2", "address": "fa:16:3e:74:2e:28", "network": {"id": "d4bfb5e4-0509-436d-8605-07b850de35b1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1900175842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f084e19e3c674b308d8a566f57bba3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ca2cd-b3", "ovs_interfaceid": "298ca2cd-b389-42be-bc06-05344f41e0d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-a909e501-6882-402a-9667-69965435230a tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Converting VIF {"id": "298ca2cd-b389-42be-bc06-05344f41e0d2", "address": "fa:16:3e:74:2e:28", "network": {"id": "d4bfb5e4-0509-436d-8605-07b850de35b1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1900175842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f084e19e3c674b308d8a566f57bba3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ca2cd-b3", "ovs_interfaceid": "298ca2cd-b389-42be-bc06-05344f41e0d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-a909e501-6882-402a-9667-69965435230a tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:2e:28,bridge_name='br-int',has_traffic_filtering=True,id=298ca2cd-b389-42be-bc06-05344f41e0d2,network=Network(d4bfb5e4-0509-436d-8605-07b850de35b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap298ca2cd-b3') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG os_vif [None req-a909e501-6882-402a-9667-69965435230a tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:2e:28,bridge_name='br-int',has_traffic_filtering=True,id=298ca2cd-b389-42be-bc06-05344f41e0d2,network=Network(d4bfb5e4-0509-436d-8605-07b850de35b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap298ca2cd-b3') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap298ca2cd-b3, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:17:24 user nova-compute[72504]: INFO os_vif [None req-a909e501-6882-402a-9667-69965435230a tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:2e:28,bridge_name='br-int',has_traffic_filtering=True,id=298ca2cd-b389-42be-bc06-05344f41e0d2,network=Network(d4bfb5e4-0509-436d-8605-07b850de35b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap298ca2cd-b3')
Aug 01 20:17:24 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-a909e501-6882-402a-9667-69965435230a tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Deleting instance files /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180_del
Aug 01 20:17:24 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-a909e501-6882-402a-9667-69965435230a tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Deletion of /opt/stack/data/nova/instances/9ac6b63a-2c5a-4f72-9dc3-8f884253e180_del complete
Aug 01 20:17:24 user nova-compute[72504]: INFO nova.compute.manager [None req-a909e501-6882-402a-9667-69965435230a tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 01 20:17:24 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-a909e501-6882-402a-9667-69965435230a tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:17:24 user nova-compute[72504]: DEBUG nova.objects.instance [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'flavor' on Instance uuid a4f9c59c-cf0b-4216-a194-22712725328d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:17:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-317746cd-cc96-4ce3-bf14-401d7f6c5d9d tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "a4f9c59c-cf0b-4216-a194-22712725328d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.692s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:17:25 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:17:25 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Took 0.93 seconds to deallocate network for instance.
Aug 01 20:17:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a909e501-6882-402a-9667-69965435230a tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:17:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a909e501-6882-402a-9667-69965435230a tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:17:25 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-a909e501-6882-402a-9667-69965435230a tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:17:25 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-a909e501-6882-402a-9667-69965435230a tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:17:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a909e501-6882-402a-9667-69965435230a tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:17:25 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-a909e501-6882-402a-9667-69965435230a tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Deleted allocations for instance 9ac6b63a-2c5a-4f72-9dc3-8f884253e180
Aug 01 20:17:25 user nova-compute[72504]: DEBUG nova.compute.manager [req-4670cda4-f12b-45e4-89ae-18e656b118c3 req-4d3e46ff-99e7-4d1e-9fd7-20d73a2f9b97 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received event network-vif-plugged-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:17:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4670cda4-f12b-45e4-89ae-18e656b118c3 req-4d3e46ff-99e7-4d1e-9fd7-20d73a2f9b97 service nova] Acquiring lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:17:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4670cda4-f12b-45e4-89ae-18e656b118c3 req-4d3e46ff-99e7-4d1e-9fd7-20d73a2f9b97 service nova] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:17:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-4670cda4-f12b-45e4-89ae-18e656b118c3 req-4d3e46ff-99e7-4d1e-9fd7-20d73a2f9b97 service nova] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:17:25 user nova-compute[72504]: DEBUG nova.compute.manager [req-4670cda4-f12b-45e4-89ae-18e656b118c3 req-4d3e46ff-99e7-4d1e-9fd7-20d73a2f9b97 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] No waiting events found dispatching network-vif-plugged-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:17:25 user nova-compute[72504]: WARNING nova.compute.manager [req-4670cda4-f12b-45e4-89ae-18e656b118c3 req-4d3e46ff-99e7-4d1e-9fd7-20d73a2f9b97 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received unexpected event network-vif-plugged-298ca2cd-b389-42be-bc06-05344f41e0d2 for instance with vm_state deleted and task_state None.
Aug 01 20:17:25 user nova-compute[72504]: DEBUG nova.compute.manager [req-4670cda4-f12b-45e4-89ae-18e656b118c3 req-4d3e46ff-99e7-4d1e-9fd7-20d73a2f9b97 service nova] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Received event network-vif-deleted-298ca2cd-b389-42be-bc06-05344f41e0d2 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:17:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a909e501-6882-402a-9667-69965435230a tempest-ServerStableDeviceRescueTest-1470200004 tempest-ServerStableDeviceRescueTest-1470200004-project-member] Lock "9ac6b63a-2c5a-4f72-9dc3-8f884253e180" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.435s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:17:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1db1cbc3-30dc-43ac-88b6-9b986c317f60 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "a4f9c59c-cf0b-4216-a194-22712725328d" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:17:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1db1cbc3-30dc-43ac-88b6-9b986c317f60 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "a4f9c59c-cf0b-4216-a194-22712725328d" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:17:25 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1db1cbc3-30dc-43ac-88b6-9b986c317f60 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:17:25 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1db1cbc3-30dc-43ac-88b6-9b986c317f60 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72504) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 01 20:17:25 user nova-compute[72504]: DEBUG nova.objects.instance [None req-1db1cbc3-30dc-43ac-88b6-9b986c317f60 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'flavor' on Instance uuid a4f9c59c-cf0b-4216-a194-22712725328d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:17:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:26 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Instance destroyed successfully.
Aug 01 20:17:26 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1db1cbc3-30dc-43ac-88b6-9b986c317f60 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:17:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1db1cbc3-30dc-43ac-88b6-9b986c317f60 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "a4f9c59c-cf0b-4216-a194-22712725328d" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.828s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:17:27 user nova-compute[72504]: DEBUG nova.compute.manager [req-ea5175d3-253a-4061-a9b8-e35948e99e92 req-8a5419c6-3d83-44a7-b353-b95e3a933119 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Received event network-vif-unplugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:17:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ea5175d3-253a-4061-a9b8-e35948e99e92 req-8a5419c6-3d83-44a7-b353-b95e3a933119 service nova] Acquiring lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:17:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ea5175d3-253a-4061-a9b8-e35948e99e92 req-8a5419c6-3d83-44a7-b353-b95e3a933119 service nova] Lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:17:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ea5175d3-253a-4061-a9b8-e35948e99e92 req-8a5419c6-3d83-44a7-b353-b95e3a933119 service nova] Lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:17:27 user nova-compute[72504]: DEBUG nova.compute.manager [req-ea5175d3-253a-4061-a9b8-e35948e99e92 req-8a5419c6-3d83-44a7-b353-b95e3a933119 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] No waiting events found dispatching network-vif-unplugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:17:27 user nova-compute[72504]: WARNING nova.compute.manager [req-ea5175d3-253a-4061-a9b8-e35948e99e92 req-8a5419c6-3d83-44a7-b353-b95e3a933119 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Received unexpected event network-vif-unplugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e for instance with vm_state stopped and task_state None.
Aug 01 20:17:27 user nova-compute[72504]: DEBUG nova.compute.manager [req-ea5175d3-253a-4061-a9b8-e35948e99e92 req-8a5419c6-3d83-44a7-b353-b95e3a933119 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Received event network-vif-plugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:17:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ea5175d3-253a-4061-a9b8-e35948e99e92 req-8a5419c6-3d83-44a7-b353-b95e3a933119 service nova] Acquiring lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:17:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ea5175d3-253a-4061-a9b8-e35948e99e92 req-8a5419c6-3d83-44a7-b353-b95e3a933119 service nova] Lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:17:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ea5175d3-253a-4061-a9b8-e35948e99e92 req-8a5419c6-3d83-44a7-b353-b95e3a933119 service nova] Lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:17:27 user nova-compute[72504]: DEBUG nova.compute.manager [req-ea5175d3-253a-4061-a9b8-e35948e99e92 req-8a5419c6-3d83-44a7-b353-b95e3a933119 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] No waiting events found dispatching network-vif-plugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:17:27 user nova-compute[72504]: WARNING nova.compute.manager [req-ea5175d3-253a-4061-a9b8-e35948e99e92 req-8a5419c6-3d83-44a7-b353-b95e3a933119 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Received unexpected event network-vif-plugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e for instance with vm_state stopped and task_state None.
Aug 01 20:17:27 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:17:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:33 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:17:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:35 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:17:35 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:17:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:39 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690921044.187188, 9ac6b63a-2c5a-4f72-9dc3-8f884253e180 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:17:39 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] VM Stopped (Lifecycle Event)
Aug 01 20:17:39 user nova-compute[72504]: DEBUG nova.compute.manager [None req-2ed4be27-7562-40ec-b0bf-0fb28042380b None None] [instance: 9ac6b63a-2c5a-4f72-9dc3-8f884253e180] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:17:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:39 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:17:39 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:17:39 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Didn't find any instances for network info cache update. {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 20:17:39 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:17:39 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:17:40 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:17:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:17:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:17:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:17:40 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:17:40 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb3228ce-ea4b-4393-a7b4-2d401ad314de/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:17:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb3228ce-ea4b-4393-a7b4-2d401ad314de/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:17:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb3228ce-ea4b-4393-a7b4-2d401ad314de/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:17:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb3228ce-ea4b-4393-a7b4-2d401ad314de/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:17:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:17:41 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690921046.359876, a4f9c59c-cf0b-4216-a194-22712725328d => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:17:41 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] VM Stopped (Lifecycle Event)
Aug 01 20:17:41 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7e136f92-33a9-4c45-abf5-99315546edaf None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:17:41 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7e136f92-33a9-4c45-abf5-99315546edaf None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:17:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:17:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:17:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:17:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:17:42 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:17:42 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:17:42 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8480MB free_disk=25.22311019897461GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:17:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:17:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:17:42 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance a4f9c59c-cf0b-4216-a194-22712725328d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:17:42 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 95c7da6a-c9a5-4441-9819-1219f7d6793f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:17:42 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance bb3228ce-ea4b-4393-a7b4-2d401ad314de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:17:42 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:17:42 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:17:42 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:17:42 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:17:42 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:17:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:17:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:45 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:17:45 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:17:47 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:17:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:17:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:17:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:18:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:18:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:18:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:18:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:18:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:18:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:18:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:18:27 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:18:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:18:33 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:18:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:18:35 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:18:35 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:18:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:18:40 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:18:40 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:18:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-03a08130-3795-4175-beea-a0f2634b9a0d req-73fcb11f-2995-4fff-ba05-90b8f2cf4903 service nova] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Received event network-changed-e6acb053-8365-45b0-ac25-1f27f42162ff {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:18:40 user nova-compute[72504]: DEBUG nova.compute.manager [req-03a08130-3795-4175-beea-a0f2634b9a0d req-73fcb11f-2995-4fff-ba05-90b8f2cf4903 service nova] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Refreshing instance network info cache due to event network-changed-e6acb053-8365-45b0-ac25-1f27f42162ff. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:18:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-03a08130-3795-4175-beea-a0f2634b9a0d req-73fcb11f-2995-4fff-ba05-90b8f2cf4903 service nova] Acquiring lock "refresh_cache-95c7da6a-c9a5-4441-9819-1219f7d6793f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:18:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-03a08130-3795-4175-beea-a0f2634b9a0d req-73fcb11f-2995-4fff-ba05-90b8f2cf4903 service nova] Acquired lock "refresh_cache-95c7da6a-c9a5-4441-9819-1219f7d6793f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:18:40 user nova-compute[72504]: DEBUG nova.network.neutron [req-03a08130-3795-4175-beea-a0f2634b9a0d req-73fcb11f-2995-4fff-ba05-90b8f2cf4903 service nova] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Refreshing network info cache for port e6acb053-8365-45b0-ac25-1f27f42162ff {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:18:41 user nova-compute[72504]: DEBUG nova.network.neutron [req-03a08130-3795-4175-beea-a0f2634b9a0d req-73fcb11f-2995-4fff-ba05-90b8f2cf4903 service nova] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Updated VIF entry in instance network info cache for port e6acb053-8365-45b0-ac25-1f27f42162ff. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:18:41 user nova-compute[72504]: DEBUG nova.network.neutron [req-03a08130-3795-4175-beea-a0f2634b9a0d req-73fcb11f-2995-4fff-ba05-90b8f2cf4903 service nova] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Updating instance_info_cache with network_info: [{"id": "e6acb053-8365-45b0-ac25-1f27f42162ff", "address": "fa:16:3e:01:7a:65", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acb053-83", "ovs_interfaceid": "e6acb053-8365-45b0-ac25-1f27f42162ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:18:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-03a08130-3795-4175-beea-a0f2634b9a0d req-73fcb11f-2995-4fff-ba05-90b8f2cf4903 service nova] Releasing lock "refresh_cache-95c7da6a-c9a5-4441-9819-1219f7d6793f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:18:41 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:18:41 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:18:41 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 20:18:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-a4f9c59c-cf0b-4216-a194-22712725328d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:18:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-a4f9c59c-cf0b-4216-a194-22712725328d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:18:42 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:18:42 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lazy-loading 'info_cache' on Instance uuid a4f9c59c-cf0b-4216-a194-22712725328d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:18:42 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Updating instance_info_cache with network_info: [{"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:18:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-a4f9c59c-cf0b-4216-a194-22712725328d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:18:42 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:18:42 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:18:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:18:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:18:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:18:42 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:18:42 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb3228ce-ea4b-4393-a7b4-2d401ad314de/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:18:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb3228ce-ea4b-4393-a7b4-2d401ad314de/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:18:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb3228ce-ea4b-4393-a7b4-2d401ad314de/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:18:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb3228ce-ea4b-4393-a7b4-2d401ad314de/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:18:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:18:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:18:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:18:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:18:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:18:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:18:43 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:18:43 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:18:43 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8608MB free_disk=25.22109603881836GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:18:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:18:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:18:44 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance a4f9c59c-cf0b-4216-a194-22712725328d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:18:44 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 95c7da6a-c9a5-4441-9819-1219f7d6793f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:18:44 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance bb3228ce-ea4b-4393-a7b4-2d401ad314de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:18:44 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:18:44 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:18:44 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:18:44 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:18:44 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:18:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:18:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:18:46 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:18:46 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:18:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:18:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:18:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "c642255e-6e48-4cdb-92da-4cb0b00e681e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:18:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "c642255e-6e48-4cdb-92da-4cb0b00e681e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:18:51 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 20:18:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:18:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:18:51 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:18:51 user nova-compute[72504]: INFO nova.compute.claims [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Claim successful on node user
Aug 01 20:18:52 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:18:52 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:18:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:18:52 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 20:18:52 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 20:18:52 user nova-compute[72504]: DEBUG nova.network.neutron [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 20:18:52 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 20:18:52 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 20:18:52 user nova-compute[72504]: INFO nova.virt.block_device [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Booting with volume bc00aab9-2531-4169-b248-f6dd6b935f78 at /dev/vda
Aug 01 20:18:52 user nova-compute[72504]: DEBUG nova.policy [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f06381c8a6214ddea7f1b36b623ed4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb59fbc2bf9749f3af7d56435cb37066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 20:18:52 user nova-compute[72504]: DEBUG os_brick.utils [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:18:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:18:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:18:52 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ff721c-353b-4113-9c70-94b768b8df60]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:18:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:18:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:18:52 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8ef5ac-d9ab-4d7e-9178-d64668f1f615]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:18:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:18:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:18:52 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2d60d2-aaa4-4204-9c16-eb5653638c7c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:18:52 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[713b222b-40aa-47eb-9aad-eb3e2b8c726b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:18:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:18:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:18:52 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:18:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:18:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:18:52 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:18:52 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1200624-9e8c-49ec-aa68-ccc4592b540c]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:18:52 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:18:52 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:18:52 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:18:52 user nova-compute[72504]: DEBUG os_brick.utils [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:18:52 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Updating existing volume attachment record: 72c0dced-0b3a-47e6-9d72-8eb747fa1561 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:18:52 user nova-compute[72504]: DEBUG nova.network.neutron [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Successfully created port: a3c2ebc3-ddd5-4f89-a355-f16ec71e3678 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 20:18:53 user nova-compute[72504]: DEBUG nova.network.neutron [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Successfully updated port: a3c2ebc3-ddd5-4f89-a355-f16ec71e3678 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 20:18:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "refresh_cache-c642255e-6e48-4cdb-92da-4cb0b00e681e" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:18:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquired lock "refresh_cache-c642255e-6e48-4cdb-92da-4cb0b00e681e" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:18:53 user nova-compute[72504]: DEBUG nova.network.neutron [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:18:53 user nova-compute[72504]: DEBUG nova.compute.manager [req-296887bf-46dd-4237-aae3-736f631d3dcf req-6ab51c31-3b32-42cb-bdfc-515bbf14e89c service nova] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Received event network-changed-a3c2ebc3-ddd5-4f89-a355-f16ec71e3678 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:18:53 user nova-compute[72504]: DEBUG nova.compute.manager [req-296887bf-46dd-4237-aae3-736f631d3dcf req-6ab51c31-3b32-42cb-bdfc-515bbf14e89c service nova] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Refreshing instance network info cache due to event network-changed-a3c2ebc3-ddd5-4f89-a355-f16ec71e3678. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:18:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-296887bf-46dd-4237-aae3-736f631d3dcf req-6ab51c31-3b32-42cb-bdfc-515bbf14e89c service nova] Acquiring lock "refresh_cache-c642255e-6e48-4cdb-92da-4cb0b00e681e" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:18:53 user nova-compute[72504]: DEBUG nova.network.neutron [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:18:54 user nova-compute[72504]: DEBUG nova.network.neutron [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Updating instance_info_cache with network_info: [{"id": "a3c2ebc3-ddd5-4f89-a355-f16ec71e3678", "address": "fa:16:3e:90:54:76", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c2ebc3-dd", "ovs_interfaceid": "a3c2ebc3-ddd5-4f89-a355-f16ec71e3678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:18:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Releasing lock "refresh_cache-c642255e-6e48-4cdb-92da-4cb0b00e681e" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:18:54 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Instance network_info: |[{"id": "a3c2ebc3-ddd5-4f89-a355-f16ec71e3678", "address": "fa:16:3e:90:54:76", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c2ebc3-dd", "ovs_interfaceid": "a3c2ebc3-ddd5-4f89-a355-f16ec71e3678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 20:18:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-296887bf-46dd-4237-aae3-736f631d3dcf req-6ab51c31-3b32-42cb-bdfc-515bbf14e89c service nova] Acquired lock "refresh_cache-c642255e-6e48-4cdb-92da-4cb0b00e681e" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:18:54 user nova-compute[72504]: DEBUG nova.network.neutron [req-296887bf-46dd-4237-aae3-736f631d3dcf req-6ab51c31-3b32-42cb-bdfc-515bbf14e89c service nova] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Refreshing network info cache for port a3c2ebc3-ddd5-4f89-a355-f16ec71e3678 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:18:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:18:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:18:54 user nova-compute[72504]: DEBUG nova.network.neutron [req-296887bf-46dd-4237-aae3-736f631d3dcf req-6ab51c31-3b32-42cb-bdfc-515bbf14e89c service nova] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Updated VIF entry in instance network info cache for port a3c2ebc3-ddd5-4f89-a355-f16ec71e3678. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:18:54 user nova-compute[72504]: DEBUG nova.network.neutron [req-296887bf-46dd-4237-aae3-736f631d3dcf req-6ab51c31-3b32-42cb-bdfc-515bbf14e89c service nova] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Updating instance_info_cache with network_info: [{"id": "a3c2ebc3-ddd5-4f89-a355-f16ec71e3678", "address": "fa:16:3e:90:54:76", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c2ebc3-dd", "ovs_interfaceid": "a3c2ebc3-ddd5-4f89-a355-f16ec71e3678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:18:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-296887bf-46dd-4237-aae3-736f631d3dcf req-6ab51c31-3b32-42cb-bdfc-515bbf14e89c service nova] Releasing lock "refresh_cache-c642255e-6e48-4cdb-92da-4cb0b00e681e" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:18:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:18:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:18:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:19:00 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Creating image(s)
Aug 01 20:19:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Did not create local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Ensure instance console log exists: /opt/stack/data/nova/instances/c642255e-6e48-4cdb-92da-4cb0b00e681e/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Start _get_guest_xml network_info=[{"id": "a3c2ebc3-ddd5-4f89-a355-f16ec71e3678", "address": "fa:16:3e:90:54:76", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c2ebc3-dd", "ovs_interfaceid": "a3c2ebc3-ddd5-4f89-a355-f16ec71e3678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIyYpQuM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c642255e-6e48-4cdb-92da-4cb0b00e681e', 'attached_at': '', 'detached_at': '', 'volume_id': 'bc00aab9-2531-4169-b248-f6dd6b935f78', 'serial': 'bc00aab9-2531-4169-b248-f6dd6b935f78'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': '72c0dced-0b3a-47e6-9d72-8eb747fa1561', 'volume_type': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:19:00 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:19:00 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:19:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIyYpQuM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:19:00 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:19:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:19:00 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:19:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:19:00 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3592dc2-7f74-4d08-a442-72a02baab9ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:19:00 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de4e223-fca0-4207-bf59-6ab9bf1269a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78] added
Aug 01 20:19:00 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afc74a7-7f5e-4f8e-a6fb-11260152ac10]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49c19d7-00dc-4758-9592-d9f36649d971]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIyYpQuM {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIyYpQuM" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b55304c-1b6e-4aa3-8d5d-0bad36445455]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zIyYpQuM'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[196a3349-d444-4857-a25a-611e8cd30ae3]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5e13a4-d7f1-451d-885e-44134999dfcf]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:19:00 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:19:00 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15c3ca1-7d08-4d80-8043-4d5d659992c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78, portal: 172.16.0.220,3260]
Aug 01 20:19:00 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78, portal: 172.16.0.220,3260] successful.
Aug 01 20:19:00 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcd6b71-9e8d-4e0a-9e48-170b87aa426b]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ee634c-a41b-4671-8afb-5e34b9873ef6]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:19:00 user nova-compute[72504]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 (non-flash)
Aug 01 20:19:00 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:19:00 user nova-compute[72504]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 (non-flash)
Aug 01 20:19:00 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab21f0e-5ece-42fa-a464-74d5c37d5ea1]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG nova.compute.manager [req-d0cba5ba-c9ba-4631-a52d-ad5c3b522929 req-e4b636fb-4fb9-497e-a304-373a780b1bf9 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Received event network-changed-ba94e20c-dd80-4acb-a307-0ed565731890 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG nova.compute.manager [req-d0cba5ba-c9ba-4631-a52d-ad5c3b522929 req-e4b636fb-4fb9-497e-a304-373a780b1bf9 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Refreshing instance network info cache due to event network-changed-ba94e20c-dd80-4acb-a307-0ed565731890. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d0cba5ba-c9ba-4631-a52d-ad5c3b522929 req-e4b636fb-4fb9-497e-a304-373a780b1bf9 service nova] Acquiring lock "refresh_cache-bb3228ce-ea4b-4393-a7b4-2d401ad314de" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d0cba5ba-c9ba-4631-a52d-ad5c3b522929 req-e4b636fb-4fb9-497e-a304-373a780b1bf9 service nova] Acquired lock "refresh_cache-bb3228ce-ea4b-4393-a7b4-2d401ad314de" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:19:00 user nova-compute[72504]: DEBUG nova.network.neutron [req-d0cba5ba-c9ba-4631-a52d-ad5c3b522929 req-e4b636fb-4fb9-497e-a304-373a780b1bf9 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Refreshing network info cache for port ba94e20c-dd80-4acb-a307-0ed565731890 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:19:01 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:19:01 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIyYpQuM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:19:01 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:19:01 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23266346166373166', 'path': '/dev/sdb'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:19:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266346166373166', 'path': '/dev/sdb'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:19:01 user nova-compute[72504]: DEBUG nova.network.neutron [req-d0cba5ba-c9ba-4631-a52d-ad5c3b522929 req-e4b636fb-4fb9-497e-a304-373a780b1bf9 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Updated VIF entry in instance network info cache for port ba94e20c-dd80-4acb-a307-0ed565731890. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:19:01 user nova-compute[72504]: DEBUG nova.network.neutron [req-d0cba5ba-c9ba-4631-a52d-ad5c3b522929 req-e4b636fb-4fb9-497e-a304-373a780b1bf9 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Updating instance_info_cache with network_info: [{"id": "ba94e20c-dd80-4acb-a307-0ed565731890", "address": "fa:16:3e:f9:35:24", "network": {"id": "ec191814-d9f8-4a40-a775-07b50423cec5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1317992461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf6047793ecc44519667cf55e090296e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba94e20c-dd", "ovs_interfaceid": "ba94e20c-dd80-4acb-a307-0ed565731890", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:19:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:18:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-933250371',display_name='tempest-TestVolumeBootPattern-server-933250371',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-933250371',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrKan85Goqo8Jv0VkDYyshQTMQ59f3rUyYronrtEBxVKZjCUMR9BmiZNw9TY8Sa/UvzfiwIaZSAr04+rYB06rxcAkBTQWOBWsdwofE2ksnZ+I8hLlgBMpWvgtrRSAHuwA==',key_name='tempest-TestVolumeBootPattern-1138255315',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb59fbc2bf9749f3af7d56435cb37066',ramdisk_id='',reservation_id='r-d1z4gcmn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-685885098',owner_user_name='tempest-TestVolumeBootPattern-685885098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:18:52Z,user_data=None,user_id='f06381c8a6214ddea7f1b36b623ed4d5',uuid=c642255e-6e48-4cdb-92da-4cb0b00e681e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3c2ebc3-ddd5-4f89-a355-f16ec71e3678", "address": "fa:16:3e:90:54:76", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c2ebc3-dd", "ovs_interfaceid": "a3c2ebc3-ddd5-4f89-a355-f16ec71e3678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:19:01 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converting VIF {"id": "a3c2ebc3-ddd5-4f89-a355-f16ec71e3678", "address": "fa:16:3e:90:54:76", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c2ebc3-dd", "ovs_interfaceid": "a3c2ebc3-ddd5-4f89-a355-f16ec71e3678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:19:01 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:54:76,bridge_name='br-int',has_traffic_filtering=True,id=a3c2ebc3-ddd5-4f89-a355-f16ec71e3678,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c2ebc3-dd') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:19:01 user nova-compute[72504]: DEBUG nova.objects.instance [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lazy-loading 'pci_devices' on Instance uuid c642255e-6e48-4cdb-92da-4cb0b00e681e {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:19:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d0cba5ba-c9ba-4631-a52d-ad5c3b522929 req-e4b636fb-4fb9-497e-a304-373a780b1bf9 service nova] Releasing lock "refresh_cache-bb3228ce-ea4b-4393-a7b4-2d401ad314de" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:19:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:19:01 user nova-compute[72504]:   <uuid>c642255e-6e48-4cdb-92da-4cb0b00e681e</uuid>
Aug 01 20:19:01 user nova-compute[72504]:   <name>instance-0000002c</name>
Aug 01 20:19:01 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:19:01 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:19:01 user nova-compute[72504]:   <metadata>
Aug 01 20:19:01 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:19:01 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:19:01 user nova-compute[72504]:       <nova:name>tempest-TestVolumeBootPattern-server-933250371</nova:name>
Aug 01 20:19:01 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:19:00</nova:creationTime>
Aug 01 20:19:01 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:19:01 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:19:01 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:19:01 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:19:01 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:19:01 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:19:01 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:19:01 user nova-compute[72504]:       <nova:owner>
Aug 01 20:19:01 user nova-compute[72504]:         <nova:user uuid="f06381c8a6214ddea7f1b36b623ed4d5">tempest-TestVolumeBootPattern-685885098-project-member</nova:user>
Aug 01 20:19:01 user nova-compute[72504]:         <nova:project uuid="eb59fbc2bf9749f3af7d56435cb37066">tempest-TestVolumeBootPattern-685885098</nova:project>
Aug 01 20:19:01 user nova-compute[72504]:       </nova:owner>
Aug 01 20:19:01 user nova-compute[72504]:       <nova:ports>
Aug 01 20:19:01 user nova-compute[72504]:         <nova:port uuid="a3c2ebc3-ddd5-4f89-a355-f16ec71e3678">
Aug 01 20:19:01 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 20:19:01 user nova-compute[72504]:         </nova:port>
Aug 01 20:19:01 user nova-compute[72504]:       </nova:ports>
Aug 01 20:19:01 user nova-compute[72504]:     </nova:instance>
Aug 01 20:19:01 user nova-compute[72504]:   </metadata>
Aug 01 20:19:01 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:19:01 user nova-compute[72504]:     <system>
Aug 01 20:19:01 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:19:01 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:19:01 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:19:01 user nova-compute[72504]:       <entry name="serial">c642255e-6e48-4cdb-92da-4cb0b00e681e</entry>
Aug 01 20:19:01 user nova-compute[72504]:       <entry name="uuid">c642255e-6e48-4cdb-92da-4cb0b00e681e</entry>
Aug 01 20:19:01 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:19:01 user nova-compute[72504]:     </system>
Aug 01 20:19:01 user nova-compute[72504]:   </sysinfo>
Aug 01 20:19:01 user nova-compute[72504]:   <os>
Aug 01 20:19:01 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:19:01 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:19:01 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:19:01 user nova-compute[72504]:   </os>
Aug 01 20:19:01 user nova-compute[72504]:   <features>
Aug 01 20:19:01 user nova-compute[72504]:     <acpi/>
Aug 01 20:19:01 user nova-compute[72504]:     <apic/>
Aug 01 20:19:01 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:19:01 user nova-compute[72504]:   </features>
Aug 01 20:19:01 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:19:01 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:19:01 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:19:01 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:19:01 user nova-compute[72504]:   </clock>
Aug 01 20:19:01 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:19:01 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:19:01 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:19:01 user nova-compute[72504]:   </cpu>
Aug 01 20:19:01 user nova-compute[72504]:   <devices>
Aug 01 20:19:01 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 20:19:01 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:19:01 user nova-compute[72504]:       <source dev="/dev/sdb"/>
Aug 01 20:19:01 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:19:01 user nova-compute[72504]:       <serial>bc00aab9-2531-4169-b248-f6dd6b935f78</serial>
Aug 01 20:19:01 user nova-compute[72504]:     </disk>
Aug 01 20:19:01 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:19:01 user nova-compute[72504]:       <mac address="fa:16:3e:90:54:76"/>
Aug 01 20:19:01 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:19:01 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:19:01 user nova-compute[72504]:       <target dev="tapa3c2ebc3-dd"/>
Aug 01 20:19:01 user nova-compute[72504]:     </interface>
Aug 01 20:19:01 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:19:01 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/c642255e-6e48-4cdb-92da-4cb0b00e681e/console.log" append="off"/>
Aug 01 20:19:01 user nova-compute[72504]:     </serial>
Aug 01 20:19:01 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:19:01 user nova-compute[72504]:     <video>
Aug 01 20:19:01 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:19:01 user nova-compute[72504]:     </video>
Aug 01 20:19:01 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:19:01 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:19:01 user nova-compute[72504]:     </rng>
Aug 01 20:19:01 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:19:01 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:19:01 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:19:01 user nova-compute[72504]:     </memballoon>
Aug 01 20:19:01 user nova-compute[72504]:   </devices>
Aug 01 20:19:01 user nova-compute[72504]: </domain>
Aug 01 20:19:01 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:19:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:18:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-933250371',display_name='tempest-TestVolumeBootPattern-server-933250371',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-933250371',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrKan85Goqo8Jv0VkDYyshQTMQ59f3rUyYronrtEBxVKZjCUMR9BmiZNw9TY8Sa/UvzfiwIaZSAr04+rYB06rxcAkBTQWOBWsdwofE2ksnZ+I8hLlgBMpWvgtrRSAHuwA==',key_name='tempest-TestVolumeBootPattern-1138255315',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb59fbc2bf9749f3af7d56435cb37066',ramdisk_id='',reservation_id='r-d1z4gcmn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-685885098',owner_user_name='tempest-TestVolumeBootPattern-685885098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:18:52Z,user_data=None,user_id='f06381c8a6214ddea7f1b36b623ed4d5',uuid=c642255e-6e48-4cdb-92da-4cb0b00e681e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3c2ebc3-ddd5-4f89-a355-f16ec71e3678", "address": "fa:16:3e:90:54:76", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c2ebc3-dd", "ovs_interfaceid": "a3c2ebc3-ddd5-4f89-a355-f16ec71e3678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:19:01 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converting VIF {"id": "a3c2ebc3-ddd5-4f89-a355-f16ec71e3678", "address": "fa:16:3e:90:54:76", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c2ebc3-dd", "ovs_interfaceid": "a3c2ebc3-ddd5-4f89-a355-f16ec71e3678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:19:01 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:54:76,bridge_name='br-int',has_traffic_filtering=True,id=a3c2ebc3-ddd5-4f89-a355-f16ec71e3678,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c2ebc3-dd') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:19:01 user nova-compute[72504]: DEBUG os_vif [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:54:76,bridge_name='br-int',has_traffic_filtering=True,id=a3c2ebc3-ddd5-4f89-a355-f16ec71e3678,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c2ebc3-dd') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:19:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:19:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:19:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3c2ebc3-dd, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:19:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa3c2ebc3-dd, col_values=(('external_ids', {'iface-id': 'a3c2ebc3-ddd5-4f89-a355-f16ec71e3678', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:54:76', 'vm-uuid': 'c642255e-6e48-4cdb-92da-4cb0b00e681e'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:19:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:19:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:01 user nova-compute[72504]: INFO os_vif [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:54:76,bridge_name='br-int',has_traffic_filtering=True,id=a3c2ebc3-ddd5-4f89-a355-f16ec71e3678,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c2ebc3-dd')
Aug 01 20:19:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:19:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] No VIF found with MAC fa:16:3e:90:54:76, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:19:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:19:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:19:02 user nova-compute[72504]: DEBUG nova.objects.instance [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lazy-loading 'flavor' on Instance uuid bb3228ce-ea4b-4393-a7b4-2d401ad314de {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:19:02 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Ignoring supplied device name: /dev/vdb
Aug 01 20:19:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:19:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:19:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:19:02 user nova-compute[72504]: INFO nova.compute.manager [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Attaching volume 690dc847-b4c1-494d-b89c-ec5121c03785 to /dev/vdb
Aug 01 20:19:02 user nova-compute[72504]: DEBUG os_brick.utils [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:19:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:02 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eaa92e5-f424-4f91-a7ac-b70b9a96ce8a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:02 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8050b6c-fff9-49bb-9d82-95dcd414ade3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:02 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d748fd2-6b9f-499d-ab23-83733a7a59cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:02 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7375c3c0-f10f-44de-bf34-fa14b3be5772]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:19:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:19:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:19:02 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:19:02 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf67450-7583-471a-b462-be0db8f24301]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:19:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:19:02 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:19:02 user nova-compute[72504]: DEBUG os_brick.utils [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:19:02 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Updating existing volume attachment record: 7cf7e2c6-ffed-4f11-88b5-83f0e3c90f00 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:19:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-02645656-b2c8-4ff8-992d-87af82c9cec9 req-21a66f02-f761-4462-aeac-ffa9b7e47523 service nova] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Received event network-vif-plugged-a3c2ebc3-ddd5-4f89-a355-f16ec71e3678 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:19:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-02645656-b2c8-4ff8-992d-87af82c9cec9 req-21a66f02-f761-4462-aeac-ffa9b7e47523 service nova] Acquiring lock "c642255e-6e48-4cdb-92da-4cb0b00e681e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:19:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-02645656-b2c8-4ff8-992d-87af82c9cec9 req-21a66f02-f761-4462-aeac-ffa9b7e47523 service nova] Lock "c642255e-6e48-4cdb-92da-4cb0b00e681e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:19:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-02645656-b2c8-4ff8-992d-87af82c9cec9 req-21a66f02-f761-4462-aeac-ffa9b7e47523 service nova] Lock "c642255e-6e48-4cdb-92da-4cb0b00e681e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:19:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-02645656-b2c8-4ff8-992d-87af82c9cec9 req-21a66f02-f761-4462-aeac-ffa9b7e47523 service nova] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] No waiting events found dispatching network-vif-plugged-a3c2ebc3-ddd5-4f89-a355-f16ec71e3678 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:19:03 user nova-compute[72504]: WARNING nova.compute.manager [req-02645656-b2c8-4ff8-992d-87af82c9cec9 req-21a66f02-f761-4462-aeac-ffa9b7e47523 service nova] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Received unexpected event network-vif-plugged-a3c2ebc3-ddd5-4f89-a355-f16ec71e3678 for instance with vm_state building and task_state spawning.
Aug 01 20:19:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:05 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690921145.2575557, c642255e-6e48-4cdb-92da-4cb0b00e681e => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:19:05 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] VM Resumed (Lifecycle Event)
Aug 01 20:19:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:19:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:19:05 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Instance spawned successfully.
Aug 01 20:19:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 20:19:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:19:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:19:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:19:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:19:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:19:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:19:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:19:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:19:05 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:19:05 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690921145.2645676, c642255e-6e48-4cdb-92da-4cb0b00e681e => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:19:05 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] VM Started (Lifecycle Event)
Aug 01 20:19:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:19:05 user nova-compute[72504]: DEBUG nova.compute.manager [req-cb070d17-de2b-47b1-81b9-4c2eb937f07e req-8dd1171a-0209-4ac6-ad46-ae90095c107f service nova] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Received event network-vif-plugged-a3c2ebc3-ddd5-4f89-a355-f16ec71e3678 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:19:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cb070d17-de2b-47b1-81b9-4c2eb937f07e req-8dd1171a-0209-4ac6-ad46-ae90095c107f service nova] Acquiring lock "c642255e-6e48-4cdb-92da-4cb0b00e681e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:19:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cb070d17-de2b-47b1-81b9-4c2eb937f07e req-8dd1171a-0209-4ac6-ad46-ae90095c107f service nova] Lock "c642255e-6e48-4cdb-92da-4cb0b00e681e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:19:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cb070d17-de2b-47b1-81b9-4c2eb937f07e req-8dd1171a-0209-4ac6-ad46-ae90095c107f service nova] Lock "c642255e-6e48-4cdb-92da-4cb0b00e681e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:19:05 user nova-compute[72504]: DEBUG nova.compute.manager [req-cb070d17-de2b-47b1-81b9-4c2eb937f07e req-8dd1171a-0209-4ac6-ad46-ae90095c107f service nova] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] No waiting events found dispatching network-vif-plugged-a3c2ebc3-ddd5-4f89-a355-f16ec71e3678 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:19:05 user nova-compute[72504]: WARNING nova.compute.manager [req-cb070d17-de2b-47b1-81b9-4c2eb937f07e req-8dd1171a-0209-4ac6-ad46-ae90095c107f service nova] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Received unexpected event network-vif-plugged-a3c2ebc3-ddd5-4f89-a355-f16ec71e3678 for instance with vm_state building and task_state spawning.
Aug 01 20:19:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:19:05 user nova-compute[72504]: INFO nova.compute.manager [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Took 5.38 seconds to spawn the instance on the hypervisor.
Aug 01 20:19:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:19:05 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:19:05 user nova-compute[72504]: INFO nova.compute.manager [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Took 13.62 seconds to build instance.
Aug 01 20:19:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-1c31946c-fb7e-435a-8188-e55a49e977a2 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "c642255e-6e48-4cdb-92da-4cb0b00e681e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.840s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:19:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:19:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:19:08 user nova-compute[72504]: DEBUG nova.compute.manager [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 20:19:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:19:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:19:08 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:19:08 user nova-compute[72504]: INFO nova.compute.claims [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Claim successful on node user
Aug 01 20:19:08 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:19:08 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:19:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.298s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:19:08 user nova-compute[72504]: DEBUG nova.compute.manager [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 20:19:08 user nova-compute[72504]: DEBUG nova.compute.manager [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 20:19:08 user nova-compute[72504]: DEBUG nova.network.neutron [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 20:19:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:08 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 20:19:08 user nova-compute[72504]: DEBUG nova.compute.manager [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 20:19:08 user nova-compute[72504]: DEBUG nova.policy [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0015fa066434b679e0126a916f96393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d4446b451947be88bc15a1a938b859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 20:19:08 user nova-compute[72504]: DEBUG nova.compute.manager [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 20:19:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:19:08 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Creating image(s)
Aug 01 20:19:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "/opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:19:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "/opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:19:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "/opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:19:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "805772ebaa4e793259cc11807c8fdb7b5f4dfd9c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:19:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "805772ebaa4e793259cc11807c8fdb7b5f4dfd9c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:19:09 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/805772ebaa4e793259cc11807c8fdb7b5f4dfd9c.part --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:09 user nova-compute[72504]: DEBUG nova.network.neutron [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Successfully created port: bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 20:19:09 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/805772ebaa4e793259cc11807c8fdb7b5f4dfd9c.part --force-share --output=json" returned: 0 in 0.155s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:09 user nova-compute[72504]: DEBUG nova.virt.images [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] 82aacf83-218b-493c-9327-6c737b4deaba was qcow2, converting to raw {{(pid=72504) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 20:19:09 user nova-compute[72504]: DEBUG nova.privsep.utils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72504) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 20:19:09 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/805772ebaa4e793259cc11807c8fdb7b5f4dfd9c.part /opt/stack/data/nova/instances/_base/805772ebaa4e793259cc11807c8fdb7b5f4dfd9c.converted {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/805772ebaa4e793259cc11807c8fdb7b5f4dfd9c.part /opt/stack/data/nova/instances/_base/805772ebaa4e793259cc11807c8fdb7b5f4dfd9c.converted" returned: 0 in 0.281s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/805772ebaa4e793259cc11807c8fdb7b5f4dfd9c.converted --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/805772ebaa4e793259cc11807c8fdb7b5f4dfd9c.converted --force-share --output=json" returned: 0 in 0.153s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "805772ebaa4e793259cc11807c8fdb7b5f4dfd9c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.303s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/805772ebaa4e793259cc11807c8fdb7b5f4dfd9c --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/805772ebaa4e793259cc11807c8fdb7b5f4dfd9c --force-share --output=json" returned: 0 in 0.174s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "805772ebaa4e793259cc11807c8fdb7b5f4dfd9c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "805772ebaa4e793259cc11807c8fdb7b5f4dfd9c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/805772ebaa4e793259cc11807c8fdb7b5f4dfd9c --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG nova.network.neutron [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Successfully updated port: bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "refresh_cache-2caaa9dd-e1fd-465b-95a0-78fa51c96c15" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquired lock "refresh_cache-2caaa9dd-e1fd-465b-95a0-78fa51c96c15" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG nova.network.neutron [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG nova.compute.manager [req-ab7d7d37-e57d-43b6-a62f-d0a4ce12c279 req-3c3b0866-af79-41cd-b457-4f688346662a service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Received event network-changed-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG nova.compute.manager [req-ab7d7d37-e57d-43b6-a62f-d0a4ce12c279 req-3c3b0866-af79-41cd-b457-4f688346662a service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Refreshing instance network info cache due to event network-changed-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ab7d7d37-e57d-43b6-a62f-d0a4ce12c279 req-3c3b0866-af79-41cd-b457-4f688346662a service nova] Acquiring lock "refresh_cache-2caaa9dd-e1fd-465b-95a0-78fa51c96c15" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/805772ebaa4e793259cc11807c8fdb7b5f4dfd9c --force-share --output=json" returned: 0 in 0.148s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/805772ebaa4e793259cc11807c8fdb7b5f4dfd9c,backing_fmt=raw /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG nova.network.neutron [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/805772ebaa4e793259cc11807c8fdb7b5f4dfd9c,backing_fmt=raw /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk 1073741824" returned: 0 in 0.064s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "805772ebaa4e793259cc11807c8fdb7b5f4dfd9c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/805772ebaa4e793259cc11807c8fdb7b5f4dfd9c --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxwzEVaD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:19:10 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:19:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:19:10 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:19:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:19:10 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[daad01cb-74b4-4361-a4ce-7350e3609a72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:19:10 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[007a4710-641c-4bb8-a23a-244312a51769]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785] added
Aug 01 20:19:10 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e188d7dc-de65-47da-bf47-29b6a5cfd35c]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2125a225-f80a-417b-92e5-438203b7b311]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kxwzEVaD {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/805772ebaa4e793259cc11807c8fdb7b5f4dfd9c --force-share --output=json" returned: 0 in 0.183s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kxwzEVaD" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8c7acc-ac8c-4ae1-ac4f-68b61a817cae]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kxwzEVaD'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2954f80d-c362-4f22-ace9-0e46ec1b7865]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40f1428-002f-414a-9d2e-0bb2beb35dab]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:19:10 user nova-compute[72504]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 (non-flash)
Aug 01 20:19:10 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:19:10 user nova-compute[72504]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 (non-flash)
Aug 01 20:19:10 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG nova.network.neutron [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Updating instance_info_cache with network_info: [{"id": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "address": "fa:16:3e:4e:0e:3d", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6cbd7a-88", "ovs_interfaceid": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Cannot resize image /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG nova.objects.instance [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lazy-loading 'migration_context' on Instance uuid 2caaa9dd-e1fd-465b-95a0-78fa51c96c15 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Releasing lock "refresh_cache-2caaa9dd-e1fd-465b-95a0-78fa51c96c15" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG nova.compute.manager [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Instance network_info: |[{"id": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "address": "fa:16:3e:4e:0e:3d", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6cbd7a-88", "ovs_interfaceid": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ab7d7d37-e57d-43b6-a62f-d0a4ce12c279 req-3c3b0866-af79-41cd-b457-4f688346662a service nova] Acquired lock "refresh_cache-2caaa9dd-e1fd-465b-95a0-78fa51c96c15" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG nova.network.neutron [req-ab7d7d37-e57d-43b6-a62f-d0a4ce12c279 req-3c3b0866-af79-41cd-b457-4f688346662a service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Refreshing network info cache for port bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Ensure instance console log exists: /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Start _get_guest_xml network_info=[{"id": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "address": "fa:16:3e:4e:0e:3d", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6cbd7a-88", "ovs_interfaceid": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T20:19:05Z,direct_url=<?>,disk_format='qcow2',id=82aacf83-218b-493c-9327-6c737b4deaba,min_disk=0,min_ram=0,name='tempest-scenario-img--1869029504',owner='72d4446b451947be88bc15a1a938b859',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T20:19:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '82aacf83-218b-493c-9327-6c737b4deaba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eeb6505-5d26-4b78-8705-7a25967eb346]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785, portal: 172.16.0.220,3260]
Aug 01 20:19:10 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785, portal: 172.16.0.220,3260] successful.
Aug 01 20:19:10 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:19:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:11 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:19:11 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:19:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T20:19:05Z,direct_url=<?>,disk_format='qcow2',id=82aacf83-218b-493c-9327-6c737b4deaba,min_disk=0,min_ram=0,name='tempest-scenario-img--1869029504',owner='72d4446b451947be88bc15a1a938b859',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T20:19:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:19:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1596056108',display_name='tempest-TestMinimumBasicScenario-server-1596056108',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1596056108',id=45,image_ref='82aacf83-218b-493c-9327-6c737b4deaba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfv0+Sv8YQSyFEhS1Mp0+BN3XoNdJsAd9DgP/q9A7Z1pq/KksnP1DUgnH5iZS5TDMZKNXkrXPfXBcsLb8arVe7V1dL2QRX9XChORu7HtUkKOV7MNd0UdfUtOONBLaIw6w==',key_name='tempest-TestMinimumBasicScenario-311143372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72d4446b451947be88bc15a1a938b859',ramdisk_id='',reservation_id='r-2fmlhn1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='82aacf83-218b-493c-9327-6c737b4deaba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-869578324',owner_user_name='tempest-TestMinimumBasicScenario-869578324-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:19:09Z,user_data=None,user_id='c0015fa066434b679e0126a916f96393',uuid=2caaa9dd-e1fd-465b-95a0-78fa51c96c15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "address": "fa:16:3e:4e:0e:3d", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6cbd7a-88", "ovs_interfaceid": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Converting VIF {"id": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "address": "fa:16:3e:4e:0e:3d", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6cbd7a-88", "ovs_interfaceid": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:0e:3d,bridge_name='br-int',has_traffic_filtering=True,id=bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7,network=Network(786ed785-b5d5-43d6-b39e-3d8c490dc3f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6cbd7a-88') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG nova.objects.instance [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lazy-loading 'pci_devices' on Instance uuid 2caaa9dd-e1fd-465b-95a0-78fa51c96c15 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bcc456-4d0b-412a-8b3e-ee1e60192374]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:19:11 user nova-compute[72504]:   <uuid>2caaa9dd-e1fd-465b-95a0-78fa51c96c15</uuid>
Aug 01 20:19:11 user nova-compute[72504]:   <name>instance-0000002d</name>
Aug 01 20:19:11 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:19:11 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:19:11 user nova-compute[72504]:   <metadata>
Aug 01 20:19:11 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:19:11 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:19:11 user nova-compute[72504]:       <nova:name>tempest-TestMinimumBasicScenario-server-1596056108</nova:name>
Aug 01 20:19:11 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:19:11</nova:creationTime>
Aug 01 20:19:11 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:19:11 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:19:11 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:19:11 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:19:11 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:19:11 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:19:11 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:19:11 user nova-compute[72504]:       <nova:owner>
Aug 01 20:19:11 user nova-compute[72504]:         <nova:user uuid="c0015fa066434b679e0126a916f96393">tempest-TestMinimumBasicScenario-869578324-project-member</nova:user>
Aug 01 20:19:11 user nova-compute[72504]:         <nova:project uuid="72d4446b451947be88bc15a1a938b859">tempest-TestMinimumBasicScenario-869578324</nova:project>
Aug 01 20:19:11 user nova-compute[72504]:       </nova:owner>
Aug 01 20:19:11 user nova-compute[72504]:       <nova:root type="image" uuid="82aacf83-218b-493c-9327-6c737b4deaba"/>
Aug 01 20:19:11 user nova-compute[72504]:       <nova:ports>
Aug 01 20:19:11 user nova-compute[72504]:         <nova:port uuid="bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7">
Aug 01 20:19:11 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 20:19:11 user nova-compute[72504]:         </nova:port>
Aug 01 20:19:11 user nova-compute[72504]:       </nova:ports>
Aug 01 20:19:11 user nova-compute[72504]:     </nova:instance>
Aug 01 20:19:11 user nova-compute[72504]:   </metadata>
Aug 01 20:19:11 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:19:11 user nova-compute[72504]:     <system>
Aug 01 20:19:11 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:19:11 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:19:11 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:19:11 user nova-compute[72504]:       <entry name="serial">2caaa9dd-e1fd-465b-95a0-78fa51c96c15</entry>
Aug 01 20:19:11 user nova-compute[72504]:       <entry name="uuid">2caaa9dd-e1fd-465b-95a0-78fa51c96c15</entry>
Aug 01 20:19:11 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:19:11 user nova-compute[72504]:     </system>
Aug 01 20:19:11 user nova-compute[72504]:   </sysinfo>
Aug 01 20:19:11 user nova-compute[72504]:   <os>
Aug 01 20:19:11 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:19:11 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:19:11 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:19:11 user nova-compute[72504]:   </os>
Aug 01 20:19:11 user nova-compute[72504]:   <features>
Aug 01 20:19:11 user nova-compute[72504]:     <acpi/>
Aug 01 20:19:11 user nova-compute[72504]:     <apic/>
Aug 01 20:19:11 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:19:11 user nova-compute[72504]:   </features>
Aug 01 20:19:11 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:19:11 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:19:11 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:19:11 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:19:11 user nova-compute[72504]:   </clock>
Aug 01 20:19:11 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:19:11 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:19:11 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:19:11 user nova-compute[72504]:   </cpu>
Aug 01 20:19:11 user nova-compute[72504]:   <devices>
Aug 01 20:19:11 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 20:19:11 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 20:19:11 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk"/>
Aug 01 20:19:11 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:19:11 user nova-compute[72504]:     </disk>
Aug 01 20:19:11 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:19:11 user nova-compute[72504]:       <mac address="fa:16:3e:4e:0e:3d"/>
Aug 01 20:19:11 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:19:11 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:19:11 user nova-compute[72504]:       <target dev="tapbb6cbd7a-88"/>
Aug 01 20:19:11 user nova-compute[72504]:     </interface>
Aug 01 20:19:11 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:19:11 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/console.log" append="off"/>
Aug 01 20:19:11 user nova-compute[72504]:     </serial>
Aug 01 20:19:11 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:19:11 user nova-compute[72504]:     <video>
Aug 01 20:19:11 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:19:11 user nova-compute[72504]:     </video>
Aug 01 20:19:11 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:19:11 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:19:11 user nova-compute[72504]:     </rng>
Aug 01 20:19:11 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:19:11 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:19:11 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:19:11 user nova-compute[72504]:     </memballoon>
Aug 01 20:19:11 user nova-compute[72504]:   </devices>
Aug 01 20:19:11 user nova-compute[72504]: </domain>
Aug 01 20:19:11 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:19:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1596056108',display_name='tempest-TestMinimumBasicScenario-server-1596056108',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1596056108',id=45,image_ref='82aacf83-218b-493c-9327-6c737b4deaba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfv0+Sv8YQSyFEhS1Mp0+BN3XoNdJsAd9DgP/q9A7Z1pq/KksnP1DUgnH5iZS5TDMZKNXkrXPfXBcsLb8arVe7V1dL2QRX9XChORu7HtUkKOV7MNd0UdfUtOONBLaIw6w==',key_name='tempest-TestMinimumBasicScenario-311143372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72d4446b451947be88bc15a1a938b859',ramdisk_id='',reservation_id='r-2fmlhn1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='82aacf83-218b-493c-9327-6c737b4deaba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-869578324',owner_user_name='tempest-TestMinimumBasicScenario-869578324-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:19:09Z,user_data=None,user_id='c0015fa066434b679e0126a916f96393',uuid=2caaa9dd-e1fd-465b-95a0-78fa51c96c15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "address": "fa:16:3e:4e:0e:3d", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6cbd7a-88", "ovs_interfaceid": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Converting VIF {"id": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "address": "fa:16:3e:4e:0e:3d", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6cbd7a-88", "ovs_interfaceid": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:0e:3d,bridge_name='br-int',has_traffic_filtering=True,id=bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7,network=Network(786ed785-b5d5-43d6-b39e-3d8c490dc3f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6cbd7a-88') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG os_vif [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:0e:3d,bridge_name='br-int',has_traffic_filtering=True,id=bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7,network=Network(786ed785-b5d5-43d6-b39e-3d8c490dc3f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6cbd7a-88') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[144baa34-77bc-48e7-a168-1027f1ca6e2b]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:19:11 user nova-compute[72504]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 (non-flash)
Aug 01 20:19:11 user nova-compute[72504]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785 (non-flash)
Aug 01 20:19:11 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:19:11 user nova-compute[72504]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 (non-flash)
Aug 01 20:19:11 user nova-compute[72504]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785 (non-flash)
Aug 01 20:19:11 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb6cbd7a-88, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbb6cbd7a-88, col_values=(('external_ids', {'iface-id': 'bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:0e:3d', 'vm-uuid': '2caaa9dd-e1fd-465b-95a0-78fa51c96c15'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2217dbb-08f7-46a5-bfed-9aac4ed0552a]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxwzEVaD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:11 user nova-compute[72504]: INFO os_vif [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:0e:3d,bridge_name='br-int',has_traffic_filtering=True,id=bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7,network=Network(786ed785-b5d5-43d6-b39e-3d8c490dc3f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6cbd7a-88')
Aug 01 20:19:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] No VIF found with MAC fa:16:3e:4e:0e:3d, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG nova.network.neutron [req-ab7d7d37-e57d-43b6-a62f-d0a4ce12c279 req-3c3b0866-af79-41cd-b457-4f688346662a service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Updated VIF entry in instance network info cache for port bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG nova.network.neutron [req-ab7d7d37-e57d-43b6-a62f-d0a4ce12c279 req-3c3b0866-af79-41cd-b457-4f688346662a service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Updating instance_info_cache with network_info: [{"id": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "address": "fa:16:3e:4e:0e:3d", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6cbd7a-88", "ovs_interfaceid": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:19:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ab7d7d37-e57d-43b6-a62f-d0a4ce12c279 req-3c3b0866-af79-41cd-b457-4f688346662a service nova] Releasing lock "refresh_cache-2caaa9dd-e1fd-465b-95a0-78fa51c96c15" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:19:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.432s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:19:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] <== connect_volume: return (1434ms) {'type': 'block', 'scsi_wwn': '26665623737393238', 'path': '/dev/sdd'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:19:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665623737393238', 'path': '/dev/sdd'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:19:12 user nova-compute[72504]: DEBUG nova.objects.instance [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lazy-loading 'flavor' on Instance uuid bb3228ce-ea4b-4393-a7b4-2d401ad314de {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:19:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 20:19:12 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:19:12 user nova-compute[72504]:   <source dev="/dev/sdd"/>
Aug 01 20:19:12 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:19:12 user nova-compute[72504]:   <serial>690dc847-b4c1-494d-b89c-ec5121c03785</serial>
Aug 01 20:19:12 user nova-compute[72504]: </disk>
Aug 01 20:19:12 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 20:19:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:12 user nova-compute[72504]: DEBUG nova.compute.manager [req-60090396-bf8b-4f21-8f37-59fc736d20c4 req-df5a8afb-5b0b-4989-991c-5c30c12e52a4 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Received event network-vif-plugged-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:19:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-60090396-bf8b-4f21-8f37-59fc736d20c4 req-df5a8afb-5b0b-4989-991c-5c30c12e52a4 service nova] Acquiring lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:19:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-60090396-bf8b-4f21-8f37-59fc736d20c4 req-df5a8afb-5b0b-4989-991c-5c30c12e52a4 service nova] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:19:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-60090396-bf8b-4f21-8f37-59fc736d20c4 req-df5a8afb-5b0b-4989-991c-5c30c12e52a4 service nova] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:19:12 user nova-compute[72504]: DEBUG nova.compute.manager [req-60090396-bf8b-4f21-8f37-59fc736d20c4 req-df5a8afb-5b0b-4989-991c-5c30c12e52a4 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] No waiting events found dispatching network-vif-plugged-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:19:12 user nova-compute[72504]: WARNING nova.compute.manager [req-60090396-bf8b-4f21-8f37-59fc736d20c4 req-df5a8afb-5b0b-4989-991c-5c30c12e52a4 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Received unexpected event network-vif-plugged-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 for instance with vm_state building and task_state spawning.
Aug 01 20:19:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:19:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:19:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] No VIF found with MAC fa:16:3e:f9:35:24, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:19:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2b7c4411-a4e4-4da6-868b-4789db9d9295 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.624s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:19:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:14 user nova-compute[72504]: DEBUG nova.compute.manager [req-510dbf62-44ea-4d91-a9d7-d7534f07fe8b req-e009309d-eb06-45e4-90a1-27b9f8f1eda8 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Received event network-vif-plugged-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:19:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-510dbf62-44ea-4d91-a9d7-d7534f07fe8b req-e009309d-eb06-45e4-90a1-27b9f8f1eda8 service nova] Acquiring lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:19:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-510dbf62-44ea-4d91-a9d7-d7534f07fe8b req-e009309d-eb06-45e4-90a1-27b9f8f1eda8 service nova] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:19:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-510dbf62-44ea-4d91-a9d7-d7534f07fe8b req-e009309d-eb06-45e4-90a1-27b9f8f1eda8 service nova] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:19:14 user nova-compute[72504]: DEBUG nova.compute.manager [req-510dbf62-44ea-4d91-a9d7-d7534f07fe8b req-e009309d-eb06-45e4-90a1-27b9f8f1eda8 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] No waiting events found dispatching network-vif-plugged-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:19:14 user nova-compute[72504]: WARNING nova.compute.manager [req-510dbf62-44ea-4d91-a9d7-d7534f07fe8b req-e009309d-eb06-45e4-90a1-27b9f8f1eda8 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Received unexpected event network-vif-plugged-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 for instance with vm_state building and task_state spawning.
Aug 01 20:19:14 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690921154.9169817, 2caaa9dd-e1fd-465b-95a0-78fa51c96c15 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:19:14 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] VM Resumed (Lifecycle Event)
Aug 01 20:19:14 user nova-compute[72504]: DEBUG nova.compute.manager [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:19:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:19:14 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Instance spawned successfully.
Aug 01 20:19:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 20:19:14 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:19:14 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:19:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:19:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:19:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:19:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:19:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:19:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:19:14 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:19:14 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690921154.918178, 2caaa9dd-e1fd-465b-95a0-78fa51c96c15 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:19:14 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] VM Started (Lifecycle Event)
Aug 01 20:19:14 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:19:14 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:19:15 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:19:15 user nova-compute[72504]: INFO nova.compute.manager [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Took 6.11 seconds to spawn the instance on the hypervisor.
Aug 01 20:19:15 user nova-compute[72504]: DEBUG nova.compute.manager [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:19:15 user nova-compute[72504]: INFO nova.compute.manager [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Took 6.75 seconds to build instance.
Aug 01 20:19:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-126edad5-3b01-4a39-a0e8-aeb32ab845a0 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.846s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:19:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:16 user nova-compute[72504]: DEBUG nova.objects.instance [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'flavor' on Instance uuid a4f9c59c-cf0b-4216-a194-22712725328d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:19:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "refresh_cache-a4f9c59c-cf0b-4216-a194-22712725328d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:19:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquired lock "refresh_cache-a4f9c59c-cf0b-4216-a194-22712725328d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:19:16 user nova-compute[72504]: DEBUG nova.network.neutron [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:19:16 user nova-compute[72504]: DEBUG nova.objects.instance [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'info_cache' on Instance uuid a4f9c59c-cf0b-4216-a194-22712725328d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:19:16 user nova-compute[72504]: DEBUG nova.network.neutron [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Updating instance_info_cache with network_info: [{"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Releasing lock "refresh_cache-a4f9c59c-cf0b-4216-a194-22712725328d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:19:17 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Instance destroyed successfully.
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.objects.instance [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'resources' on Instance uuid a4f9c59c-cf0b-4216-a194-22712725328d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-61706399',display_name='tempest-AttachVolumeTestJSON-server-61706399',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-61706399',id=39,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkLGKKoGI8XVsLxOaZh71hKpWONiOBrT0aje+GastgHoLyKuLQKlYfDXp3OwjC4WlZ28DTo1JlEqCpYnSgt/d2rMN3aO60eaUVx+bzZGYhJZWV5gQhPPIA8s7t5AmK8sA==',key_name='tempest-keypair-1070424172',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:11:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8ef67b412883421f949be025bdc1cf38',ramdisk_id='',reservation_id='r-1eu867rc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1031917511',owner_user_name='tempest-AttachVolumeTestJSON-1031917511-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:17:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90bea00e45b541baa6f98812cce770f8',uuid=a4f9c59c-cf0b-4216-a194-22712725328d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Converting VIF {"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:34:ea,bridge_name='br-int',has_traffic_filtering=True,id=b8f38092-7fe7-4274-8fcb-1e4a2808454e,network=Network(253a3888-9ae8-47b5-8875-9e4b823ac978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8f38092-7f') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG os_vif [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:34:ea,bridge_name='br-int',has_traffic_filtering=True,id=b8f38092-7fe7-4274-8fcb-1e4a2808454e,network=Network(253a3888-9ae8-47b5-8875-9e4b823ac978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8f38092-7f') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8f38092-7f, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:19:17 user nova-compute[72504]: INFO os_vif [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:34:ea,bridge_name='br-int',has_traffic_filtering=True,id=b8f38092-7fe7-4274-8fcb-1e4a2808454e,network=Network(253a3888-9ae8-47b5-8875-9e4b823ac978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8f38092-7f')
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Start _get_guest_xml network_info=[{"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.objects.instance [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'numa_topology' on Instance uuid a4f9c59c-cf0b-4216-a194-22712725328d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:19:17 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:19:17 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.objects.instance [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'vcpu_model' on Instance uuid a4f9c59c-cf0b-4216-a194-22712725328d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-61706399',display_name='tempest-AttachVolumeTestJSON-server-61706399',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-61706399',id=39,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkLGKKoGI8XVsLxOaZh71hKpWONiOBrT0aje+GastgHoLyKuLQKlYfDXp3OwjC4WlZ28DTo1JlEqCpYnSgt/d2rMN3aO60eaUVx+bzZGYhJZWV5gQhPPIA8s7t5AmK8sA==',key_name='tempest-keypair-1070424172',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:11:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8ef67b412883421f949be025bdc1cf38',ramdisk_id='',reservation_id='r-1eu867rc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1031917511',owner_user_name='tempest-AttachVolumeTestJSON-1031917511-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:17:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90bea00e45b541baa6f98812cce770f8',uuid=a4f9c59c-cf0b-4216-a194-22712725328d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Converting VIF {"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:34:ea,bridge_name='br-int',has_traffic_filtering=True,id=b8f38092-7fe7-4274-8fcb-1e4a2808454e,network=Network(253a3888-9ae8-47b5-8875-9e4b823ac978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8f38092-7f') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.objects.instance [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'pci_devices' on Instance uuid a4f9c59c-cf0b-4216-a194-22712725328d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:19:17 user nova-compute[72504]:   <uuid>a4f9c59c-cf0b-4216-a194-22712725328d</uuid>
Aug 01 20:19:17 user nova-compute[72504]:   <name>instance-00000027</name>
Aug 01 20:19:17 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:19:17 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:19:17 user nova-compute[72504]:   <metadata>
Aug 01 20:19:17 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:19:17 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:19:17 user nova-compute[72504]:       <nova:name>tempest-AttachVolumeTestJSON-server-61706399</nova:name>
Aug 01 20:19:17 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:19:17</nova:creationTime>
Aug 01 20:19:17 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:19:17 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:19:17 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:19:17 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:19:17 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:19:17 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:19:17 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:19:17 user nova-compute[72504]:       <nova:owner>
Aug 01 20:19:17 user nova-compute[72504]:         <nova:user uuid="90bea00e45b541baa6f98812cce770f8">tempest-AttachVolumeTestJSON-1031917511-project-member</nova:user>
Aug 01 20:19:17 user nova-compute[72504]:         <nova:project uuid="8ef67b412883421f949be025bdc1cf38">tempest-AttachVolumeTestJSON-1031917511</nova:project>
Aug 01 20:19:17 user nova-compute[72504]:       </nova:owner>
Aug 01 20:19:17 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 20:19:17 user nova-compute[72504]:       <nova:ports>
Aug 01 20:19:17 user nova-compute[72504]:         <nova:port uuid="b8f38092-7fe7-4274-8fcb-1e4a2808454e">
Aug 01 20:19:17 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 20:19:17 user nova-compute[72504]:         </nova:port>
Aug 01 20:19:17 user nova-compute[72504]:       </nova:ports>
Aug 01 20:19:17 user nova-compute[72504]:     </nova:instance>
Aug 01 20:19:17 user nova-compute[72504]:   </metadata>
Aug 01 20:19:17 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:19:17 user nova-compute[72504]:     <system>
Aug 01 20:19:17 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:19:17 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:19:17 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:19:17 user nova-compute[72504]:       <entry name="serial">a4f9c59c-cf0b-4216-a194-22712725328d</entry>
Aug 01 20:19:17 user nova-compute[72504]:       <entry name="uuid">a4f9c59c-cf0b-4216-a194-22712725328d</entry>
Aug 01 20:19:17 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:19:17 user nova-compute[72504]:     </system>
Aug 01 20:19:17 user nova-compute[72504]:   </sysinfo>
Aug 01 20:19:17 user nova-compute[72504]:   <os>
Aug 01 20:19:17 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:19:17 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:19:17 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:19:17 user nova-compute[72504]:   </os>
Aug 01 20:19:17 user nova-compute[72504]:   <features>
Aug 01 20:19:17 user nova-compute[72504]:     <acpi/>
Aug 01 20:19:17 user nova-compute[72504]:     <apic/>
Aug 01 20:19:17 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:19:17 user nova-compute[72504]:   </features>
Aug 01 20:19:17 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:19:17 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:19:17 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:19:17 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:19:17 user nova-compute[72504]:   </clock>
Aug 01 20:19:17 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:19:17 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:19:17 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:19:17 user nova-compute[72504]:   </cpu>
Aug 01 20:19:17 user nova-compute[72504]:   <devices>
Aug 01 20:19:17 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 20:19:17 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 20:19:17 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk"/>
Aug 01 20:19:17 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:19:17 user nova-compute[72504]:     </disk>
Aug 01 20:19:17 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:19:17 user nova-compute[72504]:       <mac address="fa:16:3e:de:34:ea"/>
Aug 01 20:19:17 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:19:17 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:19:17 user nova-compute[72504]:       <target dev="tapb8f38092-7f"/>
Aug 01 20:19:17 user nova-compute[72504]:     </interface>
Aug 01 20:19:17 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:19:17 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/console.log" append="off"/>
Aug 01 20:19:17 user nova-compute[72504]:     </serial>
Aug 01 20:19:17 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:19:17 user nova-compute[72504]:     <video>
Aug 01 20:19:17 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:19:17 user nova-compute[72504]:     </video>
Aug 01 20:19:17 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:19:17 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:19:17 user nova-compute[72504]:     </rng>
Aug 01 20:19:17 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:19:17 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:19:17 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:19:17 user nova-compute[72504]:     </memballoon>
Aug 01 20:19:17 user nova-compute[72504]:   </devices>
Aug 01 20:19:17 user nova-compute[72504]: </domain>
Aug 01 20:19:17 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.objects.instance [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'trusted_certs' on Instance uuid a4f9c59c-cf0b-4216-a194-22712725328d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.148s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Cannot resize image /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.objects.instance [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'migration_context' on Instance uuid a4f9c59c-cf0b-4216-a194-22712725328d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-61706399',display_name='tempest-AttachVolumeTestJSON-server-61706399',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-61706399',id=39,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkLGKKoGI8XVsLxOaZh71hKpWONiOBrT0aje+GastgHoLyKuLQKlYfDXp3OwjC4WlZ28DTo1JlEqCpYnSgt/d2rMN3aO60eaUVx+bzZGYhJZWV5gQhPPIA8s7t5AmK8sA==',key_name='tempest-keypair-1070424172',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:11:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='8ef67b412883421f949be025bdc1cf38',ramdisk_id='',reservation_id='r-1eu867rc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1031917511',owner_user_name='tempest-AttachVolumeTestJSON-1031917511-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:17:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90bea00e45b541baa6f98812cce770f8',uuid=a4f9c59c-cf0b-4216-a194-22712725328d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Converting VIF {"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:34:ea,bridge_name='br-int',has_traffic_filtering=True,id=b8f38092-7fe7-4274-8fcb-1e4a2808454e,network=Network(253a3888-9ae8-47b5-8875-9e4b823ac978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8f38092-7f') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG os_vif [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:34:ea,bridge_name='br-int',has_traffic_filtering=True,id=b8f38092-7fe7-4274-8fcb-1e4a2808454e,network=Network(253a3888-9ae8-47b5-8875-9e4b823ac978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8f38092-7f') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8f38092-7f, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb8f38092-7f, col_values=(('external_ids', {'iface-id': 'b8f38092-7fe7-4274-8fcb-1e4a2808454e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:34:ea', 'vm-uuid': 'a4f9c59c-cf0b-4216-a194-22712725328d'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:19:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:17 user nova-compute[72504]: INFO os_vif [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:34:ea,bridge_name='br-int',has_traffic_filtering=True,id=b8f38092-7fe7-4274-8fcb-1e4a2808454e,network=Network(253a3888-9ae8-47b5-8875-9e4b823ac978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8f38092-7f')
Aug 01 20:19:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:19 user nova-compute[72504]: DEBUG nova.compute.manager [req-7c0298d0-9aab-45e2-a68c-396fe2eb80fa req-42afbe83-f404-4899-b92a-c6542d30cec3 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Received event network-vif-plugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:19:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7c0298d0-9aab-45e2-a68c-396fe2eb80fa req-42afbe83-f404-4899-b92a-c6542d30cec3 service nova] Acquiring lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:19:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7c0298d0-9aab-45e2-a68c-396fe2eb80fa req-42afbe83-f404-4899-b92a-c6542d30cec3 service nova] Lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:19:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7c0298d0-9aab-45e2-a68c-396fe2eb80fa req-42afbe83-f404-4899-b92a-c6542d30cec3 service nova] Lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:19:19 user nova-compute[72504]: DEBUG nova.compute.manager [req-7c0298d0-9aab-45e2-a68c-396fe2eb80fa req-42afbe83-f404-4899-b92a-c6542d30cec3 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] No waiting events found dispatching network-vif-plugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:19:19 user nova-compute[72504]: WARNING nova.compute.manager [req-7c0298d0-9aab-45e2-a68c-396fe2eb80fa req-42afbe83-f404-4899-b92a-c6542d30cec3 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Received unexpected event network-vif-plugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e for instance with vm_state stopped and task_state powering-on.
Aug 01 20:19:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:21 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690921161.5847156, a4f9c59c-cf0b-4216-a194-22712725328d => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:19:21 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] VM Resumed (Lifecycle Event)
Aug 01 20:19:21 user nova-compute[72504]: DEBUG nova.compute.manager [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:19:21 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Instance rebooted successfully.
Aug 01 20:19:21 user nova-compute[72504]: DEBUG nova.compute.manager [None req-92d46010-ffac-4139-b489-b1e01cbe8004 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:19:21 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:19:21 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:19:21 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 01 20:19:21 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690921161.5865378, a4f9c59c-cf0b-4216-a194-22712725328d => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:19:21 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] VM Started (Lifecycle Event)
Aug 01 20:19:21 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:19:21 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:19:21 user nova-compute[72504]: DEBUG nova.compute.manager [req-1f67d5e4-5d43-4738-a4a6-f7b61d5f38fc req-895fc636-1a41-448c-a868-b3b0040a0598 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Received event network-vif-plugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:19:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1f67d5e4-5d43-4738-a4a6-f7b61d5f38fc req-895fc636-1a41-448c-a868-b3b0040a0598 service nova] Acquiring lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:19:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1f67d5e4-5d43-4738-a4a6-f7b61d5f38fc req-895fc636-1a41-448c-a868-b3b0040a0598 service nova] Lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:19:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1f67d5e4-5d43-4738-a4a6-f7b61d5f38fc req-895fc636-1a41-448c-a868-b3b0040a0598 service nova] Lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:19:21 user nova-compute[72504]: DEBUG nova.compute.manager [req-1f67d5e4-5d43-4738-a4a6-f7b61d5f38fc req-895fc636-1a41-448c-a868-b3b0040a0598 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] No waiting events found dispatching network-vif-plugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:19:21 user nova-compute[72504]: WARNING nova.compute.manager [req-1f67d5e4-5d43-4738-a4a6-f7b61d5f38fc req-895fc636-1a41-448c-a868-b3b0040a0598 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Received unexpected event network-vif-plugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e for instance with vm_state active and task_state None.
Aug 01 20:19:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:29 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:19:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:34 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:19:37 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:19:37 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:19:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:19:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:19:40 user nova-compute[72504]: INFO nova.compute.manager [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Detaching volume 690dc847-b4c1-494d-b89c-ec5121c03785
Aug 01 20:19:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:19:40 user nova-compute[72504]: INFO nova.virt.block_device [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Attempting to driver detach volume 690dc847-b4c1-494d-b89c-ec5121c03785 from mountpoint /dev/vdb
Aug 01 20:19:40 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Attempting to detach device vdb from instance bb3228ce-ea4b-4393-a7b4-2d401ad314de from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 20:19:40 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:19:40 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:19:40 user nova-compute[72504]:   <source dev="/dev/sdd"/>
Aug 01 20:19:40 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:19:40 user nova-compute[72504]:   <serial>690dc847-b4c1-494d-b89c-ec5121c03785</serial>
Aug 01 20:19:40 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:19:40 user nova-compute[72504]: </disk>
Aug 01 20:19:40 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:19:40 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Successfully detached device vdb from instance bb3228ce-ea4b-4393-a7b4-2d401ad314de from the persistent domain config.
Aug 01 20:19:40 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb3228ce-ea4b-4393-a7b4-2d401ad314de from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 20:19:40 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:19:40 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:19:40 user nova-compute[72504]:   <source dev="/dev/sdd"/>
Aug 01 20:19:40 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:19:40 user nova-compute[72504]:   <serial>690dc847-b4c1-494d-b89c-ec5121c03785</serial>
Aug 01 20:19:40 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:19:40 user nova-compute[72504]: </disk>
Aug 01 20:19:40 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690921181.350493, bb3228ce-ea4b-4393-a7b4-2d401ad314de => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb3228ce-ea4b-4393-a7b4-2d401ad314de {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 20:19:41 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Successfully detached device vdb from instance bb3228ce-ea4b-4393-a7b4-2d401ad314de from the live domain config.
Aug 01 20:19:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxwzEVaD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:19:41 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:19:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61b528d-750d-4773-9bd6-6598faf78733]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fbb825-5b84-422f-9d50-f4356398b16a]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:19:41 user nova-compute[72504]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 (non-flash)
Aug 01 20:19:41 user nova-compute[72504]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785 (non-flash)
Aug 01 20:19:41 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:19:41 user nova-compute[72504]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 (non-flash)
Aug 01 20:19:41 user nova-compute[72504]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785 (non-flash)
Aug 01 20:19:41 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff40c197eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785'): ({'sdd'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Removing single pathed devices sdd {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b81c1d3-25a7-4f7d-839a-50ae7ecf061e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[844f1d55-79f1-4a4f-876d-cc492bb4e989]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Flushing IO for device /dev/sdd {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[530bfdbe-3400-4f98-b629-1002c5254f45]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7ebb22-4c32-487c-8918-ae807fce3150]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] SCSI volumes sdd have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d066eb9-e370-4928-bf14-0fc92949d596]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1697237-8e4a-41d7-a909-a806a80402b4]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785, portal: 172.16.0.220,3260]
Aug 01 20:19:41 user nova-compute[72504]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785, portal: 172.16.0.220,3260] successful.
Aug 01 20:19:41 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[90aaf930-7d09-457f-b32f-49ac210a47dd]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] <== disconnect_volume: return (277ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-95c7da6a-c9a5-4441-9819-1219f7d6793f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-95c7da6a-c9a5-4441-9819-1219f7d6793f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:19:41 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:19:42 user nova-compute[72504]: DEBUG nova.objects.instance [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lazy-loading 'flavor' on Instance uuid bb3228ce-ea4b-4393-a7b4-2d401ad314de {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:19:42 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Updating instance_info_cache with network_info: [{"id": "e6acb053-8365-45b0-ac25-1f27f42162ff", "address": "fa:16:3e:01:7a:65", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acb053-83", "ovs_interfaceid": "e6acb053-8365-45b0-ac25-1f27f42162ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:19:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-95c7da6a-c9a5-4441-9819-1219f7d6793f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:19:42 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:19:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-f6bffc40-ce8b-44ac-9112-23d054367531 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.871s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:19:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.746s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:19:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:19:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:19:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:19:42 user nova-compute[72504]: INFO nova.compute.manager [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Terminating instance
Aug 01 20:19:42 user nova-compute[72504]: DEBUG nova.compute.manager [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:19:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:42 user nova-compute[72504]: DEBUG nova.compute.manager [req-3a76b56a-16fd-4cfe-a789-355baffc90a4 req-2e47978d-26c0-4408-8498-bf08c7bee686 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Received event network-vif-unplugged-ba94e20c-dd80-4acb-a307-0ed565731890 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:19:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3a76b56a-16fd-4cfe-a789-355baffc90a4 req-2e47978d-26c0-4408-8498-bf08c7bee686 service nova] Acquiring lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:19:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3a76b56a-16fd-4cfe-a789-355baffc90a4 req-2e47978d-26c0-4408-8498-bf08c7bee686 service nova] Lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:19:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3a76b56a-16fd-4cfe-a789-355baffc90a4 req-2e47978d-26c0-4408-8498-bf08c7bee686 service nova] Lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:19:42 user nova-compute[72504]: DEBUG nova.compute.manager [req-3a76b56a-16fd-4cfe-a789-355baffc90a4 req-2e47978d-26c0-4408-8498-bf08c7bee686 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] No waiting events found dispatching network-vif-unplugged-ba94e20c-dd80-4acb-a307-0ed565731890 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:19:42 user nova-compute[72504]: DEBUG nova.compute.manager [req-3a76b56a-16fd-4cfe-a789-355baffc90a4 req-2e47978d-26c0-4408-8498-bf08c7bee686 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Received event network-vif-unplugged-ba94e20c-dd80-4acb-a307-0ed565731890 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:19:42 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:19:42 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:19:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:43 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Instance destroyed successfully.
Aug 01 20:19:43 user nova-compute[72504]: DEBUG nova.objects.instance [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lazy-loading 'resources' on Instance uuid bb3228ce-ea4b-4393-a7b4-2d401ad314de {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-810728448',display_name='tempest-VolumesSnapshotTestJSON-instance-810728448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-810728448',id=43,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImwNBAQvlp6lw5EW+0791NYM0ZvrL3+marDJ0FPz/Q+of70OudmeGTGsdmmTFI3KZurhztTxwe88QIWb1lJ1ZG5EidGtWsbIC8DRTmEu60U6p67stb/kLldDX+sB9bFRw==',key_name='tempest-keypair-1682650510',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:17:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf6047793ecc44519667cf55e090296e',ramdisk_id='',reservation_id='r-x0ybjcsk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2122802409',owner_user_name='tempest-VolumesSnapshotTestJSON-2122802409-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:17:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93aee9c4331d46aab83b73dfe0584fa0',uuid=bb3228ce-ea4b-4393-a7b4-2d401ad314de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba94e20c-dd80-4acb-a307-0ed565731890", "address": "fa:16:3e:f9:35:24", "network": {"id": "ec191814-d9f8-4a40-a775-07b50423cec5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1317992461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf6047793ecc44519667cf55e090296e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba94e20c-dd", "ovs_interfaceid": "ba94e20c-dd80-4acb-a307-0ed565731890", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Converting VIF {"id": "ba94e20c-dd80-4acb-a307-0ed565731890", "address": "fa:16:3e:f9:35:24", "network": {"id": "ec191814-d9f8-4a40-a775-07b50423cec5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1317992461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf6047793ecc44519667cf55e090296e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba94e20c-dd", "ovs_interfaceid": "ba94e20c-dd80-4acb-a307-0ed565731890", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:35:24,bridge_name='br-int',has_traffic_filtering=True,id=ba94e20c-dd80-4acb-a307-0ed565731890,network=Network(ec191814-d9f8-4a40-a775-07b50423cec5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba94e20c-dd') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG os_vif [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:35:24,bridge_name='br-int',has_traffic_filtering=True,id=ba94e20c-dd80-4acb-a307-0ed565731890,network=Network(ec191814-d9f8-4a40-a775-07b50423cec5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba94e20c-dd') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba94e20c-dd, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:19:43 user nova-compute[72504]: INFO os_vif [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:35:24,bridge_name='br-int',has_traffic_filtering=True,id=ba94e20c-dd80-4acb-a307-0ed565731890,network=Network(ec191814-d9f8-4a40-a775-07b50423cec5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba94e20c-dd')
Aug 01 20:19:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxwzEVaD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:19:43 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:19:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:690dc847-b4c1-494d-b89c-ec5121c03785', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[307894a0-7f1c-45e8-ac07-a237ecc6bf42]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4fa5b8-814a-408e-99c0-d6816a45578c]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:19:43 user nova-compute[72504]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 (non-flash)
Aug 01 20:19:43 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:19:43 user nova-compute[72504]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 (non-flash)
Aug 01 20:19:43 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff414379d80>, {}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Disconnecting from: [] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.051s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] <== disconnect_volume: return (52ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:19:43 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Deleting instance files /opt/stack/data/nova/instances/bb3228ce-ea4b-4393-a7b4-2d401ad314de_del
Aug 01 20:19:43 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Deletion of /opt/stack/data/nova/instances/bb3228ce-ea4b-4393-a7b4-2d401ad314de_del complete
Aug 01 20:19:43 user nova-compute[72504]: INFO nova.compute.manager [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 01 20:19:43 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:19:44 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Took 1.25 seconds to deallocate network for instance.
Aug 01 20:19:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-83de7cba-fc5a-4432-a7af-deff6bf72608 req-a701c644-7cb8-4837-b74e-1014a1309b22 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Received event network-vif-deleted-ba94e20c-dd80-4acb-a307-0ed565731890 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:19:44 user nova-compute[72504]: WARNING nova.volume.cinder [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Attachment 7cf7e2c6-ffed-4f11-88b5-83f0e3c90f00 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7cf7e2c6-ffed-4f11-88b5-83f0e3c90f00. (HTTP 404) (Request-ID: req-c88ca385-dcd8-4c49-9c72-91ed7bfbdc09)
Aug 01 20:19:44 user nova-compute[72504]: INFO nova.compute.manager [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Took 0.03 seconds to detach 1 volumes for instance.
Aug 01 20:19:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Received event network-vif-plugged-ba94e20c-dd80-4acb-a307-0ed565731890 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] Acquiring lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] Lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] Lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] No waiting events found dispatching network-vif-plugged-ba94e20c-dd80-4acb-a307-0ed565731890 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:19:44 user nova-compute[72504]: WARNING nova.compute.manager [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Received unexpected event network-vif-plugged-ba94e20c-dd80-4acb-a307-0ed565731890 for instance with vm_state deleted and task_state None.
Aug 01 20:19:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Received event network-vif-plugged-ba94e20c-dd80-4acb-a307-0ed565731890 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] Acquiring lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] Lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] Lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] No waiting events found dispatching network-vif-plugged-ba94e20c-dd80-4acb-a307-0ed565731890 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:19:44 user nova-compute[72504]: WARNING nova.compute.manager [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Received unexpected event network-vif-plugged-ba94e20c-dd80-4acb-a307-0ed565731890 for instance with vm_state deleted and task_state None.
Aug 01 20:19:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Received event network-vif-plugged-ba94e20c-dd80-4acb-a307-0ed565731890 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] Acquiring lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] Lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] Lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] No waiting events found dispatching network-vif-plugged-ba94e20c-dd80-4acb-a307-0ed565731890 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:19:44 user nova-compute[72504]: WARNING nova.compute.manager [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Received unexpected event network-vif-plugged-ba94e20c-dd80-4acb-a307-0ed565731890 for instance with vm_state deleted and task_state None.
Aug 01 20:19:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Received event network-vif-unplugged-ba94e20c-dd80-4acb-a307-0ed565731890 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] Acquiring lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] Lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] Lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] No waiting events found dispatching network-vif-unplugged-ba94e20c-dd80-4acb-a307-0ed565731890 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:19:44 user nova-compute[72504]: WARNING nova.compute.manager [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Received unexpected event network-vif-unplugged-ba94e20c-dd80-4acb-a307-0ed565731890 for instance with vm_state deleted and task_state None.
Aug 01 20:19:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Received event network-vif-plugged-ba94e20c-dd80-4acb-a307-0ed565731890 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] Acquiring lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] Lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] Lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] No waiting events found dispatching network-vif-plugged-ba94e20c-dd80-4acb-a307-0ed565731890 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:19:44 user nova-compute[72504]: WARNING nova.compute.manager [req-83382859-746d-42e0-be20-ff48fac9dc7e req-579a7d54-f8ad-4007-8467-8843f8c5b057 service nova] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Received unexpected event network-vif-plugged-ba94e20c-dd80-4acb-a307-0ed565731890 for instance with vm_state deleted and task_state None.
Aug 01 20:19:44 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.111s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:19:44 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:19:44 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Deleted allocations for instance bb3228ce-ea4b-4393-a7b4-2d401ad314de
Aug 01 20:19:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-63b0b39c-16fb-4d84-a799-467dc3d2a19b tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "bb3228ce-ea4b-4393-a7b4-2d401ad314de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.671s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:19:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:19:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:19:45 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:19:45 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:19:46 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:19:46 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:19:46 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8180MB free_disk=25.14693832397461GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:19:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:19:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:19:46 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance a4f9c59c-cf0b-4216-a194-22712725328d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:19:46 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 95c7da6a-c9a5-4441-9819-1219f7d6793f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:19:46 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance c642255e-6e48-4cdb-92da-4cb0b00e681e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:19:46 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 2caaa9dd-e1fd-465b-95a0-78fa51c96c15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:19:46 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:19:46 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:19:46 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:19:46 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:19:46 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:19:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:19:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:49 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:19:49 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:19:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:19:58 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690921183.2147517, bb3228ce-ea4b-4393-a7b4-2d401ad314de => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:19:58 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] VM Stopped (Lifecycle Event)
Aug 01 20:19:58 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7de82ffa-9d67-4401-bf50-374d48bbd73c None None] [instance: bb3228ce-ea4b-4393-a7b4-2d401ad314de] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:19:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:20:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:20:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:20:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:20:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:20:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:20:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:20:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:20:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:20:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:20:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:20:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:20:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:20:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:20:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:20:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:20:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:20:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:20:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:20:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:20:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:20:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:20:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:20:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:20:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:20:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:20:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:20:30 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:20:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:20:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:20:34 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:20:36 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:20:36 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Cleaning up deleted instances {{(pid=72504) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 20:20:36 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] There are 0 instances to clean {{(pid=72504) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 20:20:37 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:20:37 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:20:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:20:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:20:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:20:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:20:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:20:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:20:40 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:20:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:20:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:20:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:20:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:20:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:20:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:20:43 user nova-compute[72504]: DEBUG nova.compute.manager [req-091cfbe8-2dff-43dd-854e-ad55e0244edb req-57142f71-8a2d-4295-af15-b33b7376f68d service nova] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Received event network-changed-a3c2ebc3-ddd5-4f89-a355-f16ec71e3678 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:20:43 user nova-compute[72504]: DEBUG nova.compute.manager [req-091cfbe8-2dff-43dd-854e-ad55e0244edb req-57142f71-8a2d-4295-af15-b33b7376f68d service nova] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Refreshing instance network info cache due to event network-changed-a3c2ebc3-ddd5-4f89-a355-f16ec71e3678. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:20:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-091cfbe8-2dff-43dd-854e-ad55e0244edb req-57142f71-8a2d-4295-af15-b33b7376f68d service nova] Acquiring lock "refresh_cache-c642255e-6e48-4cdb-92da-4cb0b00e681e" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:20:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-091cfbe8-2dff-43dd-854e-ad55e0244edb req-57142f71-8a2d-4295-af15-b33b7376f68d service nova] Acquired lock "refresh_cache-c642255e-6e48-4cdb-92da-4cb0b00e681e" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:20:43 user nova-compute[72504]: DEBUG nova.network.neutron [req-091cfbe8-2dff-43dd-854e-ad55e0244edb req-57142f71-8a2d-4295-af15-b33b7376f68d service nova] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Refreshing network info cache for port a3c2ebc3-ddd5-4f89-a355-f16ec71e3678 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:20:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:20:43 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:20:43 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:20:43 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Didn't find any instances for network info cache update. {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 20:20:43 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:20:43 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:20:44 user nova-compute[72504]: DEBUG nova.network.neutron [req-091cfbe8-2dff-43dd-854e-ad55e0244edb req-57142f71-8a2d-4295-af15-b33b7376f68d service nova] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Updated VIF entry in instance network info cache for port a3c2ebc3-ddd5-4f89-a355-f16ec71e3678. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:20:44 user nova-compute[72504]: DEBUG nova.network.neutron [req-091cfbe8-2dff-43dd-854e-ad55e0244edb req-57142f71-8a2d-4295-af15-b33b7376f68d service nova] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Updating instance_info_cache with network_info: [{"id": "a3c2ebc3-ddd5-4f89-a355-f16ec71e3678", "address": "fa:16:3e:90:54:76", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c2ebc3-dd", "ovs_interfaceid": "a3c2ebc3-ddd5-4f89-a355-f16ec71e3678", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:20:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-091cfbe8-2dff-43dd-854e-ad55e0244edb req-57142f71-8a2d-4295-af15-b33b7376f68d service nova] Releasing lock "refresh_cache-c642255e-6e48-4cdb-92da-4cb0b00e681e" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:20:44 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:20:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-cb9a7ae7-445f-4763-822b-b89228a70f8c req-20c81d60-2ce8-4e80-9f6f-db7407519990 service nova] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Received event network-changed-a3c2ebc3-ddd5-4f89-a355-f16ec71e3678 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:20:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-cb9a7ae7-445f-4763-822b-b89228a70f8c req-20c81d60-2ce8-4e80-9f6f-db7407519990 service nova] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Refreshing instance network info cache due to event network-changed-a3c2ebc3-ddd5-4f89-a355-f16ec71e3678. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:20:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cb9a7ae7-445f-4763-822b-b89228a70f8c req-20c81d60-2ce8-4e80-9f6f-db7407519990 service nova] Acquiring lock "refresh_cache-c642255e-6e48-4cdb-92da-4cb0b00e681e" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:20:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cb9a7ae7-445f-4763-822b-b89228a70f8c req-20c81d60-2ce8-4e80-9f6f-db7407519990 service nova] Acquired lock "refresh_cache-c642255e-6e48-4cdb-92da-4cb0b00e681e" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:20:44 user nova-compute[72504]: DEBUG nova.network.neutron [req-cb9a7ae7-445f-4763-822b-b89228a70f8c req-20c81d60-2ce8-4e80-9f6f-db7407519990 service nova] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Refreshing network info cache for port a3c2ebc3-ddd5-4f89-a355-f16ec71e3678 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:20:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "c642255e-6e48-4cdb-92da-4cb0b00e681e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:20:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "c642255e-6e48-4cdb-92da-4cb0b00e681e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:20:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "c642255e-6e48-4cdb-92da-4cb0b00e681e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:20:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "c642255e-6e48-4cdb-92da-4cb0b00e681e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:20:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "c642255e-6e48-4cdb-92da-4cb0b00e681e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:20:44 user nova-compute[72504]: INFO nova.compute.manager [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Terminating instance
Aug 01 20:20:44 user nova-compute[72504]: DEBUG nova.compute.manager [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG nova.compute.manager [req-b2f46fc9-be80-47d3-9c39-7acb03b21c39 req-b23b22c9-c999-4efc-a83f-f5fe4f4036b9 service nova] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Received event network-vif-unplugged-a3c2ebc3-ddd5-4f89-a355-f16ec71e3678 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b2f46fc9-be80-47d3-9c39-7acb03b21c39 req-b23b22c9-c999-4efc-a83f-f5fe4f4036b9 service nova] Acquiring lock "c642255e-6e48-4cdb-92da-4cb0b00e681e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b2f46fc9-be80-47d3-9c39-7acb03b21c39 req-b23b22c9-c999-4efc-a83f-f5fe4f4036b9 service nova] Lock "c642255e-6e48-4cdb-92da-4cb0b00e681e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b2f46fc9-be80-47d3-9c39-7acb03b21c39 req-b23b22c9-c999-4efc-a83f-f5fe4f4036b9 service nova] Lock "c642255e-6e48-4cdb-92da-4cb0b00e681e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG nova.compute.manager [req-b2f46fc9-be80-47d3-9c39-7acb03b21c39 req-b23b22c9-c999-4efc-a83f-f5fe4f4036b9 service nova] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] No waiting events found dispatching network-vif-unplugged-a3c2ebc3-ddd5-4f89-a355-f16ec71e3678 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG nova.compute.manager [req-b2f46fc9-be80-47d3-9c39-7acb03b21c39 req-b23b22c9-c999-4efc-a83f-f5fe4f4036b9 service nova] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Received event network-vif-unplugged-a3c2ebc3-ddd5-4f89-a355-f16ec71e3678 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG nova.network.neutron [req-cb9a7ae7-445f-4763-822b-b89228a70f8c req-20c81d60-2ce8-4e80-9f6f-db7407519990 service nova] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Updated VIF entry in instance network info cache for port a3c2ebc3-ddd5-4f89-a355-f16ec71e3678. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG nova.network.neutron [req-cb9a7ae7-445f-4763-822b-b89228a70f8c req-20c81d60-2ce8-4e80-9f6f-db7407519990 service nova] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Updating instance_info_cache with network_info: [{"id": "a3c2ebc3-ddd5-4f89-a355-f16ec71e3678", "address": "fa:16:3e:90:54:76", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c2ebc3-dd", "ovs_interfaceid": "a3c2ebc3-ddd5-4f89-a355-f16ec71e3678", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:20:45 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Instance destroyed successfully.
Aug 01 20:20:45 user nova-compute[72504]: DEBUG nova.objects.instance [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lazy-loading 'resources' on Instance uuid c642255e-6e48-4cdb-92da-4cb0b00e681e {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-cb9a7ae7-445f-4763-822b-b89228a70f8c req-20c81d60-2ce8-4e80-9f6f-db7407519990 service nova] Releasing lock "refresh_cache-c642255e-6e48-4cdb-92da-4cb0b00e681e" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:18:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-933250371',display_name='tempest-TestVolumeBootPattern-server-933250371',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-933250371',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrKan85Goqo8Jv0VkDYyshQTMQ59f3rUyYronrtEBxVKZjCUMR9BmiZNw9TY8Sa/UvzfiwIaZSAr04+rYB06rxcAkBTQWOBWsdwofE2ksnZ+I8hLlgBMpWvgtrRSAHuwA==',key_name='tempest-TestVolumeBootPattern-1138255315',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:19:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb59fbc2bf9749f3af7d56435cb37066',ramdisk_id='',reservation_id='r-d1z4gcmn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-685885098',owner_user_name='tempest-TestVolumeBootPattern-685885098-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:19:05Z,user_data=None,user_id='f06381c8a6214ddea7f1b36b623ed4d5',uuid=c642255e-6e48-4cdb-92da-4cb0b00e681e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3c2ebc3-ddd5-4f89-a355-f16ec71e3678", "address": "fa:16:3e:90:54:76", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c2ebc3-dd", "ovs_interfaceid": "a3c2ebc3-ddd5-4f89-a355-f16ec71e3678", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converting VIF {"id": "a3c2ebc3-ddd5-4f89-a355-f16ec71e3678", "address": "fa:16:3e:90:54:76", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c2ebc3-dd", "ovs_interfaceid": "a3c2ebc3-ddd5-4f89-a355-f16ec71e3678", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:54:76,bridge_name='br-int',has_traffic_filtering=True,id=a3c2ebc3-ddd5-4f89-a355-f16ec71e3678,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c2ebc3-dd') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG os_vif [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:54:76,bridge_name='br-int',has_traffic_filtering=True,id=a3c2ebc3-ddd5-4f89-a355-f16ec71e3678,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c2ebc3-dd') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3c2ebc3-dd, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:20:45 user nova-compute[72504]: INFO os_vif [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:54:76,bridge_name='br-int',has_traffic_filtering=True,id=a3c2ebc3-ddd5-4f89-a355-f16ec71e3678,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c2ebc3-dd')
Aug 01 20:20:45 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIyYpQuM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:20:45 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:20:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ccd781-6734-4149-822a-32b1c11ad0d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e50c14-c2e3-423c-967d-f68370693073]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:20:45 user nova-compute[72504]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 (non-flash)
Aug 01 20:20:45 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:20:45 user nova-compute[72504]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 (non-flash)
Aug 01 20:20:45 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3f43aa8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78'): ({'sdb'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Removing single pathed devices sdb {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a60280-fdf4-4550-bf7e-bcee8bb1f9df]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[318cc6fd-63ae-4d19-a8c9-181afe21da1c]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Flushing IO for device /dev/sdb {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8813810-eb8d-45e0-8f3d-ad5196e2720e]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:20:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cf5ae1-41bf-4c51-bcf9-3f92da74353c]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4261fe63-29e8-48a0-aac5-a6f32585cd1e]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdb43be-963a-42bb-8dc8-c31c73cc342f]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78, portal: 172.16.0.220,3260]
Aug 01 20:20:46 user nova-compute[72504]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78, portal: 172.16.0.220,3260] successful.
Aug 01 20:20:46 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc00aab9-2531-4169-b248-f6dd6b935f78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e065cf-2ab7-47e8-8569-c3cd04ec66a4]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] <== disconnect_volume: return (387ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:20:46 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Deleting instance files /opt/stack/data/nova/instances/c642255e-6e48-4cdb-92da-4cb0b00e681e_del
Aug 01 20:20:46 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Deletion of /opt/stack/data/nova/instances/c642255e-6e48-4cdb-92da-4cb0b00e681e_del complete
Aug 01 20:20:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:20:46 user nova-compute[72504]: INFO nova.compute.manager [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Took 1.35 seconds to destroy the instance on the hypervisor.
Aug 01 20:20:46 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:20:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:20:46 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Error from libvirt while getting description of instance-0000002c: [Error Code 42] Domain not found: no domain with matching uuid 'c642255e-6e48-4cdb-92da-4cb0b00e681e' (instance-0000002c): libvirt.libvirtError: Domain not found: no domain with matching uuid 'c642255e-6e48-4cdb-92da-4cb0b00e681e' (instance-0000002c)
Aug 01 20:20:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:20:47 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:20:47 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:20:47 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8457MB free_disk=25.14556121826172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:20:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:20:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:20:47 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:20:47 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Took 0.75 seconds to deallocate network for instance.
Aug 01 20:20:47 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance a4f9c59c-cf0b-4216-a194-22712725328d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:20:47 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 95c7da6a-c9a5-4441-9819-1219f7d6793f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:20:47 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance c642255e-6e48-4cdb-92da-4cb0b00e681e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:20:47 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 2caaa9dd-e1fd-465b-95a0-78fa51c96c15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:20:47 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:20:47 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:20:47 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:20:47 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:20:47 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:20:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:20:47 user nova-compute[72504]: DEBUG nova.compute.manager [req-3f22ef48-3db9-4a24-a31c-b000ae5554bd req-e7a58d5c-f988-44a6-aed2-890d928305e5 service nova] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Received event network-vif-plugged-a3c2ebc3-ddd5-4f89-a355-f16ec71e3678 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:20:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3f22ef48-3db9-4a24-a31c-b000ae5554bd req-e7a58d5c-f988-44a6-aed2-890d928305e5 service nova] Acquiring lock "c642255e-6e48-4cdb-92da-4cb0b00e681e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:20:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3f22ef48-3db9-4a24-a31c-b000ae5554bd req-e7a58d5c-f988-44a6-aed2-890d928305e5 service nova] Lock "c642255e-6e48-4cdb-92da-4cb0b00e681e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:20:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3f22ef48-3db9-4a24-a31c-b000ae5554bd req-e7a58d5c-f988-44a6-aed2-890d928305e5 service nova] Lock "c642255e-6e48-4cdb-92da-4cb0b00e681e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:20:47 user nova-compute[72504]: DEBUG nova.compute.manager [req-3f22ef48-3db9-4a24-a31c-b000ae5554bd req-e7a58d5c-f988-44a6-aed2-890d928305e5 service nova] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] No waiting events found dispatching network-vif-plugged-a3c2ebc3-ddd5-4f89-a355-f16ec71e3678 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:20:47 user nova-compute[72504]: WARNING nova.compute.manager [req-3f22ef48-3db9-4a24-a31c-b000ae5554bd req-e7a58d5c-f988-44a6-aed2-890d928305e5 service nova] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Received unexpected event network-vif-plugged-a3c2ebc3-ddd5-4f89-a355-f16ec71e3678 for instance with vm_state active and task_state deleting.
Aug 01 20:20:47 user nova-compute[72504]: DEBUG nova.compute.manager [req-3f22ef48-3db9-4a24-a31c-b000ae5554bd req-e7a58d5c-f988-44a6-aed2-890d928305e5 service nova] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Received event network-vif-deleted-a3c2ebc3-ddd5-4f89-a355-f16ec71e3678 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:20:47 user nova-compute[72504]: INFO nova.compute.manager [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Took 0.86 seconds to detach 1 volumes for instance.
Aug 01 20:20:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:20:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:20:48 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:20:48 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:20:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:20:48 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Deleted allocations for instance c642255e-6e48-4cdb-92da-4cb0b00e681e
Aug 01 20:20:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-25d1512d-eac5-4870-9d52-7f5d97a75443 tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "c642255e-6e48-4cdb-92da-4cb0b00e681e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.325s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:20:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:20:50 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:20:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:20:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:20:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "f0ffc053-4a57-486c-bc52-924e882dac0e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:20:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "f0ffc053-4a57-486c-bc52-924e882dac0e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:20:56 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 20:20:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:20:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:20:57 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:20:57 user nova-compute[72504]: INFO nova.compute.claims [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Claim successful on node user
Aug 01 20:20:57 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:20:57 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:20:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:20:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 20:20:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 20:20:57 user nova-compute[72504]: DEBUG nova.network.neutron [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 20:20:57 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 20:20:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 20:20:57 user nova-compute[72504]: DEBUG nova.policy [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93aee9c4331d46aab83b73dfe0584fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6047793ecc44519667cf55e090296e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 20:20:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 20:20:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:20:57 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Creating image(s)
Aug 01 20:20:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0ffc053-4a57-486c-bc52-924e882dac0e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:20:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "/opt/stack/data/nova/instances/f0ffc053-4a57-486c-bc52-924e882dac0e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:20:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "/opt/stack/data/nova/instances/f0ffc053-4a57-486c-bc52-924e882dac0e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:20:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:20:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.138s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:20:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:20:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:20:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:20:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:20:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/f0ffc053-4a57-486c-bc52-924e882dac0e/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:20:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/f0ffc053-4a57-486c-bc52-924e882dac0e/disk 1073741824" returned: 0 in 0.048s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:20:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:20:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:20:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.132s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:20:57 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0ffc053-4a57-486c-bc52-924e882dac0e/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 20:20:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ffc053-4a57-486c-bc52-924e882dac0e/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:20:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ffc053-4a57-486c-bc52-924e882dac0e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:20:58 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Cannot resize image /opt/stack/data/nova/instances/f0ffc053-4a57-486c-bc52-924e882dac0e/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 20:20:58 user nova-compute[72504]: DEBUG nova.objects.instance [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lazy-loading 'migration_context' on Instance uuid f0ffc053-4a57-486c-bc52-924e882dac0e {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:20:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 20:20:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Ensure instance console log exists: /opt/stack/data/nova/instances/f0ffc053-4a57-486c-bc52-924e882dac0e/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:20:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:20:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:20:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:20:58 user nova-compute[72504]: DEBUG nova.network.neutron [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Successfully created port: deaaf42d-889f-4b49-abb5-3a3d4684ea5f {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 20:20:58 user nova-compute[72504]: DEBUG nova.network.neutron [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Successfully updated port: deaaf42d-889f-4b49-abb5-3a3d4684ea5f {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 20:20:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "refresh_cache-f0ffc053-4a57-486c-bc52-924e882dac0e" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:20:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquired lock "refresh_cache-f0ffc053-4a57-486c-bc52-924e882dac0e" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:20:58 user nova-compute[72504]: DEBUG nova.network.neutron [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:20:58 user nova-compute[72504]: DEBUG nova.compute.manager [req-083b5a27-120f-4d26-ab38-fc4ff29626a0 req-6c68b642-0c38-4b66-9ed9-a1e9728615fd service nova] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Received event network-changed-deaaf42d-889f-4b49-abb5-3a3d4684ea5f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:20:58 user nova-compute[72504]: DEBUG nova.compute.manager [req-083b5a27-120f-4d26-ab38-fc4ff29626a0 req-6c68b642-0c38-4b66-9ed9-a1e9728615fd service nova] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Refreshing instance network info cache due to event network-changed-deaaf42d-889f-4b49-abb5-3a3d4684ea5f. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:20:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-083b5a27-120f-4d26-ab38-fc4ff29626a0 req-6c68b642-0c38-4b66-9ed9-a1e9728615fd service nova] Acquiring lock "refresh_cache-f0ffc053-4a57-486c-bc52-924e882dac0e" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:20:58 user nova-compute[72504]: DEBUG nova.network.neutron [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.network.neutron [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Updating instance_info_cache with network_info: [{"id": "deaaf42d-889f-4b49-abb5-3a3d4684ea5f", "address": "fa:16:3e:c7:14:6b", "network": {"id": "ec191814-d9f8-4a40-a775-07b50423cec5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1317992461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf6047793ecc44519667cf55e090296e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeaaf42d-88", "ovs_interfaceid": "deaaf42d-889f-4b49-abb5-3a3d4684ea5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Releasing lock "refresh_cache-f0ffc053-4a57-486c-bc52-924e882dac0e" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Instance network_info: |[{"id": "deaaf42d-889f-4b49-abb5-3a3d4684ea5f", "address": "fa:16:3e:c7:14:6b", "network": {"id": "ec191814-d9f8-4a40-a775-07b50423cec5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1317992461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf6047793ecc44519667cf55e090296e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeaaf42d-88", "ovs_interfaceid": "deaaf42d-889f-4b49-abb5-3a3d4684ea5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-083b5a27-120f-4d26-ab38-fc4ff29626a0 req-6c68b642-0c38-4b66-9ed9-a1e9728615fd service nova] Acquired lock "refresh_cache-f0ffc053-4a57-486c-bc52-924e882dac0e" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.network.neutron [req-083b5a27-120f-4d26-ab38-fc4ff29626a0 req-6c68b642-0c38-4b66-9ed9-a1e9728615fd service nova] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Refreshing network info cache for port deaaf42d-889f-4b49-abb5-3a3d4684ea5f {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Start _get_guest_xml network_info=[{"id": "deaaf42d-889f-4b49-abb5-3a3d4684ea5f", "address": "fa:16:3e:c7:14:6b", "network": {"id": "ec191814-d9f8-4a40-a775-07b50423cec5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1317992461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf6047793ecc44519667cf55e090296e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeaaf42d-88", "ovs_interfaceid": "deaaf42d-889f-4b49-abb5-3a3d4684ea5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:20:59 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:20:59 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:20:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1578310688',display_name='tempest-VolumesSnapshotTestJSON-instance-1578310688',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1578310688',id=46,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEO0EyIvhoozvK7S4AsEA4ujp/MZqIAgyKNhENDEkFVrVIjvZ4gvk6x1LKO1D62bVc8kR+gA1GlKHyJtnpUG25ld/iISKYuj3IOqnlmOlunMoS2HnW+4A+izMW1n/ryPw==',key_name='tempest-keypair-622673028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf6047793ecc44519667cf55e090296e',ramdisk_id='',reservation_id='r-bnxbbdbx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2122802409',owner_user_name='tempest-VolumesSnapshotTestJSON-2122802409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:20:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93aee9c4331d46aab83b73dfe0584fa0',uuid=f0ffc053-4a57-486c-bc52-924e882dac0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "deaaf42d-889f-4b49-abb5-3a3d4684ea5f", "address": "fa:16:3e:c7:14:6b", "network": {"id": "ec191814-d9f8-4a40-a775-07b50423cec5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1317992461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf6047793ecc44519667cf55e090296e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeaaf42d-88", "ovs_interfaceid": "deaaf42d-889f-4b49-abb5-3a3d4684ea5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Converting VIF {"id": "deaaf42d-889f-4b49-abb5-3a3d4684ea5f", "address": "fa:16:3e:c7:14:6b", "network": {"id": "ec191814-d9f8-4a40-a775-07b50423cec5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1317992461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf6047793ecc44519667cf55e090296e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeaaf42d-88", "ovs_interfaceid": "deaaf42d-889f-4b49-abb5-3a3d4684ea5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:14:6b,bridge_name='br-int',has_traffic_filtering=True,id=deaaf42d-889f-4b49-abb5-3a3d4684ea5f,network=Network(ec191814-d9f8-4a40-a775-07b50423cec5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeaaf42d-88') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.objects.instance [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lazy-loading 'pci_devices' on Instance uuid f0ffc053-4a57-486c-bc52-924e882dac0e {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:20:59 user nova-compute[72504]:   <uuid>f0ffc053-4a57-486c-bc52-924e882dac0e</uuid>
Aug 01 20:20:59 user nova-compute[72504]:   <name>instance-0000002e</name>
Aug 01 20:20:59 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:20:59 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:20:59 user nova-compute[72504]:   <metadata>
Aug 01 20:20:59 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:20:59 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:20:59 user nova-compute[72504]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1578310688</nova:name>
Aug 01 20:20:59 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:20:59</nova:creationTime>
Aug 01 20:20:59 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:20:59 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:20:59 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:20:59 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:20:59 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:20:59 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:20:59 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:20:59 user nova-compute[72504]:       <nova:owner>
Aug 01 20:20:59 user nova-compute[72504]:         <nova:user uuid="93aee9c4331d46aab83b73dfe0584fa0">tempest-VolumesSnapshotTestJSON-2122802409-project-member</nova:user>
Aug 01 20:20:59 user nova-compute[72504]:         <nova:project uuid="cf6047793ecc44519667cf55e090296e">tempest-VolumesSnapshotTestJSON-2122802409</nova:project>
Aug 01 20:20:59 user nova-compute[72504]:       </nova:owner>
Aug 01 20:20:59 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 20:20:59 user nova-compute[72504]:       <nova:ports>
Aug 01 20:20:59 user nova-compute[72504]:         <nova:port uuid="deaaf42d-889f-4b49-abb5-3a3d4684ea5f">
Aug 01 20:20:59 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 20:20:59 user nova-compute[72504]:         </nova:port>
Aug 01 20:20:59 user nova-compute[72504]:       </nova:ports>
Aug 01 20:20:59 user nova-compute[72504]:     </nova:instance>
Aug 01 20:20:59 user nova-compute[72504]:   </metadata>
Aug 01 20:20:59 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:20:59 user nova-compute[72504]:     <system>
Aug 01 20:20:59 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:20:59 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:20:59 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:20:59 user nova-compute[72504]:       <entry name="serial">f0ffc053-4a57-486c-bc52-924e882dac0e</entry>
Aug 01 20:20:59 user nova-compute[72504]:       <entry name="uuid">f0ffc053-4a57-486c-bc52-924e882dac0e</entry>
Aug 01 20:20:59 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:20:59 user nova-compute[72504]:     </system>
Aug 01 20:20:59 user nova-compute[72504]:   </sysinfo>
Aug 01 20:20:59 user nova-compute[72504]:   <os>
Aug 01 20:20:59 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:20:59 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:20:59 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:20:59 user nova-compute[72504]:   </os>
Aug 01 20:20:59 user nova-compute[72504]:   <features>
Aug 01 20:20:59 user nova-compute[72504]:     <acpi/>
Aug 01 20:20:59 user nova-compute[72504]:     <apic/>
Aug 01 20:20:59 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:20:59 user nova-compute[72504]:   </features>
Aug 01 20:20:59 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:20:59 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:20:59 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:20:59 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:20:59 user nova-compute[72504]:   </clock>
Aug 01 20:20:59 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:20:59 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:20:59 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:20:59 user nova-compute[72504]:   </cpu>
Aug 01 20:20:59 user nova-compute[72504]:   <devices>
Aug 01 20:20:59 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 20:20:59 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 20:20:59 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/f0ffc053-4a57-486c-bc52-924e882dac0e/disk"/>
Aug 01 20:20:59 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:20:59 user nova-compute[72504]:     </disk>
Aug 01 20:20:59 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:20:59 user nova-compute[72504]:       <mac address="fa:16:3e:c7:14:6b"/>
Aug 01 20:20:59 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:20:59 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:20:59 user nova-compute[72504]:       <target dev="tapdeaaf42d-88"/>
Aug 01 20:20:59 user nova-compute[72504]:     </interface>
Aug 01 20:20:59 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:20:59 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/f0ffc053-4a57-486c-bc52-924e882dac0e/console.log" append="off"/>
Aug 01 20:20:59 user nova-compute[72504]:     </serial>
Aug 01 20:20:59 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:20:59 user nova-compute[72504]:     <video>
Aug 01 20:20:59 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:20:59 user nova-compute[72504]:     </video>
Aug 01 20:20:59 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:20:59 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:20:59 user nova-compute[72504]:     </rng>
Aug 01 20:20:59 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:20:59 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:20:59 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:20:59 user nova-compute[72504]:     </memballoon>
Aug 01 20:20:59 user nova-compute[72504]:   </devices>
Aug 01 20:20:59 user nova-compute[72504]: </domain>
Aug 01 20:20:59 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:20:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1578310688',display_name='tempest-VolumesSnapshotTestJSON-instance-1578310688',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1578310688',id=46,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEO0EyIvhoozvK7S4AsEA4ujp/MZqIAgyKNhENDEkFVrVIjvZ4gvk6x1LKO1D62bVc8kR+gA1GlKHyJtnpUG25ld/iISKYuj3IOqnlmOlunMoS2HnW+4A+izMW1n/ryPw==',key_name='tempest-keypair-622673028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf6047793ecc44519667cf55e090296e',ramdisk_id='',reservation_id='r-bnxbbdbx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2122802409',owner_user_name='tempest-VolumesSnapshotTestJSON-2122802409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:20:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93aee9c4331d46aab83b73dfe0584fa0',uuid=f0ffc053-4a57-486c-bc52-924e882dac0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "deaaf42d-889f-4b49-abb5-3a3d4684ea5f", "address": "fa:16:3e:c7:14:6b", "network": {"id": "ec191814-d9f8-4a40-a775-07b50423cec5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1317992461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf6047793ecc44519667cf55e090296e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeaaf42d-88", "ovs_interfaceid": "deaaf42d-889f-4b49-abb5-3a3d4684ea5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Converting VIF {"id": "deaaf42d-889f-4b49-abb5-3a3d4684ea5f", "address": "fa:16:3e:c7:14:6b", "network": {"id": "ec191814-d9f8-4a40-a775-07b50423cec5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1317992461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf6047793ecc44519667cf55e090296e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeaaf42d-88", "ovs_interfaceid": "deaaf42d-889f-4b49-abb5-3a3d4684ea5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:14:6b,bridge_name='br-int',has_traffic_filtering=True,id=deaaf42d-889f-4b49-abb5-3a3d4684ea5f,network=Network(ec191814-d9f8-4a40-a775-07b50423cec5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeaaf42d-88') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG os_vif [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:14:6b,bridge_name='br-int',has_traffic_filtering=True,id=deaaf42d-889f-4b49-abb5-3a3d4684ea5f,network=Network(ec191814-d9f8-4a40-a775-07b50423cec5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeaaf42d-88') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdeaaf42d-88, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdeaaf42d-88, col_values=(('external_ids', {'iface-id': 'deaaf42d-889f-4b49-abb5-3a3d4684ea5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:14:6b', 'vm-uuid': 'f0ffc053-4a57-486c-bc52-924e882dac0e'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:20:59 user nova-compute[72504]: INFO os_vif [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:14:6b,bridge_name='br-int',has_traffic_filtering=True,id=deaaf42d-889f-4b49-abb5-3a3d4684ea5f,network=Network(ec191814-d9f8-4a40-a775-07b50423cec5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeaaf42d-88')
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:20:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] No VIF found with MAC fa:16:3e:c7:14:6b, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:21:00 user nova-compute[72504]: DEBUG nova.network.neutron [req-083b5a27-120f-4d26-ab38-fc4ff29626a0 req-6c68b642-0c38-4b66-9ed9-a1e9728615fd service nova] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Updated VIF entry in instance network info cache for port deaaf42d-889f-4b49-abb5-3a3d4684ea5f. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:21:00 user nova-compute[72504]: DEBUG nova.network.neutron [req-083b5a27-120f-4d26-ab38-fc4ff29626a0 req-6c68b642-0c38-4b66-9ed9-a1e9728615fd service nova] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Updating instance_info_cache with network_info: [{"id": "deaaf42d-889f-4b49-abb5-3a3d4684ea5f", "address": "fa:16:3e:c7:14:6b", "network": {"id": "ec191814-d9f8-4a40-a775-07b50423cec5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1317992461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf6047793ecc44519667cf55e090296e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeaaf42d-88", "ovs_interfaceid": "deaaf42d-889f-4b49-abb5-3a3d4684ea5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:21:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-083b5a27-120f-4d26-ab38-fc4ff29626a0 req-6c68b642-0c38-4b66-9ed9-a1e9728615fd service nova] Releasing lock "refresh_cache-f0ffc053-4a57-486c-bc52-924e882dac0e" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:21:00 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690921245.7918403, c642255e-6e48-4cdb-92da-4cb0b00e681e => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:21:00 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] VM Stopped (Lifecycle Event)
Aug 01 20:21:00 user nova-compute[72504]: DEBUG nova.compute.manager [None req-2b1563c7-5b80-4766-b72a-1d8ba29c741c None None] [instance: c642255e-6e48-4cdb-92da-4cb0b00e681e] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:21:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:01 user nova-compute[72504]: DEBUG nova.compute.manager [req-47a9cc73-f157-4dad-824e-9d67475e3e3e req-90771a6f-c273-4c40-9d84-feb439d7a1ae service nova] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Received event network-vif-plugged-deaaf42d-889f-4b49-abb5-3a3d4684ea5f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:21:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-47a9cc73-f157-4dad-824e-9d67475e3e3e req-90771a6f-c273-4c40-9d84-feb439d7a1ae service nova] Acquiring lock "f0ffc053-4a57-486c-bc52-924e882dac0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:21:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-47a9cc73-f157-4dad-824e-9d67475e3e3e req-90771a6f-c273-4c40-9d84-feb439d7a1ae service nova] Lock "f0ffc053-4a57-486c-bc52-924e882dac0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:21:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-47a9cc73-f157-4dad-824e-9d67475e3e3e req-90771a6f-c273-4c40-9d84-feb439d7a1ae service nova] Lock "f0ffc053-4a57-486c-bc52-924e882dac0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:21:01 user nova-compute[72504]: DEBUG nova.compute.manager [req-47a9cc73-f157-4dad-824e-9d67475e3e3e req-90771a6f-c273-4c40-9d84-feb439d7a1ae service nova] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] No waiting events found dispatching network-vif-plugged-deaaf42d-889f-4b49-abb5-3a3d4684ea5f {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:21:01 user nova-compute[72504]: WARNING nova.compute.manager [req-47a9cc73-f157-4dad-824e-9d67475e3e3e req-90771a6f-c273-4c40-9d84-feb439d7a1ae service nova] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Received unexpected event network-vif-plugged-deaaf42d-889f-4b49-abb5-3a3d4684ea5f for instance with vm_state building and task_state spawning.
Aug 01 20:21:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:21:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:21:02 user nova-compute[72504]: DEBUG nova.objects.instance [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lazy-loading 'flavor' on Instance uuid 2caaa9dd-e1fd-465b-95a0-78fa51c96c15 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:21:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:21:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:21:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:21:02 user nova-compute[72504]: INFO nova.compute.manager [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Attaching volume 349f2538-4f19-4a2f-a260-a3317907dfd3 to /dev/vdb
Aug 01 20:21:02 user nova-compute[72504]: DEBUG os_brick.utils [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:21:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:02 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7656a5-c4d2-49fc-bbaa-6e045b759673]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:02 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c705abf-d681-4d8c-baca-b8ba2f641739]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:02 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a250a1-83b6-4a96-bf2e-a5466fcb3a37]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:02 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[641f77d2-c049-4212-90b1-93d17afbd2a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:21:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:21:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:21:03 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:21:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19136af-e53f-4ded-b303-5a7ac84ba4dd]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:21:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:21:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:21:03 user nova-compute[72504]: DEBUG os_brick.utils [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:21:03 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Updating existing volume attachment record: cbd63962-baf6-4154-b46c-f4ef962de5dd {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:21:03 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690921263.3687406, f0ffc053-4a57-486c-bc52-924e882dac0e => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:21:03 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] VM Resumed (Lifecycle Event)
Aug 01 20:21:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:21:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:21:03 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Instance spawned successfully.
Aug 01 20:21:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 20:21:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:21:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:21:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:21:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:21:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:21:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:21:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:21:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:21:03 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:21:03 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690921263.3693166, f0ffc053-4a57-486c-bc52-924e882dac0e => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:21:03 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] VM Started (Lifecycle Event)
Aug 01 20:21:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:21:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:21:03 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:21:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-e1cf3157-593d-4199-8a4e-ed4be253322b req-c0044f5d-df68-47cc-aa63-1a01c94120e5 service nova] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Received event network-vif-plugged-deaaf42d-889f-4b49-abb5-3a3d4684ea5f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:21:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e1cf3157-593d-4199-8a4e-ed4be253322b req-c0044f5d-df68-47cc-aa63-1a01c94120e5 service nova] Acquiring lock "f0ffc053-4a57-486c-bc52-924e882dac0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:21:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e1cf3157-593d-4199-8a4e-ed4be253322b req-c0044f5d-df68-47cc-aa63-1a01c94120e5 service nova] Lock "f0ffc053-4a57-486c-bc52-924e882dac0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:21:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e1cf3157-593d-4199-8a4e-ed4be253322b req-c0044f5d-df68-47cc-aa63-1a01c94120e5 service nova] Lock "f0ffc053-4a57-486c-bc52-924e882dac0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:21:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-e1cf3157-593d-4199-8a4e-ed4be253322b req-c0044f5d-df68-47cc-aa63-1a01c94120e5 service nova] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] No waiting events found dispatching network-vif-plugged-deaaf42d-889f-4b49-abb5-3a3d4684ea5f {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:21:03 user nova-compute[72504]: WARNING nova.compute.manager [req-e1cf3157-593d-4199-8a4e-ed4be253322b req-c0044f5d-df68-47cc-aa63-1a01c94120e5 service nova] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Received unexpected event network-vif-plugged-deaaf42d-889f-4b49-abb5-3a3d4684ea5f for instance with vm_state building and task_state spawning.
Aug 01 20:21:03 user nova-compute[72504]: INFO nova.compute.manager [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Took 6.04 seconds to spawn the instance on the hypervisor.
Aug 01 20:21:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:21:03 user nova-compute[72504]: INFO nova.compute.manager [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Took 6.63 seconds to build instance.
Aug 01 20:21:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d9720f2-e445-46eb-b411-692251ca2740 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "f0ffc053-4a57-486c-bc52-924e882dac0e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.754s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:21:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8e5aab7d-8778-407c-9b1b-fa0c9373204e tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "a4f9c59c-cf0b-4216-a194-22712725328d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:21:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8e5aab7d-8778-407c-9b1b-fa0c9373204e tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "a4f9c59c-cf0b-4216-a194-22712725328d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:21:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8e5aab7d-8778-407c-9b1b-fa0c9373204e tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:21:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8e5aab7d-8778-407c-9b1b-fa0c9373204e tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:21:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8e5aab7d-8778-407c-9b1b-fa0c9373204e tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:21:07 user nova-compute[72504]: INFO nova.compute.manager [None req-8e5aab7d-8778-407c-9b1b-fa0c9373204e tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Terminating instance
Aug 01 20:21:07 user nova-compute[72504]: DEBUG nova.compute.manager [None req-8e5aab7d-8778-407c-9b1b-fa0c9373204e tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:21:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:07 user nova-compute[72504]: DEBUG nova.compute.manager [req-00e2a12c-b037-4e8e-8384-99aefbda3f5b req-db17b832-5edb-4b0d-a560-9746af3ce8a0 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Received event network-vif-unplugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:21:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-00e2a12c-b037-4e8e-8384-99aefbda3f5b req-db17b832-5edb-4b0d-a560-9746af3ce8a0 service nova] Acquiring lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:21:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-00e2a12c-b037-4e8e-8384-99aefbda3f5b req-db17b832-5edb-4b0d-a560-9746af3ce8a0 service nova] Lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:21:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-00e2a12c-b037-4e8e-8384-99aefbda3f5b req-db17b832-5edb-4b0d-a560-9746af3ce8a0 service nova] Lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:21:07 user nova-compute[72504]: DEBUG nova.compute.manager [req-00e2a12c-b037-4e8e-8384-99aefbda3f5b req-db17b832-5edb-4b0d-a560-9746af3ce8a0 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] No waiting events found dispatching network-vif-unplugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:21:07 user nova-compute[72504]: DEBUG nova.compute.manager [req-00e2a12c-b037-4e8e-8384-99aefbda3f5b req-db17b832-5edb-4b0d-a560-9746af3ce8a0 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Received event network-vif-unplugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:21:08 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Instance destroyed successfully.
Aug 01 20:21:08 user nova-compute[72504]: DEBUG nova.objects.instance [None req-8e5aab7d-8778-407c-9b1b-fa0c9373204e tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'resources' on Instance uuid a4f9c59c-cf0b-4216-a194-22712725328d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:21:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-8e5aab7d-8778-407c-9b1b-fa0c9373204e tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-61706399',display_name='tempest-AttachVolumeTestJSON-server-61706399',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-61706399',id=39,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkLGKKoGI8XVsLxOaZh71hKpWONiOBrT0aje+GastgHoLyKuLQKlYfDXp3OwjC4WlZ28DTo1JlEqCpYnSgt/d2rMN3aO60eaUVx+bzZGYhJZWV5gQhPPIA8s7t5AmK8sA==',key_name='tempest-keypair-1070424172',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:11:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ef67b412883421f949be025bdc1cf38',ramdisk_id='',reservation_id='r-1eu867rc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1031917511',owner_user_name='tempest-AttachVolumeTestJSON-1031917511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:19:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90bea00e45b541baa6f98812cce770f8',uuid=a4f9c59c-cf0b-4216-a194-22712725328d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:21:08 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8e5aab7d-8778-407c-9b1b-fa0c9373204e tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Converting VIF {"id": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "address": "fa:16:3e:de:34:ea", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f38092-7f", "ovs_interfaceid": "b8f38092-7fe7-4274-8fcb-1e4a2808454e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:21:08 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-8e5aab7d-8778-407c-9b1b-fa0c9373204e tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:34:ea,bridge_name='br-int',has_traffic_filtering=True,id=b8f38092-7fe7-4274-8fcb-1e4a2808454e,network=Network(253a3888-9ae8-47b5-8875-9e4b823ac978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8f38092-7f') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:21:08 user nova-compute[72504]: DEBUG os_vif [None req-8e5aab7d-8778-407c-9b1b-fa0c9373204e tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:34:ea,bridge_name='br-int',has_traffic_filtering=True,id=b8f38092-7fe7-4274-8fcb-1e4a2808454e,network=Network(253a3888-9ae8-47b5-8875-9e4b823ac978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8f38092-7f') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:21:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8f38092-7f, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:21:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:21:08 user nova-compute[72504]: INFO os_vif [None req-8e5aab7d-8778-407c-9b1b-fa0c9373204e tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:34:ea,bridge_name='br-int',has_traffic_filtering=True,id=b8f38092-7fe7-4274-8fcb-1e4a2808454e,network=Network(253a3888-9ae8-47b5-8875-9e4b823ac978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8f38092-7f')
Aug 01 20:21:08 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-8e5aab7d-8778-407c-9b1b-fa0c9373204e tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Deleting instance files /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d_del
Aug 01 20:21:08 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-8e5aab7d-8778-407c-9b1b-fa0c9373204e tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Deletion of /opt/stack/data/nova/instances/a4f9c59c-cf0b-4216-a194-22712725328d_del complete
Aug 01 20:21:08 user nova-compute[72504]: INFO nova.compute.manager [None req-8e5aab7d-8778-407c-9b1b-fa0c9373204e tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 01 20:21:08 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-8e5aab7d-8778-407c-9b1b-fa0c9373204e tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:21:08 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:21:08 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:21:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:09 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:21:09 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Took 0.90 seconds to deallocate network for instance.
Aug 01 20:21:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8e5aab7d-8778-407c-9b1b-fa0c9373204e tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:21:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8e5aab7d-8778-407c-9b1b-fa0c9373204e tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:21:09 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-8e5aab7d-8778-407c-9b1b-fa0c9373204e tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:21:09 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-8e5aab7d-8778-407c-9b1b-fa0c9373204e tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:21:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8e5aab7d-8778-407c-9b1b-fa0c9373204e tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:21:09 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-8e5aab7d-8778-407c-9b1b-fa0c9373204e tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Deleted allocations for instance a4f9c59c-cf0b-4216-a194-22712725328d
Aug 01 20:21:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8e5aab7d-8778-407c-9b1b-fa0c9373204e tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "a4f9c59c-cf0b-4216-a194-22712725328d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.141s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG nova.compute.manager [req-5c8c0ec3-e9fd-4906-949c-fedac2378e12 req-d5eea1f4-3e88-410b-bca6-a4999d485cf0 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Received event network-vif-plugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5c8c0ec3-e9fd-4906-949c-fedac2378e12 req-d5eea1f4-3e88-410b-bca6-a4999d485cf0 service nova] Acquiring lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5c8c0ec3-e9fd-4906-949c-fedac2378e12 req-d5eea1f4-3e88-410b-bca6-a4999d485cf0 service nova] Lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5c8c0ec3-e9fd-4906-949c-fedac2378e12 req-d5eea1f4-3e88-410b-bca6-a4999d485cf0 service nova] Lock "a4f9c59c-cf0b-4216-a194-22712725328d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG nova.compute.manager [req-5c8c0ec3-e9fd-4906-949c-fedac2378e12 req-d5eea1f4-3e88-410b-bca6-a4999d485cf0 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] No waiting events found dispatching network-vif-plugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:21:10 user nova-compute[72504]: WARNING nova.compute.manager [req-5c8c0ec3-e9fd-4906-949c-fedac2378e12 req-d5eea1f4-3e88-410b-bca6-a4999d485cf0 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Received unexpected event network-vif-plugged-b8f38092-7fe7-4274-8fcb-1e4a2808454e for instance with vm_state deleted and task_state None.
Aug 01 20:21:10 user nova-compute[72504]: DEBUG nova.compute.manager [req-5c8c0ec3-e9fd-4906-949c-fedac2378e12 req-d5eea1f4-3e88-410b-bca6-a4999d485cf0 service nova] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Received event network-vif-deleted-b8f38092-7fe7-4274-8fcb-1e4a2808454e {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SkDRpVmP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:21:10 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:21:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:21:10 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:21:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:21:10 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5282065-f777-418e-ac0b-1e5dc2eb907c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:21:10 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ebe939-65fc-4dd5-8adf-3996e942297c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3] added
Aug 01 20:21:10 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[94915dab-72c3-4dd5-af76-3a34a4646ae2]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbd2c17-55b3-4ccd-9ba1-53ff99825681]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SkDRpVmP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SkDRpVmP" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d993e9f-36db-4761-912b-ced3152fd58d]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SkDRpVmP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[110cfd33-7b07-4fac-881f-34d2239a461d]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b2650b-8eba-4281-b5aa-d2577461720a]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:21:10 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:21:10 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b99a853-8024-4207-8451-eac147ba272c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3, portal: 172.16.0.220,3260]
Aug 01 20:21:10 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3, portal: 172.16.0.220,3260] successful.
Aug 01 20:21:10 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1276fe8f-bcda-46cb-b108-0e665631c8c1]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49110f7-05b8-4625-b94d-76b687c80dac]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:21:10 user nova-compute[72504]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 (non-flash)
Aug 01 20:21:10 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:21:10 user nova-compute[72504]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 (non-flash)
Aug 01 20:21:10 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a473c6-d96c-459a-9d0d-172a29bb135f]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:10 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:21:11 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:21:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SkDRpVmP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:21:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:21:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26564323438643136', 'path': '/dev/sdb'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:21:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564323438643136', 'path': '/dev/sdb'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:21:11 user nova-compute[72504]: DEBUG nova.objects.instance [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lazy-loading 'flavor' on Instance uuid 2caaa9dd-e1fd-465b-95a0-78fa51c96c15 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:21:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 20:21:12 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:21:12 user nova-compute[72504]:   <source dev="/dev/sdb"/>
Aug 01 20:21:12 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:21:12 user nova-compute[72504]:   <serial>349f2538-4f19-4a2f-a260-a3317907dfd3</serial>
Aug 01 20:21:12 user nova-compute[72504]: </disk>
Aug 01 20:21:12 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 20:21:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:21:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:21:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] No VIF found with MAC fa:16:3e:4e:0e:3d, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:21:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fd63c8f9-fdf2-4f18-9657-2c9aff1d86da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.707s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:21:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:17 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:21:17 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72504) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 20:21:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:21:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:21:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:21:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:21:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:20 user nova-compute[72504]: DEBUG nova.compute.manager [req-aa520c88-5789-4b51-ad2b-650027b4fac0 req-b9b97b97-bf02-4889-84f1-c1089936a44f service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Received event network-changed-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:21:20 user nova-compute[72504]: DEBUG nova.compute.manager [req-aa520c88-5789-4b51-ad2b-650027b4fac0 req-b9b97b97-bf02-4889-84f1-c1089936a44f service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Refreshing instance network info cache due to event network-changed-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:21:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-aa520c88-5789-4b51-ad2b-650027b4fac0 req-b9b97b97-bf02-4889-84f1-c1089936a44f service nova] Acquiring lock "refresh_cache-2caaa9dd-e1fd-465b-95a0-78fa51c96c15" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:21:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-aa520c88-5789-4b51-ad2b-650027b4fac0 req-b9b97b97-bf02-4889-84f1-c1089936a44f service nova] Acquired lock "refresh_cache-2caaa9dd-e1fd-465b-95a0-78fa51c96c15" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:21:20 user nova-compute[72504]: DEBUG nova.network.neutron [req-aa520c88-5789-4b51-ad2b-650027b4fac0 req-b9b97b97-bf02-4889-84f1-c1089936a44f service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Refreshing network info cache for port bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:21:21 user nova-compute[72504]: DEBUG nova.network.neutron [req-aa520c88-5789-4b51-ad2b-650027b4fac0 req-b9b97b97-bf02-4889-84f1-c1089936a44f service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Updated VIF entry in instance network info cache for port bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:21:21 user nova-compute[72504]: DEBUG nova.network.neutron [req-aa520c88-5789-4b51-ad2b-650027b4fac0 req-b9b97b97-bf02-4889-84f1-c1089936a44f service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Updating instance_info_cache with network_info: [{"id": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "address": "fa:16:3e:4e:0e:3d", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6cbd7a-88", "ovs_interfaceid": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:21:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-aa520c88-5789-4b51-ad2b-650027b4fac0 req-b9b97b97-bf02-4889-84f1-c1089936a44f service nova] Releasing lock "refresh_cache-2caaa9dd-e1fd-465b-95a0-78fa51c96c15" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:21:22 user nova-compute[72504]: DEBUG nova.compute.manager [req-d7f66538-89e9-4862-a424-e12ff5d143b0 req-2eb6cd12-941f-4639-8292-6d7fda2e07fd service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Received event network-changed-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:21:22 user nova-compute[72504]: DEBUG nova.compute.manager [req-d7f66538-89e9-4862-a424-e12ff5d143b0 req-2eb6cd12-941f-4639-8292-6d7fda2e07fd service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Refreshing instance network info cache due to event network-changed-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:21:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d7f66538-89e9-4862-a424-e12ff5d143b0 req-2eb6cd12-941f-4639-8292-6d7fda2e07fd service nova] Acquiring lock "refresh_cache-2caaa9dd-e1fd-465b-95a0-78fa51c96c15" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:21:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d7f66538-89e9-4862-a424-e12ff5d143b0 req-2eb6cd12-941f-4639-8292-6d7fda2e07fd service nova] Acquired lock "refresh_cache-2caaa9dd-e1fd-465b-95a0-78fa51c96c15" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:21:22 user nova-compute[72504]: DEBUG nova.network.neutron [req-d7f66538-89e9-4862-a424-e12ff5d143b0 req-2eb6cd12-941f-4639-8292-6d7fda2e07fd service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Refreshing network info cache for port bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:21:23 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690921268.382802, a4f9c59c-cf0b-4216-a194-22712725328d => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:21:23 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] VM Stopped (Lifecycle Event)
Aug 01 20:21:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-96288d02-46a4-47a7-9e52-ec040c8e0f93 None None] [instance: a4f9c59c-cf0b-4216-a194-22712725328d] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:21:23 user nova-compute[72504]: DEBUG nova.network.neutron [req-d7f66538-89e9-4862-a424-e12ff5d143b0 req-2eb6cd12-941f-4639-8292-6d7fda2e07fd service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Updated VIF entry in instance network info cache for port bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:21:23 user nova-compute[72504]: DEBUG nova.network.neutron [req-d7f66538-89e9-4862-a424-e12ff5d143b0 req-2eb6cd12-941f-4639-8292-6d7fda2e07fd service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Updating instance_info_cache with network_info: [{"id": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "address": "fa:16:3e:4e:0e:3d", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6cbd7a-88", "ovs_interfaceid": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:21:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d7f66538-89e9-4862-a424-e12ff5d143b0 req-2eb6cd12-941f-4639-8292-6d7fda2e07fd service nova] Releasing lock "refresh_cache-2caaa9dd-e1fd-465b-95a0-78fa51c96c15" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:21:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:21:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:21:26 user nova-compute[72504]: INFO nova.compute.manager [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Rebooting instance
Aug 01 20:21:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "refresh_cache-2caaa9dd-e1fd-465b-95a0-78fa51c96c15" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:21:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquired lock "refresh_cache-2caaa9dd-e1fd-465b-95a0-78fa51c96c15" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:21:26 user nova-compute[72504]: DEBUG nova.network.neutron [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:21:27 user nova-compute[72504]: DEBUG nova.network.neutron [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Updating instance_info_cache with network_info: [{"id": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "address": "fa:16:3e:4e:0e:3d", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6cbd7a-88", "ovs_interfaceid": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:21:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Releasing lock "refresh_cache-2caaa9dd-e1fd-465b-95a0-78fa51c96c15" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:21:27 user nova-compute[72504]: DEBUG nova.compute.manager [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:21:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:27 user nova-compute[72504]: DEBUG nova.compute.manager [req-c4b4b524-b1d5-4b71-91d9-ac9bbb5c23f8 req-3559a41b-62ca-48a2-b0b8-1fa5e79d025b service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Received event network-vif-unplugged-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:21:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c4b4b524-b1d5-4b71-91d9-ac9bbb5c23f8 req-3559a41b-62ca-48a2-b0b8-1fa5e79d025b service nova] Acquiring lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:21:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c4b4b524-b1d5-4b71-91d9-ac9bbb5c23f8 req-3559a41b-62ca-48a2-b0b8-1fa5e79d025b service nova] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:21:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c4b4b524-b1d5-4b71-91d9-ac9bbb5c23f8 req-3559a41b-62ca-48a2-b0b8-1fa5e79d025b service nova] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:21:27 user nova-compute[72504]: DEBUG nova.compute.manager [req-c4b4b524-b1d5-4b71-91d9-ac9bbb5c23f8 req-3559a41b-62ca-48a2-b0b8-1fa5e79d025b service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] No waiting events found dispatching network-vif-unplugged-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:21:27 user nova-compute[72504]: WARNING nova.compute.manager [req-c4b4b524-b1d5-4b71-91d9-ac9bbb5c23f8 req-3559a41b-62ca-48a2-b0b8-1fa5e79d025b service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Received unexpected event network-vif-unplugged-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 20:21:27 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Instance destroyed successfully.
Aug 01 20:21:27 user nova-compute[72504]: DEBUG nova.objects.instance [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lazy-loading 'resources' on Instance uuid 2caaa9dd-e1fd-465b-95a0-78fa51c96c15 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:21:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:19:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1596056108',display_name='tempest-TestMinimumBasicScenario-server-1596056108',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1596056108',id=45,image_ref='82aacf83-218b-493c-9327-6c737b4deaba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfv0+Sv8YQSyFEhS1Mp0+BN3XoNdJsAd9DgP/q9A7Z1pq/KksnP1DUgnH5iZS5TDMZKNXkrXPfXBcsLb8arVe7V1dL2QRX9XChORu7HtUkKOV7MNd0UdfUtOONBLaIw6w==',key_name='tempest-TestMinimumBasicScenario-311143372',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:19:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72d4446b451947be88bc15a1a938b859',ramdisk_id='',reservation_id='r-2fmlhn1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='82aacf83-218b-493c-9327-6c737b4deaba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-869578324',owner_user_name='tempest-TestMinimumBasicScenario-869578324-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:21:27Z,user_data=None,user_id='c0015fa066434b679e0126a916f96393',uuid=2caaa9dd-e1fd-465b-95a0-78fa51c96c15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "address": "fa:16:3e:4e:0e:3d", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6cbd7a-88", "ovs_interfaceid": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:21:27 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Converting VIF {"id": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "address": "fa:16:3e:4e:0e:3d", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6cbd7a-88", "ovs_interfaceid": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:0e:3d,bridge_name='br-int',has_traffic_filtering=True,id=bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7,network=Network(786ed785-b5d5-43d6-b39e-3d8c490dc3f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6cbd7a-88') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_vif [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:0e:3d,bridge_name='br-int',has_traffic_filtering=True,id=bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7,network=Network(786ed785-b5d5-43d6-b39e-3d8c490dc3f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6cbd7a-88') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb6cbd7a-88, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:21:28 user nova-compute[72504]: INFO os_vif [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:0e:3d,bridge_name='br-int',has_traffic_filtering=True,id=bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7,network=Network(786ed785-b5d5-43d6-b39e-3d8c490dc3f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6cbd7a-88')
Aug 01 20:21:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SkDRpVmP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:21:28 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b9ac5c-3bbc-4ff4-827c-3f83a6f9da11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebab5fe7-bd7c-4be3-a933-9c1a1f78b264]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:21:28 user nova-compute[72504]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 (non-flash)
Aug 01 20:21:28 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:21:28 user nova-compute[72504]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 (non-flash)
Aug 01 20:21:28 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3f45ca050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3'): ({'sdb'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Removing single pathed devices sdb {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3a7439-b3e4-4bc7-bec6-3b0adfa477a5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac65c47d-c8a8-4b2a-9bef-da4de71f716a]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Flushing IO for device /dev/sdb {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6b442e-f876-4fb7-bfc6-e6e69e50d2e9]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d092d138-7a9b-462d-a202-b07e925bfe5c]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ddda8e-a5f5-4654-8d70-d29a3963376b]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a906fc5-86bc-4a49-b2b8-2c33cca8bb44]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3, portal: 172.16.0.220,3260]
Aug 01 20:21:28 user nova-compute[72504]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3, portal: 172.16.0.220,3260] successful.
Aug 01 20:21:28 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8597d4-0e67-4041-8a00-6d3c4dfebaba]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.253s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] <== disconnect_volume: return (256ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Start _get_guest_xml network_info=[{"id": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "address": "fa:16:3e:4e:0e:3d", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6cbd7a-88", "ovs_interfaceid": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=82aacf83-218b-493c-9327-6c737b4deaba,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '82aacf83-218b-493c-9327-6c737b4deaba'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SkDRpVmP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '2caaa9dd-e1fd-465b-95a0-78fa51c96c15', 'attached_at': '', 'detached_at': '', 'volume_id': '349f2538-4f19-4a2f-a260-a3317907dfd3', 'serial': '349f2538-4f19-4a2f-a260-a3317907dfd3'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': 'cbd63962-baf6-4154-b46c-f4ef962de5dd', 'volume_type': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:21:28 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:21:28 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:21:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=82aacf83-218b-493c-9327-6c737b4deaba,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG nova.objects.instance [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2caaa9dd-e1fd-465b-95a0-78fa51c96c15 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SkDRpVmP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:21:28 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:21:28 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:21:28 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[af09882f-b89d-424e-af64-6e330db38aff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:21:28 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4d8192-ad92-4066-a1b5-3a77be404f05]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3] added
Aug 01 20:21:28 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad48d39d-ae09-45b8-b69c-5a7a45420dda]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73ee498-92a2-414b-8ec0-c1a1c8549196]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SkDRpVmP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SkDRpVmP" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[408748a8-dd32-49a2-9a5a-0d55bfc5489a]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SkDRpVmP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef221442-de35-471b-ab1a-b0e864a1eeeb]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8767f9c7-7679-4f8a-a335-1a5ada514b2a]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:21:28 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:21:28 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[925b445d-4abf-47ee-b207-9b8e08570523]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3, portal: 172.16.0.220,3260]
Aug 01 20:21:28 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3, portal: 172.16.0.220,3260] successful.
Aug 01 20:21:28 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1b88d0-37ee-4934-a2cb-bb6343093e65]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0787d82e-30a7-4024-bf22-c78aa7fb03b4]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:21:28 user nova-compute[72504]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 (non-flash)
Aug 01 20:21:28 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:21:28 user nova-compute[72504]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 (non-flash)
Aug 01 20:21:28 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16a0621-4ef5-4442-a6c3-ee25fa4dd782]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SkDRpVmP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:21:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:29 user nova-compute[72504]: DEBUG nova.compute.manager [req-7b78663b-42ff-4a55-9267-9f792a6bd2ad req-10e8dffa-2913-4c08-89a1-f3810dd5bd73 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Received event network-vif-plugged-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:21:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7b78663b-42ff-4a55-9267-9f792a6bd2ad req-10e8dffa-2913-4c08-89a1-f3810dd5bd73 service nova] Acquiring lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:21:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7b78663b-42ff-4a55-9267-9f792a6bd2ad req-10e8dffa-2913-4c08-89a1-f3810dd5bd73 service nova] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:21:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7b78663b-42ff-4a55-9267-9f792a6bd2ad req-10e8dffa-2913-4c08-89a1-f3810dd5bd73 service nova] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:21:29 user nova-compute[72504]: DEBUG nova.compute.manager [req-7b78663b-42ff-4a55-9267-9f792a6bd2ad req-10e8dffa-2913-4c08-89a1-f3810dd5bd73 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] No waiting events found dispatching network-vif-plugged-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:21:29 user nova-compute[72504]: WARNING nova.compute.manager [req-7b78663b-42ff-4a55-9267-9f792a6bd2ad req-10e8dffa-2913-4c08-89a1-f3810dd5bd73 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Received unexpected event network-vif-plugged-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 20:21:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:21:29 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26564323438643136', 'path': '/dev/sdb'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:21:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564323438643136', 'path': '/dev/sdb'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:21:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:19:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1596056108',display_name='tempest-TestMinimumBasicScenario-server-1596056108',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1596056108',id=45,image_ref='82aacf83-218b-493c-9327-6c737b4deaba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfv0+Sv8YQSyFEhS1Mp0+BN3XoNdJsAd9DgP/q9A7Z1pq/KksnP1DUgnH5iZS5TDMZKNXkrXPfXBcsLb8arVe7V1dL2QRX9XChORu7HtUkKOV7MNd0UdfUtOONBLaIw6w==',key_name='tempest-TestMinimumBasicScenario-311143372',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:19:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72d4446b451947be88bc15a1a938b859',ramdisk_id='',reservation_id='r-2fmlhn1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='82aacf83-218b-493c-9327-6c737b4deaba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-869578324',owner_user_name='tempest-TestMinimumBasicScenario-869578324-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:21:27Z,user_data=None,user_id='c0015fa066434b679e0126a916f96393',uuid=2caaa9dd-e1fd-465b-95a0-78fa51c96c15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "address": "fa:16:3e:4e:0e:3d", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6cbd7a-88", "ovs_interfaceid": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:21:29 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Converting VIF {"id": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "address": "fa:16:3e:4e:0e:3d", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6cbd7a-88", "ovs_interfaceid": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:21:29 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:0e:3d,bridge_name='br-int',has_traffic_filtering=True,id=bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7,network=Network(786ed785-b5d5-43d6-b39e-3d8c490dc3f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6cbd7a-88') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:21:29 user nova-compute[72504]: DEBUG nova.objects.instance [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lazy-loading 'pci_devices' on Instance uuid 2caaa9dd-e1fd-465b-95a0-78fa51c96c15 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:21:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:21:29 user nova-compute[72504]:   <uuid>2caaa9dd-e1fd-465b-95a0-78fa51c96c15</uuid>
Aug 01 20:21:29 user nova-compute[72504]:   <name>instance-0000002d</name>
Aug 01 20:21:29 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:21:29 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:21:29 user nova-compute[72504]:   <metadata>
Aug 01 20:21:29 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:21:29 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:21:29 user nova-compute[72504]:       <nova:name>tempest-TestMinimumBasicScenario-server-1596056108</nova:name>
Aug 01 20:21:29 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:21:28</nova:creationTime>
Aug 01 20:21:29 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:21:29 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:21:29 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:21:29 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:21:29 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:21:29 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:21:29 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:21:29 user nova-compute[72504]:       <nova:owner>
Aug 01 20:21:29 user nova-compute[72504]:         <nova:user uuid="c0015fa066434b679e0126a916f96393">tempest-TestMinimumBasicScenario-869578324-project-member</nova:user>
Aug 01 20:21:29 user nova-compute[72504]:         <nova:project uuid="72d4446b451947be88bc15a1a938b859">tempest-TestMinimumBasicScenario-869578324</nova:project>
Aug 01 20:21:29 user nova-compute[72504]:       </nova:owner>
Aug 01 20:21:29 user nova-compute[72504]:       <nova:root type="image" uuid="82aacf83-218b-493c-9327-6c737b4deaba"/>
Aug 01 20:21:29 user nova-compute[72504]:       <nova:ports>
Aug 01 20:21:29 user nova-compute[72504]:         <nova:port uuid="bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7">
Aug 01 20:21:29 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 20:21:29 user nova-compute[72504]:         </nova:port>
Aug 01 20:21:29 user nova-compute[72504]:       </nova:ports>
Aug 01 20:21:29 user nova-compute[72504]:     </nova:instance>
Aug 01 20:21:29 user nova-compute[72504]:   </metadata>
Aug 01 20:21:29 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:21:29 user nova-compute[72504]:     <system>
Aug 01 20:21:29 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:21:29 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:21:29 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:21:29 user nova-compute[72504]:       <entry name="serial">2caaa9dd-e1fd-465b-95a0-78fa51c96c15</entry>
Aug 01 20:21:29 user nova-compute[72504]:       <entry name="uuid">2caaa9dd-e1fd-465b-95a0-78fa51c96c15</entry>
Aug 01 20:21:29 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:21:29 user nova-compute[72504]:     </system>
Aug 01 20:21:29 user nova-compute[72504]:   </sysinfo>
Aug 01 20:21:29 user nova-compute[72504]:   <os>
Aug 01 20:21:29 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:21:29 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:21:29 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:21:29 user nova-compute[72504]:   </os>
Aug 01 20:21:29 user nova-compute[72504]:   <features>
Aug 01 20:21:29 user nova-compute[72504]:     <acpi/>
Aug 01 20:21:29 user nova-compute[72504]:     <apic/>
Aug 01 20:21:29 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:21:29 user nova-compute[72504]:   </features>
Aug 01 20:21:29 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:21:29 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:21:29 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:21:29 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:21:29 user nova-compute[72504]:   </clock>
Aug 01 20:21:29 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:21:29 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:21:29 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:21:29 user nova-compute[72504]:   </cpu>
Aug 01 20:21:29 user nova-compute[72504]:   <devices>
Aug 01 20:21:29 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 20:21:29 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 20:21:29 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk"/>
Aug 01 20:21:29 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:21:29 user nova-compute[72504]:     </disk>
Aug 01 20:21:29 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 20:21:29 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:21:29 user nova-compute[72504]:       <source dev="/dev/sdb"/>
Aug 01 20:21:29 user nova-compute[72504]:       <target dev="vdb" bus="virtio"/>
Aug 01 20:21:29 user nova-compute[72504]:       <serial>349f2538-4f19-4a2f-a260-a3317907dfd3</serial>
Aug 01 20:21:29 user nova-compute[72504]:     </disk>
Aug 01 20:21:29 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:21:29 user nova-compute[72504]:       <mac address="fa:16:3e:4e:0e:3d"/>
Aug 01 20:21:29 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:21:29 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:21:29 user nova-compute[72504]:       <target dev="tapbb6cbd7a-88"/>
Aug 01 20:21:29 user nova-compute[72504]:     </interface>
Aug 01 20:21:29 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:21:29 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/console.log" append="off"/>
Aug 01 20:21:29 user nova-compute[72504]:     </serial>
Aug 01 20:21:29 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:21:29 user nova-compute[72504]:     <video>
Aug 01 20:21:29 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:21:29 user nova-compute[72504]:     </video>
Aug 01 20:21:29 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:21:29 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:21:29 user nova-compute[72504]:     </rng>
Aug 01 20:21:29 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:21:29 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:21:29 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:21:29 user nova-compute[72504]:     </memballoon>
Aug 01 20:21:29 user nova-compute[72504]:   </devices>
Aug 01 20:21:29 user nova-compute[72504]: </domain>
Aug 01 20:21:29 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:21:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:21:29 user nova-compute[72504]: DEBUG nova.objects.instance [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2caaa9dd-e1fd-465b-95a0-78fa51c96c15 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:21:29 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/805772ebaa4e793259cc11807c8fdb7b5f4dfd9c --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/805772ebaa4e793259cc11807c8fdb7b5f4dfd9c --force-share --output=json" returned: 0 in 0.141s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:30 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 20:21:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:30 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Cannot resize image /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 20:21:30 user nova-compute[72504]: DEBUG nova.objects.instance [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lazy-loading 'migration_context' on Instance uuid 2caaa9dd-e1fd-465b-95a0-78fa51c96c15 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:21:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:19:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1596056108',display_name='tempest-TestMinimumBasicScenario-server-1596056108',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1596056108',id=45,image_ref='82aacf83-218b-493c-9327-6c737b4deaba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfv0+Sv8YQSyFEhS1Mp0+BN3XoNdJsAd9DgP/q9A7Z1pq/KksnP1DUgnH5iZS5TDMZKNXkrXPfXBcsLb8arVe7V1dL2QRX9XChORu7HtUkKOV7MNd0UdfUtOONBLaIw6w==',key_name='tempest-TestMinimumBasicScenario-311143372',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:19:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='72d4446b451947be88bc15a1a938b859',ramdisk_id='',reservation_id='r-2fmlhn1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='82aacf83-218b-493c-9327-6c737b4deaba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-869578324',owner_user_name='tempest-TestMinimumBasicScenario-869578324-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:21:27Z,user_data=None,user_id='c0015fa066434b679e0126a916f96393',uuid=2caaa9dd-e1fd-465b-95a0-78fa51c96c15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "address": "fa:16:3e:4e:0e:3d", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6cbd7a-88", "ovs_interfaceid": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:21:30 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Converting VIF {"id": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "address": "fa:16:3e:4e:0e:3d", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6cbd7a-88", "ovs_interfaceid": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:21:30 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:0e:3d,bridge_name='br-int',has_traffic_filtering=True,id=bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7,network=Network(786ed785-b5d5-43d6-b39e-3d8c490dc3f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6cbd7a-88') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:21:30 user nova-compute[72504]: DEBUG os_vif [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:0e:3d,bridge_name='br-int',has_traffic_filtering=True,id=bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7,network=Network(786ed785-b5d5-43d6-b39e-3d8c490dc3f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6cbd7a-88') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:21:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:21:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:21:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb6cbd7a-88, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:21:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbb6cbd7a-88, col_values=(('external_ids', {'iface-id': 'bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:0e:3d', 'vm-uuid': '2caaa9dd-e1fd-465b-95a0-78fa51c96c15'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:21:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:21:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:30 user nova-compute[72504]: INFO os_vif [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:0e:3d,bridge_name='br-int',has_traffic_filtering=True,id=bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7,network=Network(786ed785-b5d5-43d6-b39e-3d8c490dc3f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6cbd7a-88')
Aug 01 20:21:30 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:21:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:31 user nova-compute[72504]: DEBUG nova.compute.manager [req-380aa783-115c-43cc-9cdd-4613dddb34d4 req-1585a102-575c-4220-8ab5-bf5e0be1c643 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Received event network-vif-plugged-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:21:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-380aa783-115c-43cc-9cdd-4613dddb34d4 req-1585a102-575c-4220-8ab5-bf5e0be1c643 service nova] Acquiring lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:21:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-380aa783-115c-43cc-9cdd-4613dddb34d4 req-1585a102-575c-4220-8ab5-bf5e0be1c643 service nova] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:21:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-380aa783-115c-43cc-9cdd-4613dddb34d4 req-1585a102-575c-4220-8ab5-bf5e0be1c643 service nova] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:21:31 user nova-compute[72504]: DEBUG nova.compute.manager [req-380aa783-115c-43cc-9cdd-4613dddb34d4 req-1585a102-575c-4220-8ab5-bf5e0be1c643 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] No waiting events found dispatching network-vif-plugged-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:21:31 user nova-compute[72504]: WARNING nova.compute.manager [req-380aa783-115c-43cc-9cdd-4613dddb34d4 req-1585a102-575c-4220-8ab5-bf5e0be1c643 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Received unexpected event network-vif-plugged-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 20:21:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:33 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Removed pending event for 2caaa9dd-e1fd-465b-95a0-78fa51c96c15 due to event {{(pid=72504) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 20:21:33 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690921293.6396494, 2caaa9dd-e1fd-465b-95a0-78fa51c96c15 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:21:33 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] VM Resumed (Lifecycle Event)
Aug 01 20:21:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:21:33 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Instance rebooted successfully.
Aug 01 20:21:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:21:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:21:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:21:33 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 01 20:21:33 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690921293.6442146, 2caaa9dd-e1fd-465b-95a0-78fa51c96c15 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:21:33 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] VM Started (Lifecycle Event)
Aug 01 20:21:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:21:33 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:21:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-9378a0ef-3ae5-4ec2-b40e-aac97b133198 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.068s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:21:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:33 user nova-compute[72504]: DEBUG nova.compute.manager [req-692317d0-44d0-42c1-9b82-2bc1fec4f5ab req-54bb39d4-c7c1-492d-b4d3-2467e6e80359 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Received event network-vif-plugged-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:21:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-692317d0-44d0-42c1-9b82-2bc1fec4f5ab req-54bb39d4-c7c1-492d-b4d3-2467e6e80359 service nova] Acquiring lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:21:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-692317d0-44d0-42c1-9b82-2bc1fec4f5ab req-54bb39d4-c7c1-492d-b4d3-2467e6e80359 service nova] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:21:33 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-692317d0-44d0-42c1-9b82-2bc1fec4f5ab req-54bb39d4-c7c1-492d-b4d3-2467e6e80359 service nova] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:21:33 user nova-compute[72504]: DEBUG nova.compute.manager [req-692317d0-44d0-42c1-9b82-2bc1fec4f5ab req-54bb39d4-c7c1-492d-b4d3-2467e6e80359 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] No waiting events found dispatching network-vif-plugged-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:21:33 user nova-compute[72504]: WARNING nova.compute.manager [req-692317d0-44d0-42c1-9b82-2bc1fec4f5ab req-54bb39d4-c7c1-492d-b4d3-2467e6e80359 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Received unexpected event network-vif-plugged-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 for instance with vm_state active and task_state None.
Aug 01 20:21:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:35 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:21:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:38 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:21:39 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:21:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:43 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:21:43 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:21:43 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 20:21:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-95c7da6a-c9a5-4441-9819-1219f7d6793f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:21:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-95c7da6a-c9a5-4441-9819-1219f7d6793f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:21:43 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:21:43 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lazy-loading 'info_cache' on Instance uuid 95c7da6a-c9a5-4441-9819-1219f7d6793f {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:21:44 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Updating instance_info_cache with network_info: [{"id": "e6acb053-8365-45b0-ac25-1f27f42162ff", "address": "fa:16:3e:01:7a:65", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acb053-83", "ovs_interfaceid": "e6acb053-8365-45b0-ac25-1f27f42162ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:21:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-95c7da6a-c9a5-4441-9819-1219f7d6793f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:21:44 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:21:44 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:21:44 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:21:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-83861038-f261-4e7c-baea-ef7237e26863 req-47093171-edb8-41b3-8735-cd3741f6d37a service nova] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Received event network-changed-e6acb053-8365-45b0-ac25-1f27f42162ff {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:21:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-83861038-f261-4e7c-baea-ef7237e26863 req-47093171-edb8-41b3-8735-cd3741f6d37a service nova] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Refreshing instance network info cache due to event network-changed-e6acb053-8365-45b0-ac25-1f27f42162ff. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:21:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-83861038-f261-4e7c-baea-ef7237e26863 req-47093171-edb8-41b3-8735-cd3741f6d37a service nova] Acquiring lock "refresh_cache-95c7da6a-c9a5-4441-9819-1219f7d6793f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:21:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-83861038-f261-4e7c-baea-ef7237e26863 req-47093171-edb8-41b3-8735-cd3741f6d37a service nova] Acquired lock "refresh_cache-95c7da6a-c9a5-4441-9819-1219f7d6793f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:21:44 user nova-compute[72504]: DEBUG nova.network.neutron [req-83861038-f261-4e7c-baea-ef7237e26863 req-47093171-edb8-41b3-8735-cd3741f6d37a service nova] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Refreshing network info cache for port e6acb053-8365-45b0-ac25-1f27f42162ff {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:21:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "95c7da6a-c9a5-4441-9819-1219f7d6793f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:21:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "95c7da6a-c9a5-4441-9819-1219f7d6793f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:21:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "95c7da6a-c9a5-4441-9819-1219f7d6793f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:21:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "95c7da6a-c9a5-4441-9819-1219f7d6793f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:21:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "95c7da6a-c9a5-4441-9819-1219f7d6793f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:21:44 user nova-compute[72504]: INFO nova.compute.manager [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Terminating instance
Aug 01 20:21:44 user nova-compute[72504]: DEBUG nova.compute.manager [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG nova.network.neutron [req-83861038-f261-4e7c-baea-ef7237e26863 req-47093171-edb8-41b3-8735-cd3741f6d37a service nova] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Updated VIF entry in instance network info cache for port e6acb053-8365-45b0-ac25-1f27f42162ff. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG nova.network.neutron [req-83861038-f261-4e7c-baea-ef7237e26863 req-47093171-edb8-41b3-8735-cd3741f6d37a service nova] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Updating instance_info_cache with network_info: [{"id": "e6acb053-8365-45b0-ac25-1f27f42162ff", "address": "fa:16:3e:01:7a:65", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acb053-83", "ovs_interfaceid": "e6acb053-8365-45b0-ac25-1f27f42162ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-83861038-f261-4e7c-baea-ef7237e26863 req-47093171-edb8-41b3-8735-cd3741f6d37a service nova] Releasing lock "refresh_cache-95c7da6a-c9a5-4441-9819-1219f7d6793f" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:45 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Instance destroyed successfully.
Aug 01 20:21:45 user nova-compute[72504]: DEBUG nova.objects.instance [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lazy-loading 'resources' on Instance uuid 95c7da6a-c9a5-4441-9819-1219f7d6793f {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:16:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1857669648',display_name='tempest-TestVolumeBootPattern-server-1857669648',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1857669648',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrKan85Goqo8Jv0VkDYyshQTMQ59f3rUyYronrtEBxVKZjCUMR9BmiZNw9TY8Sa/UvzfiwIaZSAr04+rYB06rxcAkBTQWOBWsdwofE2ksnZ+I8hLlgBMpWvgtrRSAHuwA==',key_name='tempest-TestVolumeBootPattern-1138255315',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:17:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb59fbc2bf9749f3af7d56435cb37066',ramdisk_id='',reservation_id='r-0nrv4j37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-685885098',owner_user_name='tempest-TestVolumeBootPattern-685885098-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:17:03Z,user_data=None,user_id='f06381c8a6214ddea7f1b36b623ed4d5',uuid=95c7da6a-c9a5-4441-9819-1219f7d6793f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6acb053-8365-45b0-ac25-1f27f42162ff", "address": "fa:16:3e:01:7a:65", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acb053-83", "ovs_interfaceid": "e6acb053-8365-45b0-ac25-1f27f42162ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converting VIF {"id": "e6acb053-8365-45b0-ac25-1f27f42162ff", "address": "fa:16:3e:01:7a:65", "network": {"id": "41810e08-2788-49d0-8991-12988428cebc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-647262255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb59fbc2bf9749f3af7d56435cb37066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acb053-83", "ovs_interfaceid": "e6acb053-8365-45b0-ac25-1f27f42162ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:7a:65,bridge_name='br-int',has_traffic_filtering=True,id=e6acb053-8365-45b0-ac25-1f27f42162ff,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6acb053-83') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG os_vif [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:7a:65,bridge_name='br-int',has_traffic_filtering=True,id=e6acb053-8365-45b0-ac25-1f27f42162ff,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6acb053-83') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6acb053-83, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:21:45 user nova-compute[72504]: INFO os_vif [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:7a:65,bridge_name='br-int',has_traffic_filtering=True,id=e6acb053-8365-45b0-ac25-1f27f42162ff,network=Network(41810e08-2788-49d0-8991-12988428cebc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6acb053-83')
Aug 01 20:21:45 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkHGEOcj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:21:45 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:21:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[be84fe72-9a23-4ef5-85c6-dbec502865a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d31af8-845a-45dd-9972-c808fd4e4d0b]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:21:45 user nova-compute[72504]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 (non-flash)
Aug 01 20:21:45 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 (non-flash)
Aug 01 20:21:45 user nova-compute[72504]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 (non-flash)
Aug 01 20:21:45 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3f45c1bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828'): ({'sdc'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Removing single pathed devices sdc {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4090208a-77a5-469b-958b-ce8ddc9156be]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9826b65b-7635-48ed-a541-3d96d90ce73d]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Flushing IO for device /dev/sdc {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f146647-5bb0-44a9-aeb5-320a44eeca8f]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cf533d-6d9d-44b2-9765-b93f3af5dc30]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_d33a9d7', '/dev/disk/by-id/scsi-1SCST_BIOd33a9d7-6222f901d039d919', '/dev/disk/by-id/scsi-23632323266393031') {{(pid=83379) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dd41e1-d697-489c-9cd6-ab99e6cfbec4]: (4, None) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0a54b9-ddaa-4549-b889-3cb9fa0b55ab]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:21:45 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:46 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ee8682-2647-4db9-8902-d33e9d35865a]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:46 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828, portal: 172.16.0.220,3260]
Aug 01 20:21:46 user nova-compute[72504]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828, portal: 172.16.0.220,3260] successful.
Aug 01 20:21:46 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:21:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:500a89fd-74ba-4703-83b0-986e7cb06828 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:46 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea297867-a364-42cf-9fc1-4b69e1e6bb8c]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:21:46 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:21:46 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:21:46 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] <== disconnect_volume: return (302ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:21:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:21:46 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Deleting instance files /opt/stack/data/nova/instances/95c7da6a-c9a5-4441-9819-1219f7d6793f_del
Aug 01 20:21:46 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Deletion of /opt/stack/data/nova/instances/95c7da6a-c9a5-4441-9819-1219f7d6793f_del complete
Aug 01 20:21:46 user nova-compute[72504]: INFO nova.compute.manager [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 01 20:21:46 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:21:46 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:21:46 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:21:46 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:21:46 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:21:46 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Took 0.58 seconds to deallocate network for instance.
Aug 01 20:21:46 user nova-compute[72504]: DEBUG nova.compute.manager [req-0aa7145f-b33a-40e7-a73f-3be7a1f5ad0c req-d3bc6cab-a7c8-4a56-a330-f0c509f69b88 service nova] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Received event network-vif-deleted-e6acb053-8365-45b0-ac25-1f27f42162ff {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:21:46 user nova-compute[72504]: DEBUG nova.compute.manager [req-c6daba60-9f5d-4014-b90a-9ce06ae2989b req-8bde40b0-7877-4df9-81e6-0e984ca26f10 service nova] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Received event network-vif-unplugged-e6acb053-8365-45b0-ac25-1f27f42162ff {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:21:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c6daba60-9f5d-4014-b90a-9ce06ae2989b req-8bde40b0-7877-4df9-81e6-0e984ca26f10 service nova] Acquiring lock "95c7da6a-c9a5-4441-9819-1219f7d6793f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:21:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c6daba60-9f5d-4014-b90a-9ce06ae2989b req-8bde40b0-7877-4df9-81e6-0e984ca26f10 service nova] Lock "95c7da6a-c9a5-4441-9819-1219f7d6793f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:21:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c6daba60-9f5d-4014-b90a-9ce06ae2989b req-8bde40b0-7877-4df9-81e6-0e984ca26f10 service nova] Lock "95c7da6a-c9a5-4441-9819-1219f7d6793f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:21:46 user nova-compute[72504]: DEBUG nova.compute.manager [req-c6daba60-9f5d-4014-b90a-9ce06ae2989b req-8bde40b0-7877-4df9-81e6-0e984ca26f10 service nova] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] No waiting events found dispatching network-vif-unplugged-e6acb053-8365-45b0-ac25-1f27f42162ff {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:21:46 user nova-compute[72504]: DEBUG nova.compute.manager [req-c6daba60-9f5d-4014-b90a-9ce06ae2989b req-8bde40b0-7877-4df9-81e6-0e984ca26f10 service nova] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Received event network-vif-unplugged-e6acb053-8365-45b0-ac25-1f27f42162ff for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:21:46 user nova-compute[72504]: DEBUG nova.compute.manager [req-c6daba60-9f5d-4014-b90a-9ce06ae2989b req-8bde40b0-7877-4df9-81e6-0e984ca26f10 service nova] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Received event network-vif-plugged-e6acb053-8365-45b0-ac25-1f27f42162ff {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:21:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c6daba60-9f5d-4014-b90a-9ce06ae2989b req-8bde40b0-7877-4df9-81e6-0e984ca26f10 service nova] Acquiring lock "95c7da6a-c9a5-4441-9819-1219f7d6793f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:21:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c6daba60-9f5d-4014-b90a-9ce06ae2989b req-8bde40b0-7877-4df9-81e6-0e984ca26f10 service nova] Lock "95c7da6a-c9a5-4441-9819-1219f7d6793f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:21:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c6daba60-9f5d-4014-b90a-9ce06ae2989b req-8bde40b0-7877-4df9-81e6-0e984ca26f10 service nova] Lock "95c7da6a-c9a5-4441-9819-1219f7d6793f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:21:46 user nova-compute[72504]: DEBUG nova.compute.manager [req-c6daba60-9f5d-4014-b90a-9ce06ae2989b req-8bde40b0-7877-4df9-81e6-0e984ca26f10 service nova] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] No waiting events found dispatching network-vif-plugged-e6acb053-8365-45b0-ac25-1f27f42162ff {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:21:46 user nova-compute[72504]: WARNING nova.compute.manager [req-c6daba60-9f5d-4014-b90a-9ce06ae2989b req-8bde40b0-7877-4df9-81e6-0e984ca26f10 service nova] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Received unexpected event network-vif-plugged-e6acb053-8365-45b0-ac25-1f27f42162ff for instance with vm_state active and task_state deleting.
Aug 01 20:21:47 user nova-compute[72504]: INFO nova.compute.manager [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Took 0.79 seconds to detach 1 volumes for instance.
Aug 01 20:21:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:21:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:21:47 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Refreshing inventories for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 20:21:47 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Updating ProviderTree inventory for provider b951a798-e88c-472c-8347-2c5f6a05d47c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 20:21:47 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Updating inventory in ProviderTree for provider b951a798-e88c-472c-8347-2c5f6a05d47c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 20:21:47 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Refreshing aggregate associations for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c, aggregates: None {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 20:21:47 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Refreshing trait associations for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c, traits: HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 20:21:47 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:21:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:21:47 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:21:47 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:21:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:21:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.140s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:21:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:21:47 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:21:48 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Deleted allocations for instance 95c7da6a-c9a5-4441-9819-1219f7d6793f
Aug 01 20:21:48 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ffc053-4a57-486c-bc52-924e882dac0e/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2792498c-d1a2-4182-9c02-1a740fba26de tempest-TestVolumeBootPattern-685885098 tempest-TestVolumeBootPattern-685885098-project-member] Lock "95c7da6a-c9a5-4441-9819-1219f7d6793f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.155s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:21:48 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ffc053-4a57-486c-bc52-924e882dac0e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:48 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ffc053-4a57-486c-bc52-924e882dac0e/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:48 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ffc053-4a57-486c-bc52-924e882dac0e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:48 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:48 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:48 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:21:48 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:21:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:21:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:49 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:21:49 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:21:49 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8442MB free_disk=25.134010314941406GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:21:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:21:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:21:49 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 2caaa9dd-e1fd-465b-95a0-78fa51c96c15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:21:49 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance f0ffc053-4a57-486c-bc52-924e882dac0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:21:49 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:21:49 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:21:49 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:21:49 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:21:49 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:21:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:21:50 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:21:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:52 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:21:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:21:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:00 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690921305.741787, 95c7da6a-c9a5-4441-9819-1219f7d6793f => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:22:00 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] VM Stopped (Lifecycle Event)
Aug 01 20:22:00 user nova-compute[72504]: DEBUG nova.compute.manager [None req-158b63eb-6797-4a60-b978-9ee9bd6e18c9 None None] [instance: 95c7da6a-c9a5-4441-9819-1219f7d6793f] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:22:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "257710b5-4f19-45e7-8e38-9c37277ae091" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:22:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "257710b5-4f19-45e7-8e38-9c37277ae091" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:22:01 user nova-compute[72504]: DEBUG nova.compute.manager [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 20:22:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:22:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:22:01 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:22:01 user nova-compute[72504]: INFO nova.compute.claims [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Claim successful on node user
Aug 01 20:22:01 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:22:01 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:22:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.292s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:22:01 user nova-compute[72504]: DEBUG nova.compute.manager [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 20:22:02 user nova-compute[72504]: DEBUG nova.compute.manager [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 20:22:02 user nova-compute[72504]: DEBUG nova.network.neutron [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 20:22:02 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 20:22:02 user nova-compute[72504]: DEBUG nova.compute.manager [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 20:22:02 user nova-compute[72504]: DEBUG nova.policy [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90bea00e45b541baa6f98812cce770f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef67b412883421f949be025bdc1cf38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 20:22:02 user nova-compute[72504]: DEBUG nova.compute.manager [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 20:22:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:22:02 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Creating image(s)
Aug 01 20:22:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "/opt/stack/data/nova/instances/257710b5-4f19-45e7-8e38-9c37277ae091/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:22:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "/opt/stack/data/nova/instances/257710b5-4f19-45e7-8e38-9c37277ae091/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:22:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "/opt/stack/data/nova/instances/257710b5-4f19-45e7-8e38-9c37277ae091/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:22:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:22:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:22:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:22:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:22:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:22:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.146s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:22:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/257710b5-4f19-45e7-8e38-9c37277ae091/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:22:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/257710b5-4f19-45e7-8e38-9c37277ae091/disk 1073741824" returned: 0 in 0.060s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:22:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:22:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:22:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.154s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:22:02 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Checking if we can resize image /opt/stack/data/nova/instances/257710b5-4f19-45e7-8e38-9c37277ae091/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 20:22:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257710b5-4f19-45e7-8e38-9c37277ae091/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:22:02 user nova-compute[72504]: DEBUG nova.network.neutron [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Successfully created port: 0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 20:22:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257710b5-4f19-45e7-8e38-9c37277ae091/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:22:02 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Cannot resize image /opt/stack/data/nova/instances/257710b5-4f19-45e7-8e38-9c37277ae091/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 20:22:02 user nova-compute[72504]: DEBUG nova.objects.instance [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'migration_context' on Instance uuid 257710b5-4f19-45e7-8e38-9c37277ae091 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:22:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 20:22:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Ensure instance console log exists: /opt/stack/data/nova/instances/257710b5-4f19-45e7-8e38-9c37277ae091/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:22:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:22:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:22:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:22:03 user nova-compute[72504]: DEBUG nova.network.neutron [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Successfully updated port: 0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 20:22:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "refresh_cache-257710b5-4f19-45e7-8e38-9c37277ae091" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:22:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquired lock "refresh_cache-257710b5-4f19-45e7-8e38-9c37277ae091" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:22:03 user nova-compute[72504]: DEBUG nova.network.neutron [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:22:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-18f15c39-690d-440f-8385-5fb90d2e1b73 req-bb33c879-f6ba-4647-aeb1-61d6100f33ed service nova] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Received event network-changed-0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:22:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-18f15c39-690d-440f-8385-5fb90d2e1b73 req-bb33c879-f6ba-4647-aeb1-61d6100f33ed service nova] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Refreshing instance network info cache due to event network-changed-0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:22:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-18f15c39-690d-440f-8385-5fb90d2e1b73 req-bb33c879-f6ba-4647-aeb1-61d6100f33ed service nova] Acquiring lock "refresh_cache-257710b5-4f19-45e7-8e38-9c37277ae091" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:22:03 user nova-compute[72504]: DEBUG nova.network.neutron [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:22:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.network.neutron [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Updating instance_info_cache with network_info: [{"id": "0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc", "address": "fa:16:3e:98:a3:43", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e947bdc-99", "ovs_interfaceid": "0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Releasing lock "refresh_cache-257710b5-4f19-45e7-8e38-9c37277ae091" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.compute.manager [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Instance network_info: |[{"id": "0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc", "address": "fa:16:3e:98:a3:43", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e947bdc-99", "ovs_interfaceid": "0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-18f15c39-690d-440f-8385-5fb90d2e1b73 req-bb33c879-f6ba-4647-aeb1-61d6100f33ed service nova] Acquired lock "refresh_cache-257710b5-4f19-45e7-8e38-9c37277ae091" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.network.neutron [req-18f15c39-690d-440f-8385-5fb90d2e1b73 req-bb33c879-f6ba-4647-aeb1-61d6100f33ed service nova] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Refreshing network info cache for port 0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Start _get_guest_xml network_info=[{"id": "0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc", "address": "fa:16:3e:98:a3:43", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e947bdc-99", "ovs_interfaceid": "0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:22:04 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:22:04 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:22:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1207610117',display_name='tempest-AttachVolumeTestJSON-server-1207610117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1207610117',id=47,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQb2X1+91DXQEgn8TuRg98VMxM4N5bj8MSW+/S9TDSy9gY4f+b6CvUkj2OZ+DT63WmHj6O46fX7sUWFlyOFIG91l7ObR9Ai9Q6uC8Uy2djcJZgKCF6F1+RIcQn9hXCbCQ==',key_name='tempest-keypair-95852369',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ef67b412883421f949be025bdc1cf38',ramdisk_id='',reservation_id='r-f848rwdk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1031917511',owner_user_name='tempest-AttachVolumeTestJSON-1031917511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:22:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90bea00e45b541baa6f98812cce770f8',uuid=257710b5-4f19-45e7-8e38-9c37277ae091,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc", "address": "fa:16:3e:98:a3:43", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e947bdc-99", "ovs_interfaceid": "0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Converting VIF {"id": "0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc", "address": "fa:16:3e:98:a3:43", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e947bdc-99", "ovs_interfaceid": "0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:a3:43,bridge_name='br-int',has_traffic_filtering=True,id=0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc,network=Network(253a3888-9ae8-47b5-8875-9e4b823ac978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e947bdc-99') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.objects.instance [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'pci_devices' on Instance uuid 257710b5-4f19-45e7-8e38-9c37277ae091 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:22:04 user nova-compute[72504]:   <uuid>257710b5-4f19-45e7-8e38-9c37277ae091</uuid>
Aug 01 20:22:04 user nova-compute[72504]:   <name>instance-0000002f</name>
Aug 01 20:22:04 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:22:04 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:22:04 user nova-compute[72504]:   <metadata>
Aug 01 20:22:04 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:22:04 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:22:04 user nova-compute[72504]:       <nova:name>tempest-AttachVolumeTestJSON-server-1207610117</nova:name>
Aug 01 20:22:04 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:22:04</nova:creationTime>
Aug 01 20:22:04 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:22:04 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:22:04 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:22:04 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:22:04 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:22:04 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:22:04 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:22:04 user nova-compute[72504]:       <nova:owner>
Aug 01 20:22:04 user nova-compute[72504]:         <nova:user uuid="90bea00e45b541baa6f98812cce770f8">tempest-AttachVolumeTestJSON-1031917511-project-member</nova:user>
Aug 01 20:22:04 user nova-compute[72504]:         <nova:project uuid="8ef67b412883421f949be025bdc1cf38">tempest-AttachVolumeTestJSON-1031917511</nova:project>
Aug 01 20:22:04 user nova-compute[72504]:       </nova:owner>
Aug 01 20:22:04 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 20:22:04 user nova-compute[72504]:       <nova:ports>
Aug 01 20:22:04 user nova-compute[72504]:         <nova:port uuid="0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc">
Aug 01 20:22:04 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 20:22:04 user nova-compute[72504]:         </nova:port>
Aug 01 20:22:04 user nova-compute[72504]:       </nova:ports>
Aug 01 20:22:04 user nova-compute[72504]:     </nova:instance>
Aug 01 20:22:04 user nova-compute[72504]:   </metadata>
Aug 01 20:22:04 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:22:04 user nova-compute[72504]:     <system>
Aug 01 20:22:04 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:22:04 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:22:04 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:22:04 user nova-compute[72504]:       <entry name="serial">257710b5-4f19-45e7-8e38-9c37277ae091</entry>
Aug 01 20:22:04 user nova-compute[72504]:       <entry name="uuid">257710b5-4f19-45e7-8e38-9c37277ae091</entry>
Aug 01 20:22:04 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:22:04 user nova-compute[72504]:     </system>
Aug 01 20:22:04 user nova-compute[72504]:   </sysinfo>
Aug 01 20:22:04 user nova-compute[72504]:   <os>
Aug 01 20:22:04 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:22:04 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:22:04 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:22:04 user nova-compute[72504]:   </os>
Aug 01 20:22:04 user nova-compute[72504]:   <features>
Aug 01 20:22:04 user nova-compute[72504]:     <acpi/>
Aug 01 20:22:04 user nova-compute[72504]:     <apic/>
Aug 01 20:22:04 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:22:04 user nova-compute[72504]:   </features>
Aug 01 20:22:04 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:22:04 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:22:04 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:22:04 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:22:04 user nova-compute[72504]:   </clock>
Aug 01 20:22:04 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:22:04 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:22:04 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:22:04 user nova-compute[72504]:   </cpu>
Aug 01 20:22:04 user nova-compute[72504]:   <devices>
Aug 01 20:22:04 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 20:22:04 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 20:22:04 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/257710b5-4f19-45e7-8e38-9c37277ae091/disk"/>
Aug 01 20:22:04 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:22:04 user nova-compute[72504]:     </disk>
Aug 01 20:22:04 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:22:04 user nova-compute[72504]:       <mac address="fa:16:3e:98:a3:43"/>
Aug 01 20:22:04 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:22:04 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:22:04 user nova-compute[72504]:       <target dev="tap0e947bdc-99"/>
Aug 01 20:22:04 user nova-compute[72504]:     </interface>
Aug 01 20:22:04 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:22:04 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/257710b5-4f19-45e7-8e38-9c37277ae091/console.log" append="off"/>
Aug 01 20:22:04 user nova-compute[72504]:     </serial>
Aug 01 20:22:04 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:22:04 user nova-compute[72504]:     <video>
Aug 01 20:22:04 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:22:04 user nova-compute[72504]:     </video>
Aug 01 20:22:04 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:22:04 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:22:04 user nova-compute[72504]:     </rng>
Aug 01 20:22:04 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:22:04 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:22:04 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:22:04 user nova-compute[72504]:     </memballoon>
Aug 01 20:22:04 user nova-compute[72504]:   </devices>
Aug 01 20:22:04 user nova-compute[72504]: </domain>
Aug 01 20:22:04 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:22:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1207610117',display_name='tempest-AttachVolumeTestJSON-server-1207610117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1207610117',id=47,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQb2X1+91DXQEgn8TuRg98VMxM4N5bj8MSW+/S9TDSy9gY4f+b6CvUkj2OZ+DT63WmHj6O46fX7sUWFlyOFIG91l7ObR9Ai9Q6uC8Uy2djcJZgKCF6F1+RIcQn9hXCbCQ==',key_name='tempest-keypair-95852369',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ef67b412883421f949be025bdc1cf38',ramdisk_id='',reservation_id='r-f848rwdk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1031917511',owner_user_name='tempest-AttachVolumeTestJSON-1031917511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:22:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90bea00e45b541baa6f98812cce770f8',uuid=257710b5-4f19-45e7-8e38-9c37277ae091,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc", "address": "fa:16:3e:98:a3:43", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e947bdc-99", "ovs_interfaceid": "0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Converting VIF {"id": "0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc", "address": "fa:16:3e:98:a3:43", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e947bdc-99", "ovs_interfaceid": "0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:a3:43,bridge_name='br-int',has_traffic_filtering=True,id=0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc,network=Network(253a3888-9ae8-47b5-8875-9e4b823ac978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e947bdc-99') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG os_vif [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:a3:43,bridge_name='br-int',has_traffic_filtering=True,id=0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc,network=Network(253a3888-9ae8-47b5-8875-9e4b823ac978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e947bdc-99') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e947bdc-99, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0e947bdc-99, col_values=(('external_ids', {'iface-id': '0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:a3:43', 'vm-uuid': '257710b5-4f19-45e7-8e38-9c37277ae091'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:04 user nova-compute[72504]: INFO os_vif [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:a3:43,bridge_name='br-int',has_traffic_filtering=True,id=0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc,network=Network(253a3888-9ae8-47b5-8875-9e4b823ac978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e947bdc-99')
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] No VIF found with MAC fa:16:3e:98:a3:43, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.network.neutron [req-18f15c39-690d-440f-8385-5fb90d2e1b73 req-bb33c879-f6ba-4647-aeb1-61d6100f33ed service nova] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Updated VIF entry in instance network info cache for port 0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG nova.network.neutron [req-18f15c39-690d-440f-8385-5fb90d2e1b73 req-bb33c879-f6ba-4647-aeb1-61d6100f33ed service nova] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Updating instance_info_cache with network_info: [{"id": "0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc", "address": "fa:16:3e:98:a3:43", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e947bdc-99", "ovs_interfaceid": "0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:22:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-18f15c39-690d-440f-8385-5fb90d2e1b73 req-bb33c879-f6ba-4647-aeb1-61d6100f33ed service nova] Releasing lock "refresh_cache-257710b5-4f19-45e7-8e38-9c37277ae091" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:22:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:05 user nova-compute[72504]: DEBUG nova.compute.manager [req-b3c09f5c-5e5b-460e-9e78-db40537b330b req-0908d8b0-6732-4943-bd76-c1375f47e540 service nova] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Received event network-vif-plugged-0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:22:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b3c09f5c-5e5b-460e-9e78-db40537b330b req-0908d8b0-6732-4943-bd76-c1375f47e540 service nova] Acquiring lock "257710b5-4f19-45e7-8e38-9c37277ae091-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:22:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b3c09f5c-5e5b-460e-9e78-db40537b330b req-0908d8b0-6732-4943-bd76-c1375f47e540 service nova] Lock "257710b5-4f19-45e7-8e38-9c37277ae091-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:22:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b3c09f5c-5e5b-460e-9e78-db40537b330b req-0908d8b0-6732-4943-bd76-c1375f47e540 service nova] Lock "257710b5-4f19-45e7-8e38-9c37277ae091-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:22:05 user nova-compute[72504]: DEBUG nova.compute.manager [req-b3c09f5c-5e5b-460e-9e78-db40537b330b req-0908d8b0-6732-4943-bd76-c1375f47e540 service nova] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] No waiting events found dispatching network-vif-plugged-0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:22:05 user nova-compute[72504]: WARNING nova.compute.manager [req-b3c09f5c-5e5b-460e-9e78-db40537b330b req-0908d8b0-6732-4943-bd76-c1375f47e540 service nova] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Received unexpected event network-vif-plugged-0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc for instance with vm_state building and task_state spawning.
Aug 01 20:22:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:07 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690921327.7396562, 257710b5-4f19-45e7-8e38-9c37277ae091 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:22:07 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] VM Resumed (Lifecycle Event)
Aug 01 20:22:07 user nova-compute[72504]: DEBUG nova.compute.manager [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:22:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:22:07 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Instance spawned successfully.
Aug 01 20:22:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 20:22:07 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:22:07 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:22:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:22:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:22:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:22:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:22:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:22:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:22:07 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:22:07 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690921327.7419417, 257710b5-4f19-45e7-8e38-9c37277ae091 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:22:07 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] VM Started (Lifecycle Event)
Aug 01 20:22:07 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:22:07 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:22:07 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:22:07 user nova-compute[72504]: DEBUG nova.compute.manager [req-56a30cb9-7d50-4100-b622-c911be7c83b0 req-512d9d5e-75d2-46ef-9bc7-51e08d94c60c service nova] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Received event network-vif-plugged-0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:22:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-56a30cb9-7d50-4100-b622-c911be7c83b0 req-512d9d5e-75d2-46ef-9bc7-51e08d94c60c service nova] Acquiring lock "257710b5-4f19-45e7-8e38-9c37277ae091-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:22:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-56a30cb9-7d50-4100-b622-c911be7c83b0 req-512d9d5e-75d2-46ef-9bc7-51e08d94c60c service nova] Lock "257710b5-4f19-45e7-8e38-9c37277ae091-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:22:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-56a30cb9-7d50-4100-b622-c911be7c83b0 req-512d9d5e-75d2-46ef-9bc7-51e08d94c60c service nova] Lock "257710b5-4f19-45e7-8e38-9c37277ae091-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:22:07 user nova-compute[72504]: DEBUG nova.compute.manager [req-56a30cb9-7d50-4100-b622-c911be7c83b0 req-512d9d5e-75d2-46ef-9bc7-51e08d94c60c service nova] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] No waiting events found dispatching network-vif-plugged-0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:22:07 user nova-compute[72504]: WARNING nova.compute.manager [req-56a30cb9-7d50-4100-b622-c911be7c83b0 req-512d9d5e-75d2-46ef-9bc7-51e08d94c60c service nova] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Received unexpected event network-vif-plugged-0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc for instance with vm_state building and task_state spawning.
Aug 01 20:22:07 user nova-compute[72504]: INFO nova.compute.manager [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Took 5.54 seconds to spawn the instance on the hypervisor.
Aug 01 20:22:07 user nova-compute[72504]: DEBUG nova.compute.manager [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:22:07 user nova-compute[72504]: INFO nova.compute.manager [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Took 6.25 seconds to build instance.
Aug 01 20:22:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-aa16e89d-3665-402e-acc4-e16087877946 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "257710b5-4f19-45e7-8e38-9c37277ae091" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.365s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:22:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:30 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:22:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:35 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:22:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:39 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:22:39 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:22:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:45 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:22:45 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:22:45 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:22:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-2caaa9dd-e1fd-465b-95a0-78fa51c96c15" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:22:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-2caaa9dd-e1fd-465b-95a0-78fa51c96c15" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:22:45 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:22:46 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Updating instance_info_cache with network_info: [{"id": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "address": "fa:16:3e:4e:0e:3d", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6cbd7a-88", "ovs_interfaceid": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:22:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-2caaa9dd-e1fd-465b-95a0-78fa51c96c15" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:22:46 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:22:46 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:22:46 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:22:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG nova.compute.manager [req-50ec3559-d346-43e6-95b3-ac08c190bfe6 req-a86d8362-1a89-4553-af2a-3a7ddcb3bfbf service nova] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Received event network-changed-deaaf42d-889f-4b49-abb5-3a3d4684ea5f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG nova.compute.manager [req-50ec3559-d346-43e6-95b3-ac08c190bfe6 req-a86d8362-1a89-4553-af2a-3a7ddcb3bfbf service nova] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Refreshing instance network info cache due to event network-changed-deaaf42d-889f-4b49-abb5-3a3d4684ea5f. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-50ec3559-d346-43e6-95b3-ac08c190bfe6 req-a86d8362-1a89-4553-af2a-3a7ddcb3bfbf service nova] Acquiring lock "refresh_cache-f0ffc053-4a57-486c-bc52-924e882dac0e" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-50ec3559-d346-43e6-95b3-ac08c190bfe6 req-a86d8362-1a89-4553-af2a-3a7ddcb3bfbf service nova] Acquired lock "refresh_cache-f0ffc053-4a57-486c-bc52-924e882dac0e" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG nova.network.neutron [req-50ec3559-d346-43e6-95b3-ac08c190bfe6 req-a86d8362-1a89-4553-af2a-3a7ddcb3bfbf service nova] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Refreshing network info cache for port deaaf42d-889f-4b49-abb5-3a3d4684ea5f {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "f0ffc053-4a57-486c-bc52-924e882dac0e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "f0ffc053-4a57-486c-bc52-924e882dac0e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG nova.objects.instance [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lazy-loading 'flavor' on Instance uuid f0ffc053-4a57-486c-bc52-924e882dac0e {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:22:48 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Ignoring supplied device name: /dev/vdb
Aug 01 20:22:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "f0ffc053-4a57-486c-bc52-924e882dac0e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "f0ffc053-4a57-486c-bc52-924e882dac0e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "f0ffc053-4a57-486c-bc52-924e882dac0e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:22:48 user nova-compute[72504]: INFO nova.compute.manager [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Attaching volume 13ceb393-e547-4f9b-8933-9bce419d6f07 to /dev/vdb
Aug 01 20:22:48 user nova-compute[72504]: DEBUG nova.network.neutron [req-50ec3559-d346-43e6-95b3-ac08c190bfe6 req-a86d8362-1a89-4553-af2a-3a7ddcb3bfbf service nova] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Updated VIF entry in instance network info cache for port deaaf42d-889f-4b49-abb5-3a3d4684ea5f. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG nova.network.neutron [req-50ec3559-d346-43e6-95b3-ac08c190bfe6 req-a86d8362-1a89-4553-af2a-3a7ddcb3bfbf service nova] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Updating instance_info_cache with network_info: [{"id": "deaaf42d-889f-4b49-abb5-3a3d4684ea5f", "address": "fa:16:3e:c7:14:6b", "network": {"id": "ec191814-d9f8-4a40-a775-07b50423cec5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1317992461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf6047793ecc44519667cf55e090296e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeaaf42d-88", "ovs_interfaceid": "deaaf42d-889f-4b49-abb5-3a3d4684ea5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-50ec3559-d346-43e6-95b3-ac08c190bfe6 req-a86d8362-1a89-4553-af2a-3a7ddcb3bfbf service nova] Releasing lock "refresh_cache-f0ffc053-4a57-486c-bc52-924e882dac0e" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG os_brick.utils [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da57f56-5bb8-49a0-b381-207d21b103c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7e4fb2-4b9c-4aa9-b73a-4dd82f54a771]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cf1cae-4600-4885-adb3-3c99008e6771]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa9a467-0b55-4d5a-97c8-341c640eb8bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:22:48 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:22:48 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd46c1b-0c3f-4ebf-bcdd-a4e92f7616d8]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG os_brick.utils [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Updating existing volume attachment record: fdafaaac-fb38-4522-98ad-d62132ed35e0 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:22:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:49 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:22:49 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:22:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:22:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:22:49 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:22:49 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:22:49 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257710b5-4f19-45e7-8e38-9c37277ae091/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:22:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257710b5-4f19-45e7-8e38-9c37277ae091/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:22:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257710b5-4f19-45e7-8e38-9c37277ae091/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:22:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257710b5-4f19-45e7-8e38-9c37277ae091/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:22:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ffc053-4a57-486c-bc52-924e882dac0e/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:22:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ffc053-4a57-486c-bc52-924e882dac0e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:22:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ffc053-4a57-486c-bc52-924e882dac0e/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:22:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ffc053-4a57-486c-bc52-924e882dac0e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:22:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:22:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:22:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:22:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:22:50 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:22:51 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:22:51 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:22:51 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8518MB free_disk=25.103282928466797GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:22:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:22:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:22:51 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 2caaa9dd-e1fd-465b-95a0-78fa51c96c15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:22:51 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance f0ffc053-4a57-486c-bc52-924e882dac0e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:22:51 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 257710b5-4f19-45e7-8e38-9c37277ae091 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:22:51 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:22:51 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:22:51 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:22:51 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:22:51 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:22:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.283s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:22:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:22:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'banrjFMz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:22:55 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:22:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:22:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:22:55 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:22:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:22:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:22:55 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:22:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:22:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:22:55 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6743af05-190f-4a88-bf75-11a020b9a8e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:22:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:22:55 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:22:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:22:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:22:55 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[67433dec-a374-4865-8126-eede86841f38]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:22:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07] added
Aug 01 20:22:55 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:22:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:22:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:22:55 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fd14d2-a4e1-414f-9869-0158408a4b83]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:22:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:22:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:22:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:22:55 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[59607625-8204-4bf4-8102-eb4409d7badc]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:22:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:22:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v banrjFMz {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:22:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v banrjFMz" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:22:55 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be35338-21be-4bea-85d5-af27e2c42a10]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:22:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'banrjFMz'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:22:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:22:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:22:55 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e175c7d0-a92e-4474-a99f-35e20deb21b8]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:22:55 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:22:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:22:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:22:56 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9282e0ce-abac-4e7f-9a11-05a00d7efa83]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:22:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 (non-flash)
Aug 01 20:22:56 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:22:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 (non-flash)
Aug 01 20:22:56 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:22:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:22:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:22:56 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05c7933-523b-4fb3-90ae-d6ac57ec056a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:22:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07, portal: 172.16.0.220,3260]
Aug 01 20:22:56 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07, portal: 172.16.0.220,3260] successful.
Aug 01 20:22:56 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:22:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:22:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:22:56 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ab1a1c-ef05-4ff2-9008-4786c9f6e148]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:22:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:22:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:22:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:22:56 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cc44f3-bad5-4ba8-89f6-a2d2a3133849]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:22:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 (non-flash)
Aug 01 20:22:56 user nova-compute[72504]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07 (non-flash)
Aug 01 20:22:56 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:22:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 (non-flash)
Aug 01 20:22:56 user nova-compute[72504]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07 (non-flash)
Aug 01 20:22:56 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:22:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:22:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:22:56 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:22:56 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:22:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:22:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:22:56 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56e4d22-343d-4ff8-aa6d-03c9ecfefe4d]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:22:56 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:22:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'banrjFMz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:22:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:22:57 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23931356437643063', 'path': '/dev/sdc'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:22:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931356437643063', 'path': '/dev/sdc'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:22:57 user nova-compute[72504]: DEBUG nova.objects.instance [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lazy-loading 'flavor' on Instance uuid f0ffc053-4a57-486c-bc52-924e882dac0e {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:22:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 20:22:57 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:22:57 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 20:22:57 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:22:57 user nova-compute[72504]:   <serial>13ceb393-e547-4f9b-8933-9bce419d6f07</serial>
Aug 01 20:22:57 user nova-compute[72504]: </disk>
Aug 01 20:22:57 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 20:22:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:22:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:22:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] No VIF found with MAC fa:16:3e:c7:14:6b, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:22:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c7a8d97c-ce8b-4a2c-9257-48b87041be09 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "f0ffc053-4a57-486c-bc52-924e882dac0e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.128s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:22:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:22:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:23:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:23:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:23:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:23:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:23:18 user nova-compute[72504]: DEBUG nova.compute.manager [req-80c1c766-be7a-4090-8aff-99d3c85bd1ea req-1e935a2d-861f-494f-96bb-3f87b528a2f0 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Received event network-changed-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:23:18 user nova-compute[72504]: DEBUG nova.compute.manager [req-80c1c766-be7a-4090-8aff-99d3c85bd1ea req-1e935a2d-861f-494f-96bb-3f87b528a2f0 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Refreshing instance network info cache due to event network-changed-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:23:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-80c1c766-be7a-4090-8aff-99d3c85bd1ea req-1e935a2d-861f-494f-96bb-3f87b528a2f0 service nova] Acquiring lock "refresh_cache-2caaa9dd-e1fd-465b-95a0-78fa51c96c15" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:23:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-80c1c766-be7a-4090-8aff-99d3c85bd1ea req-1e935a2d-861f-494f-96bb-3f87b528a2f0 service nova] Acquired lock "refresh_cache-2caaa9dd-e1fd-465b-95a0-78fa51c96c15" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:23:18 user nova-compute[72504]: DEBUG nova.network.neutron [req-80c1c766-be7a-4090-8aff-99d3c85bd1ea req-1e935a2d-861f-494f-96bb-3f87b528a2f0 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Refreshing network info cache for port bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:23:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "f0ffc053-4a57-486c-bc52-924e882dac0e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:23:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "f0ffc053-4a57-486c-bc52-924e882dac0e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:23:18 user nova-compute[72504]: INFO nova.compute.manager [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Detaching volume 13ceb393-e547-4f9b-8933-9bce419d6f07
Aug 01 20:23:18 user nova-compute[72504]: INFO nova.virt.block_device [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Attempting to driver detach volume 13ceb393-e547-4f9b-8933-9bce419d6f07 from mountpoint /dev/vdb
Aug 01 20:23:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Attempting to detach device vdb from instance f0ffc053-4a57-486c-bc52-924e882dac0e from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 20:23:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:23:18 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:23:18 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 20:23:18 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:23:18 user nova-compute[72504]:   <serial>13ceb393-e547-4f9b-8933-9bce419d6f07</serial>
Aug 01 20:23:18 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:23:18 user nova-compute[72504]: </disk>
Aug 01 20:23:18 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:23:18 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Successfully detached device vdb from instance f0ffc053-4a57-486c-bc52-924e882dac0e from the persistent domain config.
Aug 01 20:23:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f0ffc053-4a57-486c-bc52-924e882dac0e from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 20:23:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:23:18 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:23:18 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 20:23:18 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:23:18 user nova-compute[72504]:   <serial>13ceb393-e547-4f9b-8933-9bce419d6f07</serial>
Aug 01 20:23:18 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:23:18 user nova-compute[72504]: </disk>
Aug 01 20:23:18 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:23:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "f0ffc053-4a57-486c-bc52-924e882dac0e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:23:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690921399.131524, f0ffc053-4a57-486c-bc52-924e882dac0e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f0ffc053-4a57-486c-bc52-924e882dac0e {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 20:23:19 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Successfully detached device vdb from instance f0ffc053-4a57-486c-bc52-924e882dac0e from the live domain config.
Aug 01 20:23:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'banrjFMz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:23:19 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:23:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4532f2-72fe-4f2f-aa55-18d6f207bae6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9914d68e-d9d5-492b-aa7d-9acb414bf6cd]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 (non-flash)
Aug 01 20:23:19 user nova-compute[72504]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07 (non-flash)
Aug 01 20:23:19 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 (non-flash)
Aug 01 20:23:19 user nova-compute[72504]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07 (non-flash)
Aug 01 20:23:19 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3f437d000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07'): ({'sdc'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Removing single pathed devices sdc {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdac984-4618-4e4f-9f73-8b50eab4d046]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b99e47d-3172-4a95-8240-9d3276dee82a]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Flushing IO for device /dev/sdc {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b637aec1-527f-4361-afaf-fd5bdb0788d9]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46a613c-2157-4bba-ac09-d17ce78dedde]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG nova.network.neutron [req-80c1c766-be7a-4090-8aff-99d3c85bd1ea req-1e935a2d-861f-494f-96bb-3f87b528a2f0 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Updated VIF entry in instance network info cache for port bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG nova.network.neutron [req-80c1c766-be7a-4090-8aff-99d3c85bd1ea req-1e935a2d-861f-494f-96bb-3f87b528a2f0 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Updating instance_info_cache with network_info: [{"id": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "address": "fa:16:3e:4e:0e:3d", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6cbd7a-88", "ovs_interfaceid": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-80c1c766-be7a-4090-8aff-99d3c85bd1ea req-1e935a2d-861f-494f-96bb-3f87b528a2f0 service nova] Releasing lock "refresh_cache-2caaa9dd-e1fd-465b-95a0-78fa51c96c15" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c41a381-aac9-4305-aac3-3e76d3c775f6]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5512861a-d067-42b4-b189-96926d1aa14a]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07, portal: 172.16.0.220,3260]
Aug 01 20:23:19 user nova-compute[72504]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07, portal: 172.16.0.220,3260] successful.
Aug 01 20:23:19 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4750deb3-fe36-4ff9-8b8e-833ed9081f4b]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] <== disconnect_volume: return (299ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG nova.compute.manager [req-ac8aa4d2-d008-4a86-a933-13e3ada35c47 req-819bc993-b1c7-41a5-a41a-342016683911 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Received event network-changed-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG nova.compute.manager [req-ac8aa4d2-d008-4a86-a933-13e3ada35c47 req-819bc993-b1c7-41a5-a41a-342016683911 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Refreshing instance network info cache due to event network-changed-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ac8aa4d2-d008-4a86-a933-13e3ada35c47 req-819bc993-b1c7-41a5-a41a-342016683911 service nova] Acquiring lock "refresh_cache-2caaa9dd-e1fd-465b-95a0-78fa51c96c15" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ac8aa4d2-d008-4a86-a933-13e3ada35c47 req-819bc993-b1c7-41a5-a41a-342016683911 service nova] Acquired lock "refresh_cache-2caaa9dd-e1fd-465b-95a0-78fa51c96c15" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG nova.network.neutron [req-ac8aa4d2-d008-4a86-a933-13e3ada35c47 req-819bc993-b1c7-41a5-a41a-342016683911 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Refreshing network info cache for port bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:23:19 user nova-compute[72504]: INFO nova.compute.manager [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Detaching volume 349f2538-4f19-4a2f-a260-a3317907dfd3
Aug 01 20:23:19 user nova-compute[72504]: INFO nova.virt.block_device [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Attempting to driver detach volume 349f2538-4f19-4a2f-a260-a3317907dfd3 from mountpoint /dev/vdb
Aug 01 20:23:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Attempting to detach device vdb from instance 2caaa9dd-e1fd-465b-95a0-78fa51c96c15 from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:23:19 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:23:19 user nova-compute[72504]:   <source dev="/dev/sdb"/>
Aug 01 20:23:19 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:23:19 user nova-compute[72504]:   <serial>349f2538-4f19-4a2f-a260-a3317907dfd3</serial>
Aug 01 20:23:19 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 20:23:19 user nova-compute[72504]: </disk>
Aug 01 20:23:19 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:23:19 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Successfully detached device vdb from instance 2caaa9dd-e1fd-465b-95a0-78fa51c96c15 from the persistent domain config.
Aug 01 20:23:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2caaa9dd-e1fd-465b-95a0-78fa51c96c15 from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 20:23:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:23:19 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:23:19 user nova-compute[72504]:   <source dev="/dev/sdb"/>
Aug 01 20:23:19 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:23:19 user nova-compute[72504]:   <serial>349f2538-4f19-4a2f-a260-a3317907dfd3</serial>
Aug 01 20:23:19 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 20:23:19 user nova-compute[72504]: </disk>
Aug 01 20:23:19 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG nova.network.neutron [req-ac8aa4d2-d008-4a86-a933-13e3ada35c47 req-819bc993-b1c7-41a5-a41a-342016683911 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Updated VIF entry in instance network info cache for port bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG nova.network.neutron [req-ac8aa4d2-d008-4a86-a933-13e3ada35c47 req-819bc993-b1c7-41a5-a41a-342016683911 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Updating instance_info_cache with network_info: [{"id": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "address": "fa:16:3e:4e:0e:3d", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6cbd7a-88", "ovs_interfaceid": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ac8aa4d2-d008-4a86-a933-13e3ada35c47 req-819bc993-b1c7-41a5-a41a-342016683911 service nova] Releasing lock "refresh_cache-2caaa9dd-e1fd-465b-95a0-78fa51c96c15" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG nova.objects.instance [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lazy-loading 'flavor' on Instance uuid f0ffc053-4a57-486c-bc52-924e882dac0e {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690921400.3443859, 2caaa9dd-e1fd-465b-95a0-78fa51c96c15 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2caaa9dd-e1fd-465b-95a0-78fa51c96c15 {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 20:23:20 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Successfully detached device vdb from instance 2caaa9dd-e1fd-465b-95a0-78fa51c96c15 from the live domain config.
Aug 01 20:23:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SkDRpVmP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:23:20 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:23:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b4547190-1805-400a-b5ec-d968664b7882 tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "f0ffc053-4a57-486c-bc52-924e882dac0e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.795s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "f0ffc053-4a57-486c-bc52-924e882dac0e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.578s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "f0ffc053-4a57-486c-bc52-924e882dac0e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "f0ffc053-4a57-486c-bc52-924e882dac0e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "f0ffc053-4a57-486c-bc52-924e882dac0e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:23:20 user nova-compute[72504]: INFO nova.compute.manager [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Terminating instance
Aug 01 20:23:20 user nova-compute[72504]: DEBUG nova.compute.manager [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b4b300-c32c-4ce9-8a1a-37214cccf9ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06d8b16-f0ef-4106-8972-4aae913f0763]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 (non-flash)
Aug 01 20:23:20 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 (non-flash)
Aug 01 20:23:20 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3f45c8dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3'): ({'sdb'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Removing single pathed devices sdb {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbea35c-1454-4b2f-be31-fc99be19cb50]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a062bbc-b6c2-4b3b-8e70-0e63bed3427e]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Flushing IO for device /dev/sdb {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ad34cc-305d-4bf8-9227-70f905196ffd]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abb03da-d475-408c-afd6-41f9191a0ad9]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c01eca-7855-45a8-b09c-c04a33023fdf]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[594e01a7-ad54-474a-9ed0-323ae3a38eea]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3, portal: 172.16.0.220,3260]
Aug 01 20:23:20 user nova-compute[72504]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3, portal: 172.16.0.220,3260] successful.
Aug 01 20:23:20 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG nova.compute.manager [req-dd406f1c-afe5-4c07-96db-66fda2acb507 req-c191c526-af81-4244-b7d2-c07027a8b8b7 service nova] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Received event network-vif-unplugged-deaaf42d-889f-4b49-abb5-3a3d4684ea5f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-dd406f1c-afe5-4c07-96db-66fda2acb507 req-c191c526-af81-4244-b7d2-c07027a8b8b7 service nova] Acquiring lock "f0ffc053-4a57-486c-bc52-924e882dac0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-dd406f1c-afe5-4c07-96db-66fda2acb507 req-c191c526-af81-4244-b7d2-c07027a8b8b7 service nova] Lock "f0ffc053-4a57-486c-bc52-924e882dac0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-dd406f1c-afe5-4c07-96db-66fda2acb507 req-c191c526-af81-4244-b7d2-c07027a8b8b7 service nova] Lock "f0ffc053-4a57-486c-bc52-924e882dac0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG nova.compute.manager [req-dd406f1c-afe5-4c07-96db-66fda2acb507 req-c191c526-af81-4244-b7d2-c07027a8b8b7 service nova] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] No waiting events found dispatching network-vif-unplugged-deaaf42d-889f-4b49-abb5-3a3d4684ea5f {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG nova.compute.manager [req-dd406f1c-afe5-4c07-96db-66fda2acb507 req-c191c526-af81-4244-b7d2-c07027a8b8b7 service nova] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Received event network-vif-unplugged-deaaf42d-889f-4b49-abb5-3a3d4684ea5f for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349f2538-4f19-4a2f-a260-a3317907dfd3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2361bf8c-2b66-4e8a-99bc-533c36ba0deb]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] <== disconnect_volume: return (302ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:23:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:23:21 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Instance destroyed successfully.
Aug 01 20:23:21 user nova-compute[72504]: DEBUG nova.objects.instance [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lazy-loading 'resources' on Instance uuid f0ffc053-4a57-486c-bc52-924e882dac0e {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:23:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:20:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1578310688',display_name='tempest-VolumesSnapshotTestJSON-instance-1578310688',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1578310688',id=46,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEO0EyIvhoozvK7S4AsEA4ujp/MZqIAgyKNhENDEkFVrVIjvZ4gvk6x1LKO1D62bVc8kR+gA1GlKHyJtnpUG25ld/iISKYuj3IOqnlmOlunMoS2HnW+4A+izMW1n/ryPw==',key_name='tempest-keypair-622673028',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:21:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf6047793ecc44519667cf55e090296e',ramdisk_id='',reservation_id='r-bnxbbdbx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2122802409',owner_user_name='tempest-VolumesSnapshotTestJSON-2122802409-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:21:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93aee9c4331d46aab83b73dfe0584fa0',uuid=f0ffc053-4a57-486c-bc52-924e882dac0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "deaaf42d-889f-4b49-abb5-3a3d4684ea5f", "address": "fa:16:3e:c7:14:6b", "network": {"id": "ec191814-d9f8-4a40-a775-07b50423cec5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1317992461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf6047793ecc44519667cf55e090296e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeaaf42d-88", "ovs_interfaceid": "deaaf42d-889f-4b49-abb5-3a3d4684ea5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:23:21 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Converting VIF {"id": "deaaf42d-889f-4b49-abb5-3a3d4684ea5f", "address": "fa:16:3e:c7:14:6b", "network": {"id": "ec191814-d9f8-4a40-a775-07b50423cec5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1317992461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf6047793ecc44519667cf55e090296e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeaaf42d-88", "ovs_interfaceid": "deaaf42d-889f-4b49-abb5-3a3d4684ea5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:23:21 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:14:6b,bridge_name='br-int',has_traffic_filtering=True,id=deaaf42d-889f-4b49-abb5-3a3d4684ea5f,network=Network(ec191814-d9f8-4a40-a775-07b50423cec5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeaaf42d-88') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:23:21 user nova-compute[72504]: DEBUG os_vif [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:14:6b,bridge_name='br-int',has_traffic_filtering=True,id=deaaf42d-889f-4b49-abb5-3a3d4684ea5f,network=Network(ec191814-d9f8-4a40-a775-07b50423cec5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeaaf42d-88') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:23:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:23:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdeaaf42d-88, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:23:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:23:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:23:21 user nova-compute[72504]: INFO os_vif [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:14:6b,bridge_name='br-int',has_traffic_filtering=True,id=deaaf42d-889f-4b49-abb5-3a3d4684ea5f,network=Network(ec191814-d9f8-4a40-a775-07b50423cec5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeaaf42d-88')
Aug 01 20:23:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:23:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'banrjFMz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:23:21 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:23:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:23:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:23:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13ceb393-e547-4f9b-8933-9bce419d6f07', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:23:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:23:21 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2466c1-7baa-468e-bf5f-2e3a6300100e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:23:21 user nova-compute[72504]: WARNING os_brick.initiator.connectors.iscsi [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 01 20:23:21 user nova-compute[72504]: 
Aug 01 20:23:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:23:21 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33de12e-05e4-45a4-a5ff-c280bca02b32]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:23:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 20:23:21 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:23:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 20:23:21 user nova-compute[72504]:  {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:23:21 user nova-compute[72504]: WARNING os_brick.initiator.connectors.iscsi [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 20:23:21 user nova-compute[72504]: 
Aug 01 20:23:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff40c32b6d0>, {}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:23:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Disconnecting from: [] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:23:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.047s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:23:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] <== disconnect_volume: return (49ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:23:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:23:21 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Deleting instance files /opt/stack/data/nova/instances/f0ffc053-4a57-486c-bc52-924e882dac0e_del
Aug 01 20:23:21 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Deletion of /opt/stack/data/nova/instances/f0ffc053-4a57-486c-bc52-924e882dac0e_del complete
Aug 01 20:23:21 user nova-compute[72504]: INFO nova.compute.manager [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 01 20:23:21 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:23:21 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:23:21 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:23:21 user nova-compute[72504]: DEBUG nova.objects.instance [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lazy-loading 'flavor' on Instance uuid 2caaa9dd-e1fd-465b-95a0-78fa51c96c15 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:23:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-2538dd0a-c955-4962-8ab8-5e132509f1da tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.649s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:23:22 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:23:22 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Took 0.93 seconds to deallocate network for instance.
Aug 01 20:23:22 user nova-compute[72504]: DEBUG nova.compute.manager [req-2b9eae93-fe40-4355-b68f-5b22528195a3 req-abc40434-296a-45b8-a755-ae56817e7173 service nova] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Received event network-vif-deleted-deaaf42d-889f-4b49-abb5-3a3d4684ea5f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:23:22 user nova-compute[72504]: INFO nova.compute.manager [req-2b9eae93-fe40-4355-b68f-5b22528195a3 req-abc40434-296a-45b8-a755-ae56817e7173 service nova] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Neutron deleted interface deaaf42d-889f-4b49-abb5-3a3d4684ea5f; detaching it from the instance and deleting it from the info cache
Aug 01 20:23:22 user nova-compute[72504]: DEBUG nova.network.neutron [req-2b9eae93-fe40-4355-b68f-5b22528195a3 req-abc40434-296a-45b8-a755-ae56817e7173 service nova] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:23:22 user nova-compute[72504]: WARNING nova.volume.cinder [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Attachment fdafaaac-fb38-4522-98ad-d62132ed35e0 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = fdafaaac-fb38-4522-98ad-d62132ed35e0. (HTTP 404) (Request-ID: req-4d545a3f-9174-4127-a8b2-a00740c56dc4)
Aug 01 20:23:22 user nova-compute[72504]: INFO nova.compute.manager [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Took 0.02 seconds to detach 1 volumes for instance.
Aug 01 20:23:22 user nova-compute[72504]: DEBUG nova.compute.manager [req-2b9eae93-fe40-4355-b68f-5b22528195a3 req-abc40434-296a-45b8-a755-ae56817e7173 service nova] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Detach interface failed, port_id=deaaf42d-889f-4b49-abb5-3a3d4684ea5f, reason: Instance f0ffc053-4a57-486c-bc52-924e882dac0e could not be found. {{(pid=72504) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 20:23:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:23:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:23:22 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:23:22 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:23:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:23:22 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Deleted allocations for instance f0ffc053-4a57-486c-bc52-924e882dac0e
Aug 01 20:23:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-6eeb2665-322f-43c9-b1b6-31396d7a577f tempest-VolumesSnapshotTestJSON-2122802409 tempest-VolumesSnapshotTestJSON-2122802409-project-member] Lock "f0ffc053-4a57-486c-bc52-924e882dac0e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.186s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:23:22 user nova-compute[72504]: DEBUG nova.compute.manager [req-dba8c498-e26b-4329-90d9-cbce066a7fb9 req-16b789ff-1a8c-47e5-8bde-de801f36c78f service nova] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Received event network-vif-plugged-deaaf42d-889f-4b49-abb5-3a3d4684ea5f {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:23:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-dba8c498-e26b-4329-90d9-cbce066a7fb9 req-16b789ff-1a8c-47e5-8bde-de801f36c78f service nova] Acquiring lock "f0ffc053-4a57-486c-bc52-924e882dac0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:23:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-dba8c498-e26b-4329-90d9-cbce066a7fb9 req-16b789ff-1a8c-47e5-8bde-de801f36c78f service nova] Lock "f0ffc053-4a57-486c-bc52-924e882dac0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:23:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-dba8c498-e26b-4329-90d9-cbce066a7fb9 req-16b789ff-1a8c-47e5-8bde-de801f36c78f service nova] Lock "f0ffc053-4a57-486c-bc52-924e882dac0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:23:22 user nova-compute[72504]: DEBUG nova.compute.manager [req-dba8c498-e26b-4329-90d9-cbce066a7fb9 req-16b789ff-1a8c-47e5-8bde-de801f36c78f service nova] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] No waiting events found dispatching network-vif-plugged-deaaf42d-889f-4b49-abb5-3a3d4684ea5f {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:23:22 user nova-compute[72504]: WARNING nova.compute.manager [req-dba8c498-e26b-4329-90d9-cbce066a7fb9 req-16b789ff-1a8c-47e5-8bde-de801f36c78f service nova] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Received unexpected event network-vif-plugged-deaaf42d-889f-4b49-abb5-3a3d4684ea5f for instance with vm_state deleted and task_state None.
Aug 01 20:23:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:23:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:23:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:23:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:23:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:23:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:23:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:23:32 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:23:36 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690921401.12107, f0ffc053-4a57-486c-bc52-924e882dac0e => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:23:36 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] VM Stopped (Lifecycle Event)
Aug 01 20:23:36 user nova-compute[72504]: DEBUG nova.compute.manager [None req-f6b855eb-a75f-48e2-83f6-cc3da1c8ce2c None None] [instance: f0ffc053-4a57-486c-bc52-924e882dac0e] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:23:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:23:36 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:23:39 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:23:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:23:41 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:23:45 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:23:45 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:23:45 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Didn't find any instances for network info cache update. {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 20:23:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:23:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:23:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:23:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:23:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:23:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:23:46 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:23:47 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:23:47 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:23:51 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:23:51 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:23:51 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:23:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:23:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:23:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:23:51 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:23:51 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257710b5-4f19-45e7-8e38-9c37277ae091/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257710b5-4f19-45e7-8e38-9c37277ae091/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:23:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257710b5-4f19-45e7-8e38-9c37277ae091/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/257710b5-4f19-45e7-8e38-9c37277ae091/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:23:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:23:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:52 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:23:52 user nova-compute[72504]: DEBUG nova.compute.manager [req-9f4bab67-d74f-4a6c-b3c0-d96fbc742c05 req-0845c068-19b0-46f9-b332-0cfef4782dc7 service nova] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Received event network-changed-0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:23:52 user nova-compute[72504]: DEBUG nova.compute.manager [req-9f4bab67-d74f-4a6c-b3c0-d96fbc742c05 req-0845c068-19b0-46f9-b332-0cfef4782dc7 service nova] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Refreshing instance network info cache due to event network-changed-0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:23:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-9f4bab67-d74f-4a6c-b3c0-d96fbc742c05 req-0845c068-19b0-46f9-b332-0cfef4782dc7 service nova] Acquiring lock "refresh_cache-257710b5-4f19-45e7-8e38-9c37277ae091" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:23:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-9f4bab67-d74f-4a6c-b3c0-d96fbc742c05 req-0845c068-19b0-46f9-b332-0cfef4782dc7 service nova] Acquired lock "refresh_cache-257710b5-4f19-45e7-8e38-9c37277ae091" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:23:52 user nova-compute[72504]: DEBUG nova.network.neutron [req-9f4bab67-d74f-4a6c-b3c0-d96fbc742c05 req-0845c068-19b0-46f9-b332-0cfef4782dc7 service nova] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Refreshing network info cache for port 0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:23:52 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:23:52 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:23:52 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8631MB free_disk=25.129730224609375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:23:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:23:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:23:53 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 2caaa9dd-e1fd-465b-95a0-78fa51c96c15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:23:53 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 257710b5-4f19-45e7-8e38-9c37277ae091 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:23:53 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:23:53 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:23:53 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:23:53 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:23:53 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:23:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:23:53 user nova-compute[72504]: DEBUG nova.network.neutron [req-9f4bab67-d74f-4a6c-b3c0-d96fbc742c05 req-0845c068-19b0-46f9-b332-0cfef4782dc7 service nova] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Updated VIF entry in instance network info cache for port 0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:23:53 user nova-compute[72504]: DEBUG nova.network.neutron [req-9f4bab67-d74f-4a6c-b3c0-d96fbc742c05 req-0845c068-19b0-46f9-b332-0cfef4782dc7 service nova] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Updating instance_info_cache with network_info: [{"id": "0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc", "address": "fa:16:3e:98:a3:43", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e947bdc-99", "ovs_interfaceid": "0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:23:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-9f4bab67-d74f-4a6c-b3c0-d96fbc742c05 req-0845c068-19b0-46f9-b332-0cfef4782dc7 service nova] Releasing lock "refresh_cache-257710b5-4f19-45e7-8e38-9c37277ae091" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:23:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:23:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:23:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "257710b5-4f19-45e7-8e38-9c37277ae091" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:23:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "257710b5-4f19-45e7-8e38-9c37277ae091" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:23:56 user nova-compute[72504]: DEBUG nova.objects.instance [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'flavor' on Instance uuid 257710b5-4f19-45e7-8e38-9c37277ae091 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:23:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "257710b5-4f19-45e7-8e38-9c37277ae091" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:23:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "257710b5-4f19-45e7-8e38-9c37277ae091" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:23:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "257710b5-4f19-45e7-8e38-9c37277ae091" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:23:56 user nova-compute[72504]: INFO nova.compute.manager [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Attaching volume 23d63c21-261c-447d-86f0-76c31c6c7236 to /dev/vdb
Aug 01 20:23:56 user nova-compute[72504]: DEBUG os_brick.utils [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:23:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:23:56 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde87f71-326a-490b-9e6b-f477d1a66202]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:23:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:23:56 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1e591f-34b3-498a-96bb-ae8275124816]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:23:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:23:56 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70277f9-5d60-4f30-87f4-c1515eb95a8b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:23:56 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf4fded-19a3-46c3-9e29-574d3fd79eb9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:23:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:23:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:23:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:23:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:23:56 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:23:56 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[347dd770-30c7-4493-825c-76e075014848]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:23:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:23:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:23:56 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:23:56 user nova-compute[72504]: DEBUG os_brick.utils [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:23:56 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Updating existing volume attachment record: 1cd0f74c-ce20-43fc-b651-fa1bde8ca1bc {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:23:58 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:23:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:24:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:24:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IULdYguD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:24:04 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:24:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:24:04 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:24:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:24:04 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0212d1bf-5db7-4530-a9fe-8359c6298e98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:24:04 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7108b4b-cbd0-48e5-b3ac-f592018d91da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236] added
Aug 01 20:24:04 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6736136f-f43c-4d3a-97ba-8845c95dd61d]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[deda1812-203e-42f9-bdb7-f907df1c99ce]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IULdYguD {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IULdYguD" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ec54b8-9ac1-4301-9118-57f0f12ea324]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IULdYguD'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[782af334-f0af-46ff-b9fe-9c477aec1ba9]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ad0901-ff22-447c-8ee4-1b26230b0424]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 20:24:04 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 20:24:04 user nova-compute[72504]:  {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:24:04 user nova-compute[72504]: WARNING os_brick.initiator.connectors.iscsi [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 20:24:04 user nova-compute[72504]: 
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f763771e-43a6-4c2e-9e05-c977cc241a7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236, portal: 172.16.0.220,3260]
Aug 01 20:24:04 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236, portal: 172.16.0.220,3260] successful.
Aug 01 20:24:04 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d01796-5f17-414d-b576-97a9ecf50214]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4bea40-34c1-47f5-96fa-62a2774868b3]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 (non-flash)
Aug 01 20:24:04 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 (non-flash)
Aug 01 20:24:04 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dce51b-2923-4631-9d90-4e290ae6f575]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:04 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:24:05 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:24:05 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IULdYguD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:24:05 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:24:05 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26661623731343433', 'path': '/dev/sdb'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:24:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661623731343433', 'path': '/dev/sdb'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:24:05 user nova-compute[72504]: DEBUG nova.objects.instance [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'flavor' on Instance uuid 257710b5-4f19-45e7-8e38-9c37277ae091 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:24:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 20:24:05 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:24:05 user nova-compute[72504]:   <source dev="/dev/sdb"/>
Aug 01 20:24:05 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:24:05 user nova-compute[72504]:   <serial>23d63c21-261c-447d-86f0-76c31c6c7236</serial>
Aug 01 20:24:05 user nova-compute[72504]: </disk>
Aug 01 20:24:05 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 20:24:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:24:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:24:05 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] No VIF found with MAC fa:16:3e:98:a3:43, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:24:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-bc00787d-9df2-406d-8570-062c9c45f53b tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "257710b5-4f19-45e7-8e38-9c37277ae091" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.276s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:24:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:24:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:24:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:24:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "257710b5-4f19-45e7-8e38-9c37277ae091" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:24:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "257710b5-4f19-45e7-8e38-9c37277ae091" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:24:10 user nova-compute[72504]: DEBUG nova.objects.instance [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'flavor' on Instance uuid 257710b5-4f19-45e7-8e38-9c37277ae091 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:24:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "257710b5-4f19-45e7-8e38-9c37277ae091" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:24:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "257710b5-4f19-45e7-8e38-9c37277ae091" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:24:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "257710b5-4f19-45e7-8e38-9c37277ae091" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:24:10 user nova-compute[72504]: INFO nova.compute.manager [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Attaching volume 0ee8a052-e85f-4ebc-9ca0-8861906db07e to /dev/vdc
Aug 01 20:24:10 user nova-compute[72504]: DEBUG os_brick.utils [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:24:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:10 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[231f2359-eda9-4a16-abf4-d1f8f1d9758c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:10 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e5837e-a10f-48bb-9b68-b7a942839c99]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:10 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cee0d4-3963-43e6-b2c1-f36d5ca0b524]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:10 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae60a67f-c037-4661-bdb6-2455b51901fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:24:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:24:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:24:10 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:24:10 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffc9932-8460-453d-aef2-0971b3183221]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:24:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:24:10 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:24:10 user nova-compute[72504]: DEBUG os_brick.utils [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:24:10 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Updating existing volume attachment record: bcaac9ec-206f-4d3c-b6c7-201eb6e5cce8 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:24:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:24:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-eb2fa857-c924-4752-8c3f-6c94da2317e9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:24:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-eb2fa857-c924-4752-8c3f-6c94da2317e9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:24:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-eb2fa857-c924-4752-8c3f-6c94da2317e9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:24:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-eb2fa857-c924-4752-8c3f-6c94da2317e9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:24:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-eb2fa857-c924-4752-8c3f-6c94da2317e9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:24:14 user nova-compute[72504]: INFO nova.compute.manager [None req-eb2fa857-c924-4752-8c3f-6c94da2317e9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Terminating instance
Aug 01 20:24:14 user nova-compute[72504]: DEBUG nova.compute.manager [None req-eb2fa857-c924-4752-8c3f-6c94da2317e9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:24:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:24:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:24:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:24:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:24:15 user nova-compute[72504]: DEBUG nova.compute.manager [req-73fafa5a-c1b2-41fa-9e7f-4d8f1596c5fb req-bd00f773-856b-45e7-b67e-1611b826fd35 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Received event network-vif-unplugged-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:24:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-73fafa5a-c1b2-41fa-9e7f-4d8f1596c5fb req-bd00f773-856b-45e7-b67e-1611b826fd35 service nova] Acquiring lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:24:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-73fafa5a-c1b2-41fa-9e7f-4d8f1596c5fb req-bd00f773-856b-45e7-b67e-1611b826fd35 service nova] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:24:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-73fafa5a-c1b2-41fa-9e7f-4d8f1596c5fb req-bd00f773-856b-45e7-b67e-1611b826fd35 service nova] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:24:15 user nova-compute[72504]: DEBUG nova.compute.manager [req-73fafa5a-c1b2-41fa-9e7f-4d8f1596c5fb req-bd00f773-856b-45e7-b67e-1611b826fd35 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] No waiting events found dispatching network-vif-unplugged-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:24:15 user nova-compute[72504]: DEBUG nova.compute.manager [req-73fafa5a-c1b2-41fa-9e7f-4d8f1596c5fb req-bd00f773-856b-45e7-b67e-1611b826fd35 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Received event network-vif-unplugged-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:24:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:24:15 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Instance destroyed successfully.
Aug 01 20:24:15 user nova-compute[72504]: DEBUG nova.objects.instance [None req-eb2fa857-c924-4752-8c3f-6c94da2317e9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lazy-loading 'resources' on Instance uuid 2caaa9dd-e1fd-465b-95a0-78fa51c96c15 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:24:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-eb2fa857-c924-4752-8c3f-6c94da2317e9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:19:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1596056108',display_name='tempest-TestMinimumBasicScenario-server-1596056108',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1596056108',id=45,image_ref='82aacf83-218b-493c-9327-6c737b4deaba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfv0+Sv8YQSyFEhS1Mp0+BN3XoNdJsAd9DgP/q9A7Z1pq/KksnP1DUgnH5iZS5TDMZKNXkrXPfXBcsLb8arVe7V1dL2QRX9XChORu7HtUkKOV7MNd0UdfUtOONBLaIw6w==',key_name='tempest-TestMinimumBasicScenario-311143372',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:19:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72d4446b451947be88bc15a1a938b859',ramdisk_id='',reservation_id='r-2fmlhn1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='82aacf83-218b-493c-9327-6c737b4deaba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-869578324',owner_user_name='tempest-TestMinimumBasicScenario-869578324-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:21:34Z,user_data=None,user_id='c0015fa066434b679e0126a916f96393',uuid=2caaa9dd-e1fd-465b-95a0-78fa51c96c15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "address": "fa:16:3e:4e:0e:3d", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6cbd7a-88", "ovs_interfaceid": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:24:15 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-eb2fa857-c924-4752-8c3f-6c94da2317e9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Converting VIF {"id": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "address": "fa:16:3e:4e:0e:3d", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6cbd7a-88", "ovs_interfaceid": "bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:24:15 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-eb2fa857-c924-4752-8c3f-6c94da2317e9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:0e:3d,bridge_name='br-int',has_traffic_filtering=True,id=bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7,network=Network(786ed785-b5d5-43d6-b39e-3d8c490dc3f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6cbd7a-88') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:24:15 user nova-compute[72504]: DEBUG os_vif [None req-eb2fa857-c924-4752-8c3f-6c94da2317e9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:0e:3d,bridge_name='br-int',has_traffic_filtering=True,id=bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7,network=Network(786ed785-b5d5-43d6-b39e-3d8c490dc3f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6cbd7a-88') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:24:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:24:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb6cbd7a-88, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:24:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:24:15 user nova-compute[72504]: INFO os_vif [None req-eb2fa857-c924-4752-8c3f-6c94da2317e9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:0e:3d,bridge_name='br-int',has_traffic_filtering=True,id=bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7,network=Network(786ed785-b5d5-43d6-b39e-3d8c490dc3f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6cbd7a-88')
Aug 01 20:24:15 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-eb2fa857-c924-4752-8c3f-6c94da2317e9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Deleting instance files /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15_del
Aug 01 20:24:15 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-eb2fa857-c924-4752-8c3f-6c94da2317e9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Deletion of /opt/stack/data/nova/instances/2caaa9dd-e1fd-465b-95a0-78fa51c96c15_del complete
Aug 01 20:24:15 user nova-compute[72504]: INFO nova.compute.manager [None req-eb2fa857-c924-4752-8c3f-6c94da2317e9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 01 20:24:15 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-eb2fa857-c924-4752-8c3f-6c94da2317e9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:24:15 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:24:15 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:24:16 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:24:16 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Took 0.59 seconds to deallocate network for instance.
Aug 01 20:24:16 user nova-compute[72504]: DEBUG nova.compute.manager [req-ad5f31ed-8f66-42c4-825e-c28e52899072 req-eac56530-b1ba-40f7-a7e3-879a35d31332 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Received event network-vif-deleted-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:24:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-eb2fa857-c924-4752-8c3f-6c94da2317e9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:24:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-eb2fa857-c924-4752-8c3f-6c94da2317e9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:24:16 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-eb2fa857-c924-4752-8c3f-6c94da2317e9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:24:16 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-eb2fa857-c924-4752-8c3f-6c94da2317e9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:24:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-eb2fa857-c924-4752-8c3f-6c94da2317e9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:24:16 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-eb2fa857-c924-4752-8c3f-6c94da2317e9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Deleted allocations for instance 2caaa9dd-e1fd-465b-95a0-78fa51c96c15
Aug 01 20:24:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-eb2fa857-c924-4752-8c3f-6c94da2317e9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.808s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:24:17 user nova-compute[72504]: DEBUG nova.compute.manager [req-530c240d-e5e7-4c13-8209-359b2af45186 req-9c52abf7-1bdb-4730-84f7-db9f4873b637 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Received event network-vif-plugged-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:24:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-530c240d-e5e7-4c13-8209-359b2af45186 req-9c52abf7-1bdb-4730-84f7-db9f4873b637 service nova] Acquiring lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:24:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-530c240d-e5e7-4c13-8209-359b2af45186 req-9c52abf7-1bdb-4730-84f7-db9f4873b637 service nova] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:24:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-530c240d-e5e7-4c13-8209-359b2af45186 req-9c52abf7-1bdb-4730-84f7-db9f4873b637 service nova] Lock "2caaa9dd-e1fd-465b-95a0-78fa51c96c15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:24:17 user nova-compute[72504]: DEBUG nova.compute.manager [req-530c240d-e5e7-4c13-8209-359b2af45186 req-9c52abf7-1bdb-4730-84f7-db9f4873b637 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] No waiting events found dispatching network-vif-plugged-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:24:17 user nova-compute[72504]: WARNING nova.compute.manager [req-530c240d-e5e7-4c13-8209-359b2af45186 req-9c52abf7-1bdb-4730-84f7-db9f4873b637 service nova] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Received unexpected event network-vif-plugged-bb6cbd7a-883f-48a0-9a17-6b96e48ecdd7 for instance with vm_state deleted and task_state None.
Aug 01 20:24:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZFxaRoCK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:24:18 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:24:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:24:18 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:24:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:24:18 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94f20fd-21e6-4a81-9cba-de976a7f5332]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:24:18 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe6a8bf-fbbd-4ae2-aff8-224ca0d43659]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e] added
Aug 01 20:24:18 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fe9223-52bf-47fc-8db9-ba7a37954f08]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[95757092-4c23-463e-9408-c4661d40b0f8]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZFxaRoCK {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZFxaRoCK" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8119dd7d-3bf7-473e-9bdc-b96b5f0e7320]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZFxaRoCK'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6886ccb2-d203-4b2d-badf-c36e2a62c5d4]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0243115b-aa06-4598-9f77-f9afb1a8e595]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 (non-flash)
Aug 01 20:24:18 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 (non-flash)
Aug 01 20:24:18 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d5f391-6711-4956-b004-3032391df0b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e, portal: 172.16.0.220,3260]
Aug 01 20:24:18 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e, portal: 172.16.0.220,3260] successful.
Aug 01 20:24:18 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[042abdbf-20c0-4b33-8bc9-1d6d88b246e8]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b1d175-3849-46c5-9353-89e528d3e873]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 (non-flash)
Aug 01 20:24:18 user nova-compute[72504]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e (non-flash)
Aug 01 20:24:18 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 (non-flash)
Aug 01 20:24:18 user nova-compute[72504]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e (non-flash)
Aug 01 20:24:18 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bb63c7-15f3-4410-9ce0-72d8343b1864]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:24:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZFxaRoCK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:24:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:24:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23938326138656633', 'path': '/dev/sdc'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:24:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938326138656633', 'path': '/dev/sdc'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:24:19 user nova-compute[72504]: DEBUG nova.objects.instance [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'flavor' on Instance uuid 257710b5-4f19-45e7-8e38-9c37277ae091 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:24:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 20:24:19 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:24:19 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 20:24:19 user nova-compute[72504]:   <target dev="vdc" bus="virtio"/>
Aug 01 20:24:19 user nova-compute[72504]:   <serial>0ee8a052-e85f-4ebc-9ca0-8861906db07e</serial>
Aug 01 20:24:19 user nova-compute[72504]: </disk>
Aug 01 20:24:19 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 20:24:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:24:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:24:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:24:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] No VIF found with MAC fa:16:3e:98:a3:43, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:24:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fdd44255-30e1-4431-9a42-0dff5a1581cc tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "257710b5-4f19-45e7-8e38-9c37277ae091" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.734s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:24:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:24:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "257710b5-4f19-45e7-8e38-9c37277ae091" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:24:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "257710b5-4f19-45e7-8e38-9c37277ae091" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:24:21 user nova-compute[72504]: INFO nova.compute.manager [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Detaching volume 23d63c21-261c-447d-86f0-76c31c6c7236
Aug 01 20:24:21 user nova-compute[72504]: INFO nova.virt.block_device [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Attempting to driver detach volume 23d63c21-261c-447d-86f0-76c31c6c7236 from mountpoint /dev/vdb
Aug 01 20:24:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Attempting to detach device vdb from instance 257710b5-4f19-45e7-8e38-9c37277ae091 from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 20:24:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:24:21 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:24:21 user nova-compute[72504]:   <source dev="/dev/sdb"/>
Aug 01 20:24:21 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:24:21 user nova-compute[72504]:   <serial>23d63c21-261c-447d-86f0-76c31c6c7236</serial>
Aug 01 20:24:21 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:24:21 user nova-compute[72504]: </disk>
Aug 01 20:24:21 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:24:21 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Successfully detached device vdb from instance 257710b5-4f19-45e7-8e38-9c37277ae091 from the persistent domain config.
Aug 01 20:24:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 257710b5-4f19-45e7-8e38-9c37277ae091 from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 20:24:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:24:21 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:24:21 user nova-compute[72504]:   <source dev="/dev/sdb"/>
Aug 01 20:24:21 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:24:21 user nova-compute[72504]:   <serial>23d63c21-261c-447d-86f0-76c31c6c7236</serial>
Aug 01 20:24:21 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:24:21 user nova-compute[72504]: </disk>
Aug 01 20:24:21 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690921462.0625076, 257710b5-4f19-45e7-8e38-9c37277ae091 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 257710b5-4f19-45e7-8e38-9c37277ae091 {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 20:24:22 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Successfully detached device vdb from instance 257710b5-4f19-45e7-8e38-9c37277ae091 from the live domain config.
Aug 01 20:24:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IULdYguD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:24:22 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:24:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04f331f-9537-4e96-bcbe-23d789c6b356]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[336b1be9-dbd6-41b7-997c-5a9a2b349eb2]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 (non-flash)
Aug 01 20:24:22 user nova-compute[72504]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e (non-flash)
Aug 01 20:24:22 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 (non-flash)
Aug 01 20:24:22 user nova-compute[72504]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e (non-flash)
Aug 01 20:24:22 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3f47368c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236'): ({'sdb'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Removing single pathed devices sdb {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[252de770-d359-47ee-8492-00ca4f3eb6c2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e03d732-4775-4842-8ea0-34cf43e13c22]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Flushing IO for device /dev/sdb {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10f986d-3237-4692-9091-ea45e4fbe15c]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb57c62-4acc-4790-b021-3f5d7262df85]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d31e8e3-476d-4486-944d-415bc5998d45]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cef21ac-c35a-4cc6-97b1-dcf1baca4923]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236, portal: 172.16.0.220,3260]
Aug 01 20:24:22 user nova-compute[72504]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236, portal: 172.16.0.220,3260] successful.
Aug 01 20:24:22 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d63c21-261c-447d-86f0-76c31c6c7236 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7a7045-922d-467f-a65c-a6e7690aec90]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] <== disconnect_volume: return (283ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:24:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:24:23 user nova-compute[72504]: DEBUG nova.objects.instance [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'flavor' on Instance uuid 257710b5-4f19-45e7-8e38-9c37277ae091 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:24:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b3e6df2e-244d-44cc-8aac-13195d6806ff tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "257710b5-4f19-45e7-8e38-9c37277ae091" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.586s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:24:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:24:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "257710b5-4f19-45e7-8e38-9c37277ae091" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:24:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "257710b5-4f19-45e7-8e38-9c37277ae091" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:24:23 user nova-compute[72504]: INFO nova.compute.manager [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Detaching volume 0ee8a052-e85f-4ebc-9ca0-8861906db07e
Aug 01 20:24:23 user nova-compute[72504]: INFO nova.virt.block_device [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Attempting to driver detach volume 0ee8a052-e85f-4ebc-9ca0-8861906db07e from mountpoint /dev/vdc
Aug 01 20:24:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Attempting to detach device vdc from instance 257710b5-4f19-45e7-8e38-9c37277ae091 from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:24:24 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:24:24 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 20:24:24 user nova-compute[72504]:   <target dev="vdc" bus="virtio"/>
Aug 01 20:24:24 user nova-compute[72504]:   <serial>0ee8a052-e85f-4ebc-9ca0-8861906db07e</serial>
Aug 01 20:24:24 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 20:24:24 user nova-compute[72504]: </disk>
Aug 01 20:24:24 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:24:24 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Successfully detached device vdc from instance 257710b5-4f19-45e7-8e38-9c37277ae091 from the persistent domain config.
Aug 01 20:24:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 257710b5-4f19-45e7-8e38-9c37277ae091 from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:24:24 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:24:24 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 20:24:24 user nova-compute[72504]:   <target dev="vdc" bus="virtio"/>
Aug 01 20:24:24 user nova-compute[72504]:   <serial>0ee8a052-e85f-4ebc-9ca0-8861906db07e</serial>
Aug 01 20:24:24 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 20:24:24 user nova-compute[72504]: </disk>
Aug 01 20:24:24 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690921464.4263787, 257710b5-4f19-45e7-8e38-9c37277ae091 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 257710b5-4f19-45e7-8e38-9c37277ae091 {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 20:24:24 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Successfully detached device vdc from instance 257710b5-4f19-45e7-8e38-9c37277ae091 from the live domain config.
Aug 01 20:24:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZFxaRoCK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:24:24 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:24:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1094bb4d-74b5-4db7-9f60-58de3dea1ea0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78fd2d1-bcfe-4a88-bbf2-f995ae2c7258]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e (non-flash)
Aug 01 20:24:24 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e (non-flash)
Aug 01 20:24:24 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff40c10caf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e'): ({'sdc'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Removing single pathed devices sdc {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ae91eb-6ff9-4f60-aaad-84e0d32eed22]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36a1b79-c125-4cb4-8329-367c42d25bac]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Flushing IO for device /dev/sdc {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96a5e1a-681e-4749-8f6b-da2e6da0019e]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[772c2678-4489-4d4f-9b32-8062d63ec4a7]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[814a1d57-c330-4c24-a1f1-7c4c4bdd52aa]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd88fb9-e32e-42dc-8e4e-301b4323baf4]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e, portal: 172.16.0.220,3260]
Aug 01 20:24:24 user nova-compute[72504]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e, portal: 172.16.0.220,3260] successful.
Aug 01 20:24:24 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee8a052-e85f-4ebc-9ca0-8861906db07e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6021d863-d72f-4b9e-a760-911a6f9c5cc0]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] <== disconnect_volume: return (300ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:24:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:24:25 user nova-compute[72504]: DEBUG nova.objects.instance [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'flavor' on Instance uuid 257710b5-4f19-45e7-8e38-9c37277ae091 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:24:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:24:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5e3673fe-fdc3-483d-9575-2548a4d728f9 tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "257710b5-4f19-45e7-8e38-9c37277ae091" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.631s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:24:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-51b891ac-517f-4a2f-b04d-911b3465ed8f tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "257710b5-4f19-45e7-8e38-9c37277ae091" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:24:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-51b891ac-517f-4a2f-b04d-911b3465ed8f tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "257710b5-4f19-45e7-8e38-9c37277ae091" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:24:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-51b891ac-517f-4a2f-b04d-911b3465ed8f tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "257710b5-4f19-45e7-8e38-9c37277ae091-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:24:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-51b891ac-517f-4a2f-b04d-911b3465ed8f tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "257710b5-4f19-45e7-8e38-9c37277ae091-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:24:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-51b891ac-517f-4a2f-b04d-911b3465ed8f tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "257710b5-4f19-45e7-8e38-9c37277ae091-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:24:26 user nova-compute[72504]: INFO nova.compute.manager [None req-51b891ac-517f-4a2f-b04d-911b3465ed8f tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Terminating instance
Aug 01 20:24:26 user nova-compute[72504]: DEBUG nova.compute.manager [None req-51b891ac-517f-4a2f-b04d-911b3465ed8f tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:24:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:24:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:24:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:24:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:24:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:24:26 user nova-compute[72504]: DEBUG nova.compute.manager [req-8bf5d738-8021-49cd-929e-c3147b39fdda req-1e1616e2-bbf2-41e2-ae2e-6a5f328d0987 service nova] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Received event network-vif-unplugged-0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:24:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-8bf5d738-8021-49cd-929e-c3147b39fdda req-1e1616e2-bbf2-41e2-ae2e-6a5f328d0987 service nova] Acquiring lock "257710b5-4f19-45e7-8e38-9c37277ae091-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:24:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-8bf5d738-8021-49cd-929e-c3147b39fdda req-1e1616e2-bbf2-41e2-ae2e-6a5f328d0987 service nova] Lock "257710b5-4f19-45e7-8e38-9c37277ae091-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:24:26 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-8bf5d738-8021-49cd-929e-c3147b39fdda req-1e1616e2-bbf2-41e2-ae2e-6a5f328d0987 service nova] Lock "257710b5-4f19-45e7-8e38-9c37277ae091-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:24:26 user nova-compute[72504]: DEBUG nova.compute.manager [req-8bf5d738-8021-49cd-929e-c3147b39fdda req-1e1616e2-bbf2-41e2-ae2e-6a5f328d0987 service nova] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] No waiting events found dispatching network-vif-unplugged-0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:24:26 user nova-compute[72504]: DEBUG nova.compute.manager [req-8bf5d738-8021-49cd-929e-c3147b39fdda req-1e1616e2-bbf2-41e2-ae2e-6a5f328d0987 service nova] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Received event network-vif-unplugged-0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:24:27 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Instance destroyed successfully.
Aug 01 20:24:27 user nova-compute[72504]: DEBUG nova.objects.instance [None req-51b891ac-517f-4a2f-b04d-911b3465ed8f tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lazy-loading 'resources' on Instance uuid 257710b5-4f19-45e7-8e38-9c37277ae091 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:24:27 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-51b891ac-517f-4a2f-b04d-911b3465ed8f tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:22:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1207610117',display_name='tempest-AttachVolumeTestJSON-server-1207610117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1207610117',id=47,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQb2X1+91DXQEgn8TuRg98VMxM4N5bj8MSW+/S9TDSy9gY4f+b6CvUkj2OZ+DT63WmHj6O46fX7sUWFlyOFIG91l7ObR9Ai9Q6uC8Uy2djcJZgKCF6F1+RIcQn9hXCbCQ==',key_name='tempest-keypair-95852369',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:22:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ef67b412883421f949be025bdc1cf38',ramdisk_id='',reservation_id='r-f848rwdk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1031917511',owner_user_name='tempest-AttachVolumeTestJSON-1031917511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:22:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90bea00e45b541baa6f98812cce770f8',uuid=257710b5-4f19-45e7-8e38-9c37277ae091,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc", "address": "fa:16:3e:98:a3:43", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e947bdc-99", "ovs_interfaceid": "0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:24:27 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-51b891ac-517f-4a2f-b04d-911b3465ed8f tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Converting VIF {"id": "0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc", "address": "fa:16:3e:98:a3:43", "network": {"id": "253a3888-9ae8-47b5-8875-9e4b823ac978", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1522131082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef67b412883421f949be025bdc1cf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e947bdc-99", "ovs_interfaceid": "0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:24:27 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-51b891ac-517f-4a2f-b04d-911b3465ed8f tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:a3:43,bridge_name='br-int',has_traffic_filtering=True,id=0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc,network=Network(253a3888-9ae8-47b5-8875-9e4b823ac978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e947bdc-99') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:24:27 user nova-compute[72504]: DEBUG os_vif [None req-51b891ac-517f-4a2f-b04d-911b3465ed8f tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:a3:43,bridge_name='br-int',has_traffic_filtering=True,id=0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc,network=Network(253a3888-9ae8-47b5-8875-9e4b823ac978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e947bdc-99') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:24:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:24:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e947bdc-99, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:24:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:24:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:24:27 user nova-compute[72504]: INFO os_vif [None req-51b891ac-517f-4a2f-b04d-911b3465ed8f tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:a3:43,bridge_name='br-int',has_traffic_filtering=True,id=0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc,network=Network(253a3888-9ae8-47b5-8875-9e4b823ac978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e947bdc-99')
Aug 01 20:24:27 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-51b891ac-517f-4a2f-b04d-911b3465ed8f tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Deleting instance files /opt/stack/data/nova/instances/257710b5-4f19-45e7-8e38-9c37277ae091_del
Aug 01 20:24:27 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-51b891ac-517f-4a2f-b04d-911b3465ed8f tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Deletion of /opt/stack/data/nova/instances/257710b5-4f19-45e7-8e38-9c37277ae091_del complete
Aug 01 20:24:27 user nova-compute[72504]: INFO nova.compute.manager [None req-51b891ac-517f-4a2f-b04d-911b3465ed8f tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 01 20:24:27 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-51b891ac-517f-4a2f-b04d-911b3465ed8f tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:24:27 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:24:27 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:24:28 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:24:28 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Took 0.84 seconds to deallocate network for instance.
Aug 01 20:24:28 user nova-compute[72504]: DEBUG nova.compute.manager [req-ee42cf02-677e-4530-8d36-689d9d7beac3 req-7c0f4511-7cc9-4ec3-a056-56d666dc3ebd service nova] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Received event network-vif-deleted-0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:24:28 user nova-compute[72504]: INFO nova.compute.manager [req-ee42cf02-677e-4530-8d36-689d9d7beac3 req-7c0f4511-7cc9-4ec3-a056-56d666dc3ebd service nova] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Neutron deleted interface 0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc; detaching it from the instance and deleting it from the info cache
Aug 01 20:24:28 user nova-compute[72504]: DEBUG nova.network.neutron [req-ee42cf02-677e-4530-8d36-689d9d7beac3 req-7c0f4511-7cc9-4ec3-a056-56d666dc3ebd service nova] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:24:28 user nova-compute[72504]: DEBUG nova.compute.manager [req-ee42cf02-677e-4530-8d36-689d9d7beac3 req-7c0f4511-7cc9-4ec3-a056-56d666dc3ebd service nova] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Detach interface failed, port_id=0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc, reason: Instance 257710b5-4f19-45e7-8e38-9c37277ae091 could not be found. {{(pid=72504) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 20:24:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-51b891ac-517f-4a2f-b04d-911b3465ed8f tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:24:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-51b891ac-517f-4a2f-b04d-911b3465ed8f tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:24:28 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-51b891ac-517f-4a2f-b04d-911b3465ed8f tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:24:28 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-51b891ac-517f-4a2f-b04d-911b3465ed8f tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:24:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-51b891ac-517f-4a2f-b04d-911b3465ed8f tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:24:28 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-51b891ac-517f-4a2f-b04d-911b3465ed8f tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Deleted allocations for instance 257710b5-4f19-45e7-8e38-9c37277ae091
Aug 01 20:24:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-51b891ac-517f-4a2f-b04d-911b3465ed8f tempest-AttachVolumeTestJSON-1031917511 tempest-AttachVolumeTestJSON-1031917511-project-member] Lock "257710b5-4f19-45e7-8e38-9c37277ae091" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.976s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:24:28 user nova-compute[72504]: DEBUG nova.compute.manager [req-bbb6217b-fe11-4592-a170-25b208654677 req-a883069b-6f04-476a-bdd0-804e3015b93a service nova] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Received event network-vif-plugged-0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:24:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-bbb6217b-fe11-4592-a170-25b208654677 req-a883069b-6f04-476a-bdd0-804e3015b93a service nova] Acquiring lock "257710b5-4f19-45e7-8e38-9c37277ae091-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:24:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-bbb6217b-fe11-4592-a170-25b208654677 req-a883069b-6f04-476a-bdd0-804e3015b93a service nova] Lock "257710b5-4f19-45e7-8e38-9c37277ae091-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:24:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-bbb6217b-fe11-4592-a170-25b208654677 req-a883069b-6f04-476a-bdd0-804e3015b93a service nova] Lock "257710b5-4f19-45e7-8e38-9c37277ae091-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:24:28 user nova-compute[72504]: DEBUG nova.compute.manager [req-bbb6217b-fe11-4592-a170-25b208654677 req-a883069b-6f04-476a-bdd0-804e3015b93a service nova] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] No waiting events found dispatching network-vif-plugged-0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:24:28 user nova-compute[72504]: WARNING nova.compute.manager [req-bbb6217b-fe11-4592-a170-25b208654677 req-a883069b-6f04-476a-bdd0-804e3015b93a service nova] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Received unexpected event network-vif-plugged-0e947bdc-99b1-4fc7-a78f-5d7e459ae1dc for instance with vm_state deleted and task_state None.
Aug 01 20:24:30 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690921455.4377754, 2caaa9dd-e1fd-465b-95a0-78fa51c96c15 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:24:30 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] VM Stopped (Lifecycle Event)
Aug 01 20:24:30 user nova-compute[72504]: DEBUG nova.compute.manager [None req-2d8674c2-0475-4422-ae7e-6bcc97e6a1db None None] [instance: 2caaa9dd-e1fd-465b-95a0-78fa51c96c15] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:24:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:24:32 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:24:36 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:24:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:24:40 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:24:42 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690921467.3408523, 257710b5-4f19-45e7-8e38-9c37277ae091 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:24:42 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] VM Stopped (Lifecycle Event)
Aug 01 20:24:42 user nova-compute[72504]: DEBUG nova.compute.manager [None req-f373119f-c79d-415f-9993-6824ac2291c8 None None] [instance: 257710b5-4f19-45e7-8e38-9c37277ae091] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:24:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:24:43 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:24:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:24:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:24:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:24:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:24:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:24:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:24:47 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:24:47 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:24:47 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:24:47 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 20:24:47 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Didn't find any instances for network info cache update. {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 20:24:47 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:24:47 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:24:51 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:24:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:24:53 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:24:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:24:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:24:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:24:53 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:24:54 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:24:54 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:24:54 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8862MB free_disk=25.175125122070312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:24:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:24:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:24:54 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:24:54 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:24:54 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:24:54 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:24:54 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:24:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:24:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:25:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:25:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:25:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:25:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:07 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:25:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:25:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:25:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:25:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:25:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:25:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:25:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.imagecache [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Verify base images {{(pid=72504) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 01 20:25:07 user nova-compute[72504]: WARNING nova.virt.libvirt.imagecache [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Unknown base file: /opt/stack/data/nova/instances/_base/58bddab1984b0b8f716d61b28c9375b6fa2c07aa
Aug 01 20:25:07 user nova-compute[72504]: WARNING nova.virt.libvirt.imagecache [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7c053d76191c916636190b81df43fe972f1485b1
Aug 01 20:25:07 user nova-compute[72504]: WARNING nova.virt.libvirt.imagecache [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Unknown base file: /opt/stack/data/nova/instances/_base/805772ebaa4e793259cc11807c8fdb7b5f4dfd9c
Aug 01 20:25:07 user nova-compute[72504]: WARNING nova.virt.libvirt.imagecache [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6c0fe78d1a8b5118e82636c49401685c312a7c10
Aug 01 20:25:07 user nova-compute[72504]: WARNING nova.virt.libvirt.imagecache [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Unknown base file: /opt/stack/data/nova/instances/_base/074eae364ff5c4c70ec3be4140b38e8248990d4e
Aug 01 20:25:07 user nova-compute[72504]: WARNING nova.virt.libvirt.imagecache [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Unknown base file: /opt/stack/data/nova/instances/_base/217f7c5d9190b28be6caf01eaa96e865da8fcd22
Aug 01 20:25:07 user nova-compute[72504]: WARNING nova.virt.libvirt.imagecache [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Unknown base file: /opt/stack/data/nova/instances/_base/84172392ce6ee4d7bc762047142f8bdc7ebe9621
Aug 01 20:25:07 user nova-compute[72504]: WARNING nova.virt.libvirt.imagecache [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Unknown base file: /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5
Aug 01 20:25:07 user nova-compute[72504]: INFO nova.virt.libvirt.imagecache [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Removable base files: /opt/stack/data/nova/instances/_base/58bddab1984b0b8f716d61b28c9375b6fa2c07aa /opt/stack/data/nova/instances/_base/7c053d76191c916636190b81df43fe972f1485b1 /opt/stack/data/nova/instances/_base/805772ebaa4e793259cc11807c8fdb7b5f4dfd9c /opt/stack/data/nova/instances/_base/6c0fe78d1a8b5118e82636c49401685c312a7c10 /opt/stack/data/nova/instances/_base/074eae364ff5c4c70ec3be4140b38e8248990d4e /opt/stack/data/nova/instances/_base/217f7c5d9190b28be6caf01eaa96e865da8fcd22 /opt/stack/data/nova/instances/_base/84172392ce6ee4d7bc762047142f8bdc7ebe9621 /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5
Aug 01 20:25:07 user nova-compute[72504]: INFO nova.virt.libvirt.imagecache [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/58bddab1984b0b8f716d61b28c9375b6fa2c07aa
Aug 01 20:25:07 user nova-compute[72504]: INFO nova.virt.libvirt.imagecache [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7c053d76191c916636190b81df43fe972f1485b1
Aug 01 20:25:07 user nova-compute[72504]: INFO nova.virt.libvirt.imagecache [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/805772ebaa4e793259cc11807c8fdb7b5f4dfd9c
Aug 01 20:25:07 user nova-compute[72504]: INFO nova.virt.libvirt.imagecache [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6c0fe78d1a8b5118e82636c49401685c312a7c10
Aug 01 20:25:07 user nova-compute[72504]: INFO nova.virt.libvirt.imagecache [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/074eae364ff5c4c70ec3be4140b38e8248990d4e
Aug 01 20:25:07 user nova-compute[72504]: INFO nova.virt.libvirt.imagecache [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/217f7c5d9190b28be6caf01eaa96e865da8fcd22
Aug 01 20:25:07 user nova-compute[72504]: INFO nova.virt.libvirt.imagecache [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/84172392ce6ee4d7bc762047142f8bdc7ebe9621
Aug 01 20:25:07 user nova-compute[72504]: INFO nova.virt.libvirt.imagecache [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5
Aug 01 20:25:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.imagecache [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Verification complete {{(pid=72504) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 01 20:25:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.imagecache [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Verify swap images {{(pid=72504) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 01 20:25:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.imagecache [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Verify ephemeral images {{(pid=72504) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 01 20:25:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:25:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:25:08 user nova-compute[72504]: DEBUG nova.compute.manager [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 20:25:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:25:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:25:09 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:25:09 user nova-compute[72504]: INFO nova.compute.claims [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Claim successful on node user
Aug 01 20:25:09 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:25:09 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:25:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.180s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:25:09 user nova-compute[72504]: DEBUG nova.compute.manager [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 20:25:09 user nova-compute[72504]: DEBUG nova.compute.manager [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 20:25:09 user nova-compute[72504]: DEBUG nova.network.neutron [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 20:25:09 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 20:25:09 user nova-compute[72504]: DEBUG nova.compute.manager [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 20:25:09 user nova-compute[72504]: DEBUG nova.compute.manager [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 20:25:09 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:25:09 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Creating image(s)
Aug 01 20:25:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "/opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:25:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "/opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:25:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "/opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:25:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "ffde6124ab33199ad779999dbaee319301d06478" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:25:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "ffde6124ab33199ad779999dbaee319301d06478" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:25:09 user nova-compute[72504]: DEBUG nova.policy [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0015fa066434b679e0126a916f96393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d4446b451947be88bc15a1a938b859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 20:25:09 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ffde6124ab33199ad779999dbaee319301d06478.part --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:25:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ffde6124ab33199ad779999dbaee319301d06478.part --force-share --output=json" returned: 0 in 0.143s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:25:10 user nova-compute[72504]: DEBUG nova.virt.images [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] 14534198-33da-4241-b4ea-8ccc019a85e1 was qcow2, converting to raw {{(pid=72504) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 20:25:10 user nova-compute[72504]: DEBUG nova.privsep.utils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72504) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 20:25:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ffde6124ab33199ad779999dbaee319301d06478.part /opt/stack/data/nova/instances/_base/ffde6124ab33199ad779999dbaee319301d06478.converted {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:25:10 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:10 user nova-compute[72504]: DEBUG nova.network.neutron [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Successfully created port: c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 20:25:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ffde6124ab33199ad779999dbaee319301d06478.part /opt/stack/data/nova/instances/_base/ffde6124ab33199ad779999dbaee319301d06478.converted" returned: 0 in 0.366s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:25:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ffde6124ab33199ad779999dbaee319301d06478.converted --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:25:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ffde6124ab33199ad779999dbaee319301d06478.converted --force-share --output=json" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:25:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "ffde6124ab33199ad779999dbaee319301d06478" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.261s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:25:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ffde6124ab33199ad779999dbaee319301d06478 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:25:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ffde6124ab33199ad779999dbaee319301d06478 --force-share --output=json" returned: 0 in 0.142s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:25:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "ffde6124ab33199ad779999dbaee319301d06478" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:25:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "ffde6124ab33199ad779999dbaee319301d06478" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:25:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ffde6124ab33199ad779999dbaee319301d06478 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:25:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ffde6124ab33199ad779999dbaee319301d06478 --force-share --output=json" returned: 0 in 0.141s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:25:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ffde6124ab33199ad779999dbaee319301d06478,backing_fmt=raw /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ffde6124ab33199ad779999dbaee319301d06478,backing_fmt=raw /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk 1073741824" returned: 0 in 0.051s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "ffde6124ab33199ad779999dbaee319301d06478" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ffde6124ab33199ad779999dbaee319301d06478 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.network.neutron [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Successfully updated port: c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquired lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.network.neutron [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ffde6124ab33199ad779999dbaee319301d06478 --force-share --output=json" returned: 0 in 0.131s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.compute.manager [req-75add4c9-5556-4800-be4f-05b51e68b907 req-47a98e72-38f2-44a3-853d-f57e98fadf4e service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Received event network-changed-c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.compute.manager [req-75add4c9-5556-4800-be4f-05b51e68b907 req-47a98e72-38f2-44a3-853d-f57e98fadf4e service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Refreshing instance network info cache due to event network-changed-c9241d82-2fb0-4009-9861-d616702811ce. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-75add4c9-5556-4800-be4f-05b51e68b907 req-47a98e72-38f2-44a3-853d-f57e98fadf4e service nova] Acquiring lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.network.neutron [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Cannot resize image /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.objects.instance [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lazy-loading 'migration_context' on Instance uuid 07379d7d-7337-4b7c-9a2a-69454c7f6bd0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Ensure instance console log exists: /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.network.neutron [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Updating instance_info_cache with network_info: [{"id": "c9241d82-2fb0-4009-9861-d616702811ce", "address": "fa:16:3e:03:16:b6", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9241d82-2f", "ovs_interfaceid": "c9241d82-2fb0-4009-9861-d616702811ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Releasing lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.compute.manager [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Instance network_info: |[{"id": "c9241d82-2fb0-4009-9861-d616702811ce", "address": "fa:16:3e:03:16:b6", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9241d82-2f", "ovs_interfaceid": "c9241d82-2fb0-4009-9861-d616702811ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-75add4c9-5556-4800-be4f-05b51e68b907 req-47a98e72-38f2-44a3-853d-f57e98fadf4e service nova] Acquired lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.network.neutron [req-75add4c9-5556-4800-be4f-05b51e68b907 req-47a98e72-38f2-44a3-853d-f57e98fadf4e service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Refreshing network info cache for port c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Start _get_guest_xml network_info=[{"id": "c9241d82-2fb0-4009-9861-d616702811ce", "address": "fa:16:3e:03:16:b6", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9241d82-2f", "ovs_interfaceid": "c9241d82-2fb0-4009-9861-d616702811ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T20:25:06Z,direct_url=<?>,disk_format='qcow2',id=14534198-33da-4241-b4ea-8ccc019a85e1,min_disk=0,min_ram=0,name='tempest-scenario-img--738837308',owner='72d4446b451947be88bc15a1a938b859',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T20:25:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '14534198-33da-4241-b4ea-8ccc019a85e1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:25:11 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:25:11 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T20:25:06Z,direct_url=<?>,disk_format='qcow2',id=14534198-33da-4241-b4ea-8ccc019a85e1,min_disk=0,min_ram=0,name='tempest-scenario-img--738837308',owner='72d4446b451947be88bc15a1a938b859',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T20:25:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2041375816',display_name='tempest-TestMinimumBasicScenario-server-2041375816',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2041375816',id=48,image_ref='14534198-33da-4241-b4ea-8ccc019a85e1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLehmylpaCdal4Jqd8WaFkEfiZW2L1clsbF//05KMkNDqEcpl0EZbm2TzEFmXpF4uVTxvfJcw8Q1QqJKuWUwE7fCr1E92qXwnO85qh82bjj+2dWKu/NGJQAY8KDt9btYFw==',key_name='tempest-TestMinimumBasicScenario-1903276268',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72d4446b451947be88bc15a1a938b859',ramdisk_id='',reservation_id='r-zcj9lrw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='14534198-33da-4241-b4ea-8ccc019a85e1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-869578324',owner_user_name='tempest-TestMinimumBasicScenario-869578324-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:25:09Z,user_data=None,user_id='c0015fa066434b679e0126a916f96393',uuid=07379d7d-7337-4b7c-9a2a-69454c7f6bd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9241d82-2fb0-4009-9861-d616702811ce", "address": "fa:16:3e:03:16:b6", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9241d82-2f", "ovs_interfaceid": "c9241d82-2fb0-4009-9861-d616702811ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Converting VIF {"id": "c9241d82-2fb0-4009-9861-d616702811ce", "address": "fa:16:3e:03:16:b6", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9241d82-2f", "ovs_interfaceid": "c9241d82-2fb0-4009-9861-d616702811ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:16:b6,bridge_name='br-int',has_traffic_filtering=True,id=c9241d82-2fb0-4009-9861-d616702811ce,network=Network(786ed785-b5d5-43d6-b39e-3d8c490dc3f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9241d82-2f') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.objects.instance [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lazy-loading 'pci_devices' on Instance uuid 07379d7d-7337-4b7c-9a2a-69454c7f6bd0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:25:11 user nova-compute[72504]:   <uuid>07379d7d-7337-4b7c-9a2a-69454c7f6bd0</uuid>
Aug 01 20:25:11 user nova-compute[72504]:   <name>instance-00000030</name>
Aug 01 20:25:11 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:25:11 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:25:11 user nova-compute[72504]:   <metadata>
Aug 01 20:25:11 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:25:11 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:25:11 user nova-compute[72504]:       <nova:name>tempest-TestMinimumBasicScenario-server-2041375816</nova:name>
Aug 01 20:25:11 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:25:11</nova:creationTime>
Aug 01 20:25:11 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:25:11 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:25:11 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:25:11 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:25:11 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:25:11 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:25:11 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:25:11 user nova-compute[72504]:       <nova:owner>
Aug 01 20:25:11 user nova-compute[72504]:         <nova:user uuid="c0015fa066434b679e0126a916f96393">tempest-TestMinimumBasicScenario-869578324-project-member</nova:user>
Aug 01 20:25:11 user nova-compute[72504]:         <nova:project uuid="72d4446b451947be88bc15a1a938b859">tempest-TestMinimumBasicScenario-869578324</nova:project>
Aug 01 20:25:11 user nova-compute[72504]:       </nova:owner>
Aug 01 20:25:11 user nova-compute[72504]:       <nova:root type="image" uuid="14534198-33da-4241-b4ea-8ccc019a85e1"/>
Aug 01 20:25:11 user nova-compute[72504]:       <nova:ports>
Aug 01 20:25:11 user nova-compute[72504]:         <nova:port uuid="c9241d82-2fb0-4009-9861-d616702811ce">
Aug 01 20:25:11 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 20:25:11 user nova-compute[72504]:         </nova:port>
Aug 01 20:25:11 user nova-compute[72504]:       </nova:ports>
Aug 01 20:25:11 user nova-compute[72504]:     </nova:instance>
Aug 01 20:25:11 user nova-compute[72504]:   </metadata>
Aug 01 20:25:11 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:25:11 user nova-compute[72504]:     <system>
Aug 01 20:25:11 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:25:11 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:25:11 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:25:11 user nova-compute[72504]:       <entry name="serial">07379d7d-7337-4b7c-9a2a-69454c7f6bd0</entry>
Aug 01 20:25:11 user nova-compute[72504]:       <entry name="uuid">07379d7d-7337-4b7c-9a2a-69454c7f6bd0</entry>
Aug 01 20:25:11 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:25:11 user nova-compute[72504]:     </system>
Aug 01 20:25:11 user nova-compute[72504]:   </sysinfo>
Aug 01 20:25:11 user nova-compute[72504]:   <os>
Aug 01 20:25:11 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:25:11 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:25:11 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:25:11 user nova-compute[72504]:   </os>
Aug 01 20:25:11 user nova-compute[72504]:   <features>
Aug 01 20:25:11 user nova-compute[72504]:     <acpi/>
Aug 01 20:25:11 user nova-compute[72504]:     <apic/>
Aug 01 20:25:11 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:25:11 user nova-compute[72504]:   </features>
Aug 01 20:25:11 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:25:11 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:25:11 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:25:11 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:25:11 user nova-compute[72504]:   </clock>
Aug 01 20:25:11 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:25:11 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:25:11 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:25:11 user nova-compute[72504]:   </cpu>
Aug 01 20:25:11 user nova-compute[72504]:   <devices>
Aug 01 20:25:11 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 20:25:11 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 20:25:11 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk"/>
Aug 01 20:25:11 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:25:11 user nova-compute[72504]:     </disk>
Aug 01 20:25:11 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:25:11 user nova-compute[72504]:       <mac address="fa:16:3e:03:16:b6"/>
Aug 01 20:25:11 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:25:11 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:25:11 user nova-compute[72504]:       <target dev="tapc9241d82-2f"/>
Aug 01 20:25:11 user nova-compute[72504]:     </interface>
Aug 01 20:25:11 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:25:11 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/console.log" append="off"/>
Aug 01 20:25:11 user nova-compute[72504]:     </serial>
Aug 01 20:25:11 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:25:11 user nova-compute[72504]:     <video>
Aug 01 20:25:11 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:25:11 user nova-compute[72504]:     </video>
Aug 01 20:25:11 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:25:11 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:25:11 user nova-compute[72504]:     </rng>
Aug 01 20:25:11 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:25:11 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:25:11 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:25:11 user nova-compute[72504]:     </memballoon>
Aug 01 20:25:11 user nova-compute[72504]:   </devices>
Aug 01 20:25:11 user nova-compute[72504]: </domain>
Aug 01 20:25:11 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2041375816',display_name='tempest-TestMinimumBasicScenario-server-2041375816',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2041375816',id=48,image_ref='14534198-33da-4241-b4ea-8ccc019a85e1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLehmylpaCdal4Jqd8WaFkEfiZW2L1clsbF//05KMkNDqEcpl0EZbm2TzEFmXpF4uVTxvfJcw8Q1QqJKuWUwE7fCr1E92qXwnO85qh82bjj+2dWKu/NGJQAY8KDt9btYFw==',key_name='tempest-TestMinimumBasicScenario-1903276268',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72d4446b451947be88bc15a1a938b859',ramdisk_id='',reservation_id='r-zcj9lrw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='14534198-33da-4241-b4ea-8ccc019a85e1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-869578324',owner_user_name='tempest-TestMinimumBasicScenario-869578324-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:25:09Z,user_data=None,user_id='c0015fa066434b679e0126a916f96393',uuid=07379d7d-7337-4b7c-9a2a-69454c7f6bd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9241d82-2fb0-4009-9861-d616702811ce", "address": "fa:16:3e:03:16:b6", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9241d82-2f", "ovs_interfaceid": "c9241d82-2fb0-4009-9861-d616702811ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Converting VIF {"id": "c9241d82-2fb0-4009-9861-d616702811ce", "address": "fa:16:3e:03:16:b6", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9241d82-2f", "ovs_interfaceid": "c9241d82-2fb0-4009-9861-d616702811ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:16:b6,bridge_name='br-int',has_traffic_filtering=True,id=c9241d82-2fb0-4009-9861-d616702811ce,network=Network(786ed785-b5d5-43d6-b39e-3d8c490dc3f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9241d82-2f') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG os_vif [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:16:b6,bridge_name='br-int',has_traffic_filtering=True,id=c9241d82-2fb0-4009-9861-d616702811ce,network=Network(786ed785-b5d5-43d6-b39e-3d8c490dc3f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9241d82-2f') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9241d82-2f, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc9241d82-2f, col_values=(('external_ids', {'iface-id': 'c9241d82-2fb0-4009-9861-d616702811ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:16:b6', 'vm-uuid': '07379d7d-7337-4b7c-9a2a-69454c7f6bd0'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:11 user nova-compute[72504]: INFO os_vif [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:16:b6,bridge_name='br-int',has_traffic_filtering=True,id=c9241d82-2fb0-4009-9861-d616702811ce,network=Network(786ed785-b5d5-43d6-b39e-3d8c490dc3f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9241d82-2f')
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] No VIF found with MAC fa:16:3e:03:16:b6, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.network.neutron [req-75add4c9-5556-4800-be4f-05b51e68b907 req-47a98e72-38f2-44a3-853d-f57e98fadf4e service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Updated VIF entry in instance network info cache for port c9241d82-2fb0-4009-9861-d616702811ce. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:25:11 user nova-compute[72504]: DEBUG nova.network.neutron [req-75add4c9-5556-4800-be4f-05b51e68b907 req-47a98e72-38f2-44a3-853d-f57e98fadf4e service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Updating instance_info_cache with network_info: [{"id": "c9241d82-2fb0-4009-9861-d616702811ce", "address": "fa:16:3e:03:16:b6", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9241d82-2f", "ovs_interfaceid": "c9241d82-2fb0-4009-9861-d616702811ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:25:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-75add4c9-5556-4800-be4f-05b51e68b907 req-47a98e72-38f2-44a3-853d-f57e98fadf4e service nova] Releasing lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:25:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:13 user nova-compute[72504]: DEBUG nova.compute.manager [req-ccd8a35b-b71b-4cc8-9b15-f1b3253b6d3e req-34ffae92-c4ae-41c8-9187-352d7ef99573 service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Received event network-vif-plugged-c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:25:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ccd8a35b-b71b-4cc8-9b15-f1b3253b6d3e req-34ffae92-c4ae-41c8-9187-352d7ef99573 service nova] Acquiring lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:25:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ccd8a35b-b71b-4cc8-9b15-f1b3253b6d3e req-34ffae92-c4ae-41c8-9187-352d7ef99573 service nova] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:25:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ccd8a35b-b71b-4cc8-9b15-f1b3253b6d3e req-34ffae92-c4ae-41c8-9187-352d7ef99573 service nova] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:25:13 user nova-compute[72504]: DEBUG nova.compute.manager [req-ccd8a35b-b71b-4cc8-9b15-f1b3253b6d3e req-34ffae92-c4ae-41c8-9187-352d7ef99573 service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] No waiting events found dispatching network-vif-plugged-c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:25:13 user nova-compute[72504]: WARNING nova.compute.manager [req-ccd8a35b-b71b-4cc8-9b15-f1b3253b6d3e req-34ffae92-c4ae-41c8-9187-352d7ef99573 service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Received unexpected event network-vif-plugged-c9241d82-2fb0-4009-9861-d616702811ce for instance with vm_state building and task_state spawning.
Aug 01 20:25:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:15 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690921515.0093808, 07379d7d-7337-4b7c-9a2a-69454c7f6bd0 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:25:15 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] VM Resumed (Lifecycle Event)
Aug 01 20:25:15 user nova-compute[72504]: DEBUG nova.compute.manager [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:25:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:25:15 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Instance spawned successfully.
Aug 01 20:25:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 20:25:15 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:25:15 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:25:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:25:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:25:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:25:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:25:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:25:15 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:25:15 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:25:15 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690921515.0132813, 07379d7d-7337-4b7c-9a2a-69454c7f6bd0 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:25:15 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] VM Started (Lifecycle Event)
Aug 01 20:25:15 user nova-compute[72504]: INFO nova.compute.manager [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Took 5.73 seconds to spawn the instance on the hypervisor.
Aug 01 20:25:15 user nova-compute[72504]: DEBUG nova.compute.manager [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:25:15 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:25:15 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:25:15 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:25:15 user nova-compute[72504]: INFO nova.compute.manager [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Took 6.20 seconds to build instance.
Aug 01 20:25:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-4012f904-7ab1-484e-a344-f7784fc863cb tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.359s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:25:15 user nova-compute[72504]: DEBUG nova.compute.manager [req-d34f1ffe-c8e0-44b6-9605-aabbb81efc63 req-b6a47e59-0a0d-4afc-82cb-f69617cb62dc service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Received event network-vif-plugged-c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:25:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d34f1ffe-c8e0-44b6-9605-aabbb81efc63 req-b6a47e59-0a0d-4afc-82cb-f69617cb62dc service nova] Acquiring lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:25:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d34f1ffe-c8e0-44b6-9605-aabbb81efc63 req-b6a47e59-0a0d-4afc-82cb-f69617cb62dc service nova] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:25:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-d34f1ffe-c8e0-44b6-9605-aabbb81efc63 req-b6a47e59-0a0d-4afc-82cb-f69617cb62dc service nova] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:25:15 user nova-compute[72504]: DEBUG nova.compute.manager [req-d34f1ffe-c8e0-44b6-9605-aabbb81efc63 req-b6a47e59-0a0d-4afc-82cb-f69617cb62dc service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] No waiting events found dispatching network-vif-plugged-c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:25:15 user nova-compute[72504]: WARNING nova.compute.manager [req-d34f1ffe-c8e0-44b6-9605-aabbb81efc63 req-b6a47e59-0a0d-4afc-82cb-f69617cb62dc service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Received unexpected event network-vif-plugged-c9241d82-2fb0-4009-9861-d616702811ce for instance with vm_state active and task_state None.
Aug 01 20:25:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:32 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:25:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:36 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:25:36 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Cleaning up deleted instances {{(pid=72504) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 20:25:36 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] There are 0 instances to clean {{(pid=72504) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 20:25:37 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:25:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:42 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:25:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:45 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:25:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:47 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:25:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:48 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:25:48 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:25:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:49 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:25:49 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:25:49 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 20:25:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:25:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:25:50 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:25:50 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lazy-loading 'info_cache' on Instance uuid 07379d7d-7337-4b7c-9a2a-69454c7f6bd0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:25:50 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Updating instance_info_cache with network_info: [{"id": "c9241d82-2fb0-4009-9861-d616702811ce", "address": "fa:16:3e:03:16:b6", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9241d82-2f", "ovs_interfaceid": "c9241d82-2fb0-4009-9861-d616702811ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:25:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:25:50 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:25:51 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:53 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:25:53 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:25:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:55 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:25:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:25:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:25:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:25:55 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:25:55 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:25:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:25:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:25:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:25:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:56 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:25:56 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:25:56 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8732MB free_disk=25.1141357421875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:25:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:25:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:25:56 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 07379d7d-7337-4b7c-9a2a-69454c7f6bd0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:25:56 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:25:56 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:25:56 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:25:57 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:25:57 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:25:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.402s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:25:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:25:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:00 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:26:01 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:11 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:16 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:23 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:26:23 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72504) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 20:26:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:33 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:26:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:26:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:26:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:26:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:26:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:26:39 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:26:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:44 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:26:45 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:26:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:47 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:26:48 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:26:48 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:26:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:51 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:51 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:26:51 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:26:51 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 20:26:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:26:51 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:26:51 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:26:51 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lazy-loading 'info_cache' on Instance uuid 07379d7d-7337-4b7c-9a2a-69454c7f6bd0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:26:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "27f71b04-7113-416c-961e-0c1610c45715" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:26:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "27f71b04-7113-416c-961e-0c1610c45715" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:26:52 user nova-compute[72504]: DEBUG nova.compute.manager [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 20:26:52 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Updating instance_info_cache with network_info: [{"id": "c9241d82-2fb0-4009-9861-d616702811ce", "address": "fa:16:3e:03:16:b6", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9241d82-2f", "ovs_interfaceid": "c9241d82-2fb0-4009-9861-d616702811ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:26:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:26:52 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:26:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:26:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:26:52 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:26:52 user nova-compute[72504]: INFO nova.compute.claims [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Claim successful on node user
Aug 01 20:26:52 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Refreshing inventories for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 20:26:52 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Updating ProviderTree inventory for provider b951a798-e88c-472c-8347-2c5f6a05d47c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 20:26:52 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Updating inventory in ProviderTree for provider b951a798-e88c-472c-8347-2c5f6a05d47c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 20:26:52 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Refreshing aggregate associations for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c, aggregates: None {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 20:26:52 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Refreshing trait associations for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c, traits: HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 20:26:52 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:26:52 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:26:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:26:52 user nova-compute[72504]: DEBUG nova.compute.manager [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 20:26:52 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:26:52 user nova-compute[72504]: DEBUG nova.compute.manager [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 20:26:52 user nova-compute[72504]: DEBUG nova.network.neutron [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 20:26:52 user nova-compute[72504]: WARNING nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] While synchronizing instance power states, found 2 instances in the database and 1 instances on the hypervisor.
Aug 01 20:26:52 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid 07379d7d-7337-4b7c-9a2a-69454c7f6bd0 {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 20:26:52 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid 27f71b04-7113-416c-961e-0c1610c45715 {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 20:26:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:26:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:26:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "27f71b04-7113-416c-961e-0c1610c45715" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:26:53 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 20:26:53 user nova-compute[72504]: DEBUG nova.compute.manager [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG nova.policy [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74f57f96a0f3453f91f8bb8554c4e53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954dcaf44c2347b597c22547e7234855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG nova.compute.manager [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:26:53 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Creating image(s)
Aug 01 20:26:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "/opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "/opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "/opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.144s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.136s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk 1073741824" returned: 0 in 0.052s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.131s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Checking if we can resize image /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Cannot resize image /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG nova.objects.instance [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lazy-loading 'migration_context' on Instance uuid 27f71b04-7113-416c-961e-0c1610c45715 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Ensure instance console log exists: /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:26:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:54 user nova-compute[72504]: DEBUG nova.network.neutron [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Successfully created port: 56c55251-4056-41f5-9643-2775e2bc3f46 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 20:26:54 user nova-compute[72504]: DEBUG nova.network.neutron [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Successfully updated port: 56c55251-4056-41f5-9643-2775e2bc3f46 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 20:26:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "refresh_cache-27f71b04-7113-416c-961e-0c1610c45715" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:26:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquired lock "refresh_cache-27f71b04-7113-416c-961e-0c1610c45715" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:26:54 user nova-compute[72504]: DEBUG nova.network.neutron [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.network.neutron [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-b20d0dcc-6aee-428b-ae83-8158dd6518f8 req-6582322f-20f0-4b43-b544-a3b42d7f480e service nova] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Received event network-changed-56c55251-4056-41f5-9643-2775e2bc3f46 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-b20d0dcc-6aee-428b-ae83-8158dd6518f8 req-6582322f-20f0-4b43-b544-a3b42d7f480e service nova] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Refreshing instance network info cache due to event network-changed-56c55251-4056-41f5-9643-2775e2bc3f46. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b20d0dcc-6aee-428b-ae83-8158dd6518f8 req-6582322f-20f0-4b43-b544-a3b42d7f480e service nova] Acquiring lock "refresh_cache-27f71b04-7113-416c-961e-0c1610c45715" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.network.neutron [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Updating instance_info_cache with network_info: [{"id": "56c55251-4056-41f5-9643-2775e2bc3f46", "address": "fa:16:3e:ed:b0:63", "network": {"id": "ef0eee7c-6d8a-43f8-b1b0-584de56c03ad", "bridge": "br-int", "label": "tempest-TestStampPattern-741020257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "954dcaf44c2347b597c22547e7234855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c55251-40", "ovs_interfaceid": "56c55251-4056-41f5-9643-2775e2bc3f46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Releasing lock "refresh_cache-27f71b04-7113-416c-961e-0c1610c45715" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.compute.manager [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Instance network_info: |[{"id": "56c55251-4056-41f5-9643-2775e2bc3f46", "address": "fa:16:3e:ed:b0:63", "network": {"id": "ef0eee7c-6d8a-43f8-b1b0-584de56c03ad", "bridge": "br-int", "label": "tempest-TestStampPattern-741020257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "954dcaf44c2347b597c22547e7234855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c55251-40", "ovs_interfaceid": "56c55251-4056-41f5-9643-2775e2bc3f46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b20d0dcc-6aee-428b-ae83-8158dd6518f8 req-6582322f-20f0-4b43-b544-a3b42d7f480e service nova] Acquired lock "refresh_cache-27f71b04-7113-416c-961e-0c1610c45715" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.network.neutron [req-b20d0dcc-6aee-428b-ae83-8158dd6518f8 req-6582322f-20f0-4b43-b544-a3b42d7f480e service nova] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Refreshing network info cache for port 56c55251-4056-41f5-9643-2775e2bc3f46 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Start _get_guest_xml network_info=[{"id": "56c55251-4056-41f5-9643-2775e2bc3f46", "address": "fa:16:3e:ed:b0:63", "network": {"id": "ef0eee7c-6d8a-43f8-b1b0-584de56c03ad", "bridge": "br-int", "label": "tempest-TestStampPattern-741020257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "954dcaf44c2347b597c22547e7234855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c55251-40", "ovs_interfaceid": "56c55251-4056-41f5-9643-2775e2bc3f46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:26:55 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:26:55 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1439760497',display_name='tempest-TestStampPattern-server-1439760497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1439760497',id=49,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdI4LVSFCNR3lCoRwal10ZL6scdIAKC39QaHuvFuFnuwr/NWu42mzRscFZm983YeCIxnd4AhvNYO2SqFRb2qJ3zDi2GZAA4BpoLQqSXZ7AgQYEQbMB3T2D4Kl1fpdT5ig==',key_name='tempest-TestStampPattern-981271227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='954dcaf44c2347b597c22547e7234855',ramdisk_id='',reservation_id='r-ruqgqkdg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1951030330',owner_user_name='tempest-TestStampPattern-1951030330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:26:53Z,user_data=None,user_id='74f57f96a0f3453f91f8bb8554c4e53a',uuid=27f71b04-7113-416c-961e-0c1610c45715,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56c55251-4056-41f5-9643-2775e2bc3f46", "address": "fa:16:3e:ed:b0:63", "network": {"id": "ef0eee7c-6d8a-43f8-b1b0-584de56c03ad", "bridge": "br-int", "label": "tempest-TestStampPattern-741020257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "954dcaf44c2347b597c22547e7234855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c55251-40", "ovs_interfaceid": "56c55251-4056-41f5-9643-2775e2bc3f46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Converting VIF {"id": "56c55251-4056-41f5-9643-2775e2bc3f46", "address": "fa:16:3e:ed:b0:63", "network": {"id": "ef0eee7c-6d8a-43f8-b1b0-584de56c03ad", "bridge": "br-int", "label": "tempest-TestStampPattern-741020257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "954dcaf44c2347b597c22547e7234855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c55251-40", "ovs_interfaceid": "56c55251-4056-41f5-9643-2775e2bc3f46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b0:63,bridge_name='br-int',has_traffic_filtering=True,id=56c55251-4056-41f5-9643-2775e2bc3f46,network=Network(ef0eee7c-6d8a-43f8-b1b0-584de56c03ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c55251-40') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.objects.instance [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lazy-loading 'pci_devices' on Instance uuid 27f71b04-7113-416c-961e-0c1610c45715 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:26:55 user nova-compute[72504]:   <uuid>27f71b04-7113-416c-961e-0c1610c45715</uuid>
Aug 01 20:26:55 user nova-compute[72504]:   <name>instance-00000031</name>
Aug 01 20:26:55 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:26:55 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:26:55 user nova-compute[72504]:   <metadata>
Aug 01 20:26:55 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:26:55 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:26:55 user nova-compute[72504]:       <nova:name>tempest-TestStampPattern-server-1439760497</nova:name>
Aug 01 20:26:55 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:26:55</nova:creationTime>
Aug 01 20:26:55 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:26:55 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:26:55 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:26:55 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:26:55 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:26:55 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:26:55 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:26:55 user nova-compute[72504]:       <nova:owner>
Aug 01 20:26:55 user nova-compute[72504]:         <nova:user uuid="74f57f96a0f3453f91f8bb8554c4e53a">tempest-TestStampPattern-1951030330-project-member</nova:user>
Aug 01 20:26:55 user nova-compute[72504]:         <nova:project uuid="954dcaf44c2347b597c22547e7234855">tempest-TestStampPattern-1951030330</nova:project>
Aug 01 20:26:55 user nova-compute[72504]:       </nova:owner>
Aug 01 20:26:55 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 20:26:55 user nova-compute[72504]:       <nova:ports>
Aug 01 20:26:55 user nova-compute[72504]:         <nova:port uuid="56c55251-4056-41f5-9643-2775e2bc3f46">
Aug 01 20:26:55 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 20:26:55 user nova-compute[72504]:         </nova:port>
Aug 01 20:26:55 user nova-compute[72504]:       </nova:ports>
Aug 01 20:26:55 user nova-compute[72504]:     </nova:instance>
Aug 01 20:26:55 user nova-compute[72504]:   </metadata>
Aug 01 20:26:55 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:26:55 user nova-compute[72504]:     <system>
Aug 01 20:26:55 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:26:55 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:26:55 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:26:55 user nova-compute[72504]:       <entry name="serial">27f71b04-7113-416c-961e-0c1610c45715</entry>
Aug 01 20:26:55 user nova-compute[72504]:       <entry name="uuid">27f71b04-7113-416c-961e-0c1610c45715</entry>
Aug 01 20:26:55 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:26:55 user nova-compute[72504]:     </system>
Aug 01 20:26:55 user nova-compute[72504]:   </sysinfo>
Aug 01 20:26:55 user nova-compute[72504]:   <os>
Aug 01 20:26:55 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:26:55 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:26:55 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:26:55 user nova-compute[72504]:   </os>
Aug 01 20:26:55 user nova-compute[72504]:   <features>
Aug 01 20:26:55 user nova-compute[72504]:     <acpi/>
Aug 01 20:26:55 user nova-compute[72504]:     <apic/>
Aug 01 20:26:55 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:26:55 user nova-compute[72504]:   </features>
Aug 01 20:26:55 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:26:55 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:26:55 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:26:55 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:26:55 user nova-compute[72504]:   </clock>
Aug 01 20:26:55 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:26:55 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:26:55 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:26:55 user nova-compute[72504]:   </cpu>
Aug 01 20:26:55 user nova-compute[72504]:   <devices>
Aug 01 20:26:55 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 20:26:55 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 20:26:55 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk"/>
Aug 01 20:26:55 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:26:55 user nova-compute[72504]:     </disk>
Aug 01 20:26:55 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:26:55 user nova-compute[72504]:       <mac address="fa:16:3e:ed:b0:63"/>
Aug 01 20:26:55 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:26:55 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:26:55 user nova-compute[72504]:       <target dev="tap56c55251-40"/>
Aug 01 20:26:55 user nova-compute[72504]:     </interface>
Aug 01 20:26:55 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:26:55 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/console.log" append="off"/>
Aug 01 20:26:55 user nova-compute[72504]:     </serial>
Aug 01 20:26:55 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:26:55 user nova-compute[72504]:     <video>
Aug 01 20:26:55 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:26:55 user nova-compute[72504]:     </video>
Aug 01 20:26:55 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:26:55 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:26:55 user nova-compute[72504]:     </rng>
Aug 01 20:26:55 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:26:55 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:26:55 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:26:55 user nova-compute[72504]:     </memballoon>
Aug 01 20:26:55 user nova-compute[72504]:   </devices>
Aug 01 20:26:55 user nova-compute[72504]: </domain>
Aug 01 20:26:55 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1439760497',display_name='tempest-TestStampPattern-server-1439760497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1439760497',id=49,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdI4LVSFCNR3lCoRwal10ZL6scdIAKC39QaHuvFuFnuwr/NWu42mzRscFZm983YeCIxnd4AhvNYO2SqFRb2qJ3zDi2GZAA4BpoLQqSXZ7AgQYEQbMB3T2D4Kl1fpdT5ig==',key_name='tempest-TestStampPattern-981271227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='954dcaf44c2347b597c22547e7234855',ramdisk_id='',reservation_id='r-ruqgqkdg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1951030330',owner_user_name='tempest-TestStampPattern-1951030330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:26:53Z,user_data=None,user_id='74f57f96a0f3453f91f8bb8554c4e53a',uuid=27f71b04-7113-416c-961e-0c1610c45715,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56c55251-4056-41f5-9643-2775e2bc3f46", "address": "fa:16:3e:ed:b0:63", "network": {"id": "ef0eee7c-6d8a-43f8-b1b0-584de56c03ad", "bridge": "br-int", "label": "tempest-TestStampPattern-741020257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "954dcaf44c2347b597c22547e7234855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c55251-40", "ovs_interfaceid": "56c55251-4056-41f5-9643-2775e2bc3f46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Converting VIF {"id": "56c55251-4056-41f5-9643-2775e2bc3f46", "address": "fa:16:3e:ed:b0:63", "network": {"id": "ef0eee7c-6d8a-43f8-b1b0-584de56c03ad", "bridge": "br-int", "label": "tempest-TestStampPattern-741020257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "954dcaf44c2347b597c22547e7234855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c55251-40", "ovs_interfaceid": "56c55251-4056-41f5-9643-2775e2bc3f46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b0:63,bridge_name='br-int',has_traffic_filtering=True,id=56c55251-4056-41f5-9643-2775e2bc3f46,network=Network(ef0eee7c-6d8a-43f8-b1b0-584de56c03ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c55251-40') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG os_vif [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b0:63,bridge_name='br-int',has_traffic_filtering=True,id=56c55251-4056-41f5-9643-2775e2bc3f46,network=Network(ef0eee7c-6d8a-43f8-b1b0-584de56c03ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c55251-40') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56c55251-40, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap56c55251-40, col_values=(('external_ids', {'iface-id': '56c55251-4056-41f5-9643-2775e2bc3f46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:b0:63', 'vm-uuid': '27f71b04-7113-416c-961e-0c1610c45715'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:55 user nova-compute[72504]: INFO os_vif [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b0:63,bridge_name='br-int',has_traffic_filtering=True,id=56c55251-4056-41f5-9643-2775e2bc3f46,network=Network(ef0eee7c-6d8a-43f8-b1b0-584de56c03ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c55251-40')
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] No VIF found with MAC fa:16:3e:ed:b0:63, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.network.neutron [req-b20d0dcc-6aee-428b-ae83-8158dd6518f8 req-6582322f-20f0-4b43-b544-a3b42d7f480e service nova] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Updated VIF entry in instance network info cache for port 56c55251-4056-41f5-9643-2775e2bc3f46. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG nova.network.neutron [req-b20d0dcc-6aee-428b-ae83-8158dd6518f8 req-6582322f-20f0-4b43-b544-a3b42d7f480e service nova] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Updating instance_info_cache with network_info: [{"id": "56c55251-4056-41f5-9643-2775e2bc3f46", "address": "fa:16:3e:ed:b0:63", "network": {"id": "ef0eee7c-6d8a-43f8-b1b0-584de56c03ad", "bridge": "br-int", "label": "tempest-TestStampPattern-741020257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "954dcaf44c2347b597c22547e7234855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c55251-40", "ovs_interfaceid": "56c55251-4056-41f5-9643-2775e2bc3f46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:26:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b20d0dcc-6aee-428b-ae83-8158dd6518f8 req-6582322f-20f0-4b43-b544-a3b42d7f480e service nova] Releasing lock "refresh_cache-27f71b04-7113-416c-961e-0c1610c45715" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:26:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:56 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:56 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:26:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:26:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:26:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:26:56 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:26:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-1ff8083e-80d4-4cc1-bc66-4d25309d1e6c req-0c271854-2e87-4438-b7fb-15d89ade0106 service nova] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Received event network-vif-plugged-56c55251-4056-41f5-9643-2775e2bc3f46 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:26:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1ff8083e-80d4-4cc1-bc66-4d25309d1e6c req-0c271854-2e87-4438-b7fb-15d89ade0106 service nova] Acquiring lock "27f71b04-7113-416c-961e-0c1610c45715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:26:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1ff8083e-80d4-4cc1-bc66-4d25309d1e6c req-0c271854-2e87-4438-b7fb-15d89ade0106 service nova] Lock "27f71b04-7113-416c-961e-0c1610c45715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:26:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1ff8083e-80d4-4cc1-bc66-4d25309d1e6c req-0c271854-2e87-4438-b7fb-15d89ade0106 service nova] Lock "27f71b04-7113-416c-961e-0c1610c45715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:26:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-1ff8083e-80d4-4cc1-bc66-4d25309d1e6c req-0c271854-2e87-4438-b7fb-15d89ade0106 service nova] [instance: 27f71b04-7113-416c-961e-0c1610c45715] No waiting events found dispatching network-vif-plugged-56c55251-4056-41f5-9643-2775e2bc3f46 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:26:57 user nova-compute[72504]: WARNING nova.compute.manager [req-1ff8083e-80d4-4cc1-bc66-4d25309d1e6c req-0c271854-2e87-4438-b7fb-15d89ade0106 service nova] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Received unexpected event network-vif-plugged-56c55251-4056-41f5-9643-2775e2bc3f46 for instance with vm_state building and task_state spawning.
Aug 01 20:26:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:26:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:26:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:26:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:26:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:26:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:26:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:26:57 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:26:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:26:59 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690921618.9956315, 27f71b04-7113-416c-961e-0c1610c45715 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:26:59 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 27f71b04-7113-416c-961e-0c1610c45715] VM Resumed (Lifecycle Event)
Aug 01 20:26:59 user nova-compute[72504]: DEBUG nova.compute.manager [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:26:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:26:59 user nova-compute[72504]: DEBUG nova.compute.manager [req-b3f6a6cb-76ca-43eb-96db-b66169a6a283 req-455055cb-74ab-4958-bce9-b1d37aea3c89 service nova] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Received event network-vif-plugged-56c55251-4056-41f5-9643-2775e2bc3f46 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:26:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b3f6a6cb-76ca-43eb-96db-b66169a6a283 req-455055cb-74ab-4958-bce9-b1d37aea3c89 service nova] Acquiring lock "27f71b04-7113-416c-961e-0c1610c45715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:26:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b3f6a6cb-76ca-43eb-96db-b66169a6a283 req-455055cb-74ab-4958-bce9-b1d37aea3c89 service nova] Lock "27f71b04-7113-416c-961e-0c1610c45715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:26:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b3f6a6cb-76ca-43eb-96db-b66169a6a283 req-455055cb-74ab-4958-bce9-b1d37aea3c89 service nova] Lock "27f71b04-7113-416c-961e-0c1610c45715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:26:59 user nova-compute[72504]: DEBUG nova.compute.manager [req-b3f6a6cb-76ca-43eb-96db-b66169a6a283 req-455055cb-74ab-4958-bce9-b1d37aea3c89 service nova] [instance: 27f71b04-7113-416c-961e-0c1610c45715] No waiting events found dispatching network-vif-plugged-56c55251-4056-41f5-9643-2775e2bc3f46 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:26:59 user nova-compute[72504]: WARNING nova.compute.manager [req-b3f6a6cb-76ca-43eb-96db-b66169a6a283 req-455055cb-74ab-4958-bce9-b1d37aea3c89 service nova] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Received unexpected event network-vif-plugged-56c55251-4056-41f5-9643-2775e2bc3f46 for instance with vm_state building and task_state spawning.
Aug 01 20:26:59 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:26:59 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:26:59 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8739MB free_disk=25.101516723632812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:26:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:26:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:26:59 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:26:59 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Instance spawned successfully.
Aug 01 20:26:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 20:26:59 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:26:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:26:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:26:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:26:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:26:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:26:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:26:59 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 27f71b04-7113-416c-961e-0c1610c45715] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:26:59 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690921618.996375, 27f71b04-7113-416c-961e-0c1610c45715 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:26:59 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 27f71b04-7113-416c-961e-0c1610c45715] VM Started (Lifecycle Event)
Aug 01 20:26:59 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:26:59 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:26:59 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 27f71b04-7113-416c-961e-0c1610c45715] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:26:59 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 07379d7d-7337-4b7c-9a2a-69454c7f6bd0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:26:59 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 27f71b04-7113-416c-961e-0c1610c45715 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:26:59 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:26:59 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:26:59 user nova-compute[72504]: INFO nova.compute.manager [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Took 6.40 seconds to spawn the instance on the hypervisor.
Aug 01 20:26:59 user nova-compute[72504]: DEBUG nova.compute.manager [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:26:59 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:26:59 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:26:59 user nova-compute[72504]: INFO nova.compute.manager [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Took 7.36 seconds to build instance.
Aug 01 20:26:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a477efc5-46ae-44c7-857c-6c61a26f9b9a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "27f71b04-7113-416c-961e-0c1610c45715" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.454s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:26:59 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:26:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.329s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:26:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "27f71b04-7113-416c-961e-0c1610c45715" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.665s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:26:59 user nova-compute[72504]: INFO nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 27f71b04-7113-416c-961e-0c1610c45715] During sync_power_state the instance has a pending task (networking). Skip.
Aug 01 20:26:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "27f71b04-7113-416c-961e-0c1610c45715" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:27:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:27:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:27:03 user nova-compute[72504]: DEBUG nova.objects.instance [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lazy-loading 'flavor' on Instance uuid 07379d7d-7337-4b7c-9a2a-69454c7f6bd0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:27:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:27:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:27:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:27:04 user nova-compute[72504]: INFO nova.compute.manager [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Attaching volume ba5bb382-bce2-4e9b-8809-4f78caf341f3 to /dev/vdb
Aug 01 20:27:04 user nova-compute[72504]: DEBUG os_brick.utils [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:27:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:27:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:27:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8350c135-1d98-4577-bdce-9fc3733ec2c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:27:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:27:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:27:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6b5833-b751-4e27-b6c3-0c6f2654be28]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:27:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:27:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:27:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[992a2e84-a862-432f-b0ba-546e5a422f90]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:27:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b25c38-45fc-4236-8606-e314c545961a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:27:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:27:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:27:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:27:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:27:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:27:04 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:27:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[701a0e3a-7888-4e74-a4fd-2f714fb7d679]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:27:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:27:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:27:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:27:04 user nova-compute[72504]: DEBUG os_brick.utils [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:27:04 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Updating existing volume attachment record: e6e3ab99-b739-42ce-8c5f-71412d55aa64 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:27:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:10 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cfLeynbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:27:11 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:27:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:27:11 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:27:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:27:11 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fba0f1-09dc-4700-be19-2ac2a3a8a094]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:27:11 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe6140a-6ed8-43dc-be75-77f24c83b54d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3] added
Aug 01 20:27:11 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[57616f1a-0670-454f-9c3d-f9b5474bfab3]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4b5e77-c651-42ec-af57-54e50e242cc5]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cfLeynbd {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cfLeynbd" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b355068f-ff9f-427f-82f6-76a155dcb442]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cfLeynbd'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cce9e1-9d2e-41dd-8dad-3986e38f8149]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cdee7d-2754-409f-9ba0-ec1ba65d674e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 20:27:11 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 20:27:11 user nova-compute[72504]:  {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:27:11 user nova-compute[72504]: WARNING os_brick.initiator.connectors.iscsi [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 20:27:11 user nova-compute[72504]: 
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a232f81d-70c0-4994-af98-261be5162f5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3, portal: 172.16.0.220,3260]
Aug 01 20:27:11 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3, portal: 172.16.0.220,3260] successful.
Aug 01 20:27:11 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9754d670-dd9e-4a18-8348-24bff2d64ebe]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5900f004-92bc-4292-8d4f-eef4b85cea66]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 (non-flash)
Aug 01 20:27:11 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 (non-flash)
Aug 01 20:27:11 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2472c8a-ef7f-4965-afdb-06d770383939]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:27:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cfLeynbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:27:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:27:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23961636438363233', 'path': '/dev/sdb'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:27:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961636438363233', 'path': '/dev/sdb'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:27:12 user nova-compute[72504]: DEBUG nova.objects.instance [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lazy-loading 'flavor' on Instance uuid 07379d7d-7337-4b7c-9a2a-69454c7f6bd0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:27:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 20:27:12 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:27:12 user nova-compute[72504]:   <source dev="/dev/sdb"/>
Aug 01 20:27:12 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:27:12 user nova-compute[72504]:   <serial>ba5bb382-bce2-4e9b-8809-4f78caf341f3</serial>
Aug 01 20:27:12 user nova-compute[72504]: </disk>
Aug 01 20:27:12 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 20:27:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:27:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:27:13 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] No VIF found with MAC fa:16:3e:03:16:b6, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:27:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-5b1dfd1a-780b-4506-bf23-2e7f84125bd9 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.152s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:27:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:15 user nova-compute[72504]: DEBUG nova.compute.manager [req-27b76123-6fef-49d8-92ea-981d4ad6daec req-4a3f2ebe-065d-42cc-a98e-566175f42188 service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Received event network-changed-c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:27:15 user nova-compute[72504]: DEBUG nova.compute.manager [req-27b76123-6fef-49d8-92ea-981d4ad6daec req-4a3f2ebe-065d-42cc-a98e-566175f42188 service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Refreshing instance network info cache due to event network-changed-c9241d82-2fb0-4009-9861-d616702811ce. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:27:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-27b76123-6fef-49d8-92ea-981d4ad6daec req-4a3f2ebe-065d-42cc-a98e-566175f42188 service nova] Acquiring lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:27:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-27b76123-6fef-49d8-92ea-981d4ad6daec req-4a3f2ebe-065d-42cc-a98e-566175f42188 service nova] Acquired lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:27:15 user nova-compute[72504]: DEBUG nova.network.neutron [req-27b76123-6fef-49d8-92ea-981d4ad6daec req-4a3f2ebe-065d-42cc-a98e-566175f42188 service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Refreshing network info cache for port c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:27:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:16 user nova-compute[72504]: DEBUG nova.network.neutron [req-27b76123-6fef-49d8-92ea-981d4ad6daec req-4a3f2ebe-065d-42cc-a98e-566175f42188 service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Updated VIF entry in instance network info cache for port c9241d82-2fb0-4009-9861-d616702811ce. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:27:16 user nova-compute[72504]: DEBUG nova.network.neutron [req-27b76123-6fef-49d8-92ea-981d4ad6daec req-4a3f2ebe-065d-42cc-a98e-566175f42188 service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Updating instance_info_cache with network_info: [{"id": "c9241d82-2fb0-4009-9861-d616702811ce", "address": "fa:16:3e:03:16:b6", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9241d82-2f", "ovs_interfaceid": "c9241d82-2fb0-4009-9861-d616702811ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:27:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-27b76123-6fef-49d8-92ea-981d4ad6daec req-4a3f2ebe-065d-42cc-a98e-566175f42188 service nova] Releasing lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:27:17 user nova-compute[72504]: DEBUG nova.compute.manager [req-b6a8c5f5-84fc-4c4e-9317-96aae0bd4ceb req-dcdad01f-ad2d-4650-b263-1fa8e8108c39 service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Received event network-changed-c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:27:17 user nova-compute[72504]: DEBUG nova.compute.manager [req-b6a8c5f5-84fc-4c4e-9317-96aae0bd4ceb req-dcdad01f-ad2d-4650-b263-1fa8e8108c39 service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Refreshing instance network info cache due to event network-changed-c9241d82-2fb0-4009-9861-d616702811ce. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:27:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b6a8c5f5-84fc-4c4e-9317-96aae0bd4ceb req-dcdad01f-ad2d-4650-b263-1fa8e8108c39 service nova] Acquiring lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:27:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b6a8c5f5-84fc-4c4e-9317-96aae0bd4ceb req-dcdad01f-ad2d-4650-b263-1fa8e8108c39 service nova] Acquired lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:27:17 user nova-compute[72504]: DEBUG nova.network.neutron [req-b6a8c5f5-84fc-4c4e-9317-96aae0bd4ceb req-dcdad01f-ad2d-4650-b263-1fa8e8108c39 service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Refreshing network info cache for port c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:27:17 user nova-compute[72504]: DEBUG nova.network.neutron [req-b6a8c5f5-84fc-4c4e-9317-96aae0bd4ceb req-dcdad01f-ad2d-4650-b263-1fa8e8108c39 service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Updated VIF entry in instance network info cache for port c9241d82-2fb0-4009-9861-d616702811ce. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:27:17 user nova-compute[72504]: DEBUG nova.network.neutron [req-b6a8c5f5-84fc-4c4e-9317-96aae0bd4ceb req-dcdad01f-ad2d-4650-b263-1fa8e8108c39 service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Updating instance_info_cache with network_info: [{"id": "c9241d82-2fb0-4009-9861-d616702811ce", "address": "fa:16:3e:03:16:b6", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9241d82-2f", "ovs_interfaceid": "c9241d82-2fb0-4009-9861-d616702811ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:27:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7a6da3b1-a088-4de0-97b1-d6293018f22c tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:27:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7a6da3b1-a088-4de0-97b1-d6293018f22c tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:27:17 user nova-compute[72504]: INFO nova.compute.manager [None req-7a6da3b1-a088-4de0-97b1-d6293018f22c tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Rebooting instance
Aug 01 20:27:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b6a8c5f5-84fc-4c4e-9317-96aae0bd4ceb req-dcdad01f-ad2d-4650-b263-1fa8e8108c39 service nova] Releasing lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:27:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7a6da3b1-a088-4de0-97b1-d6293018f22c tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:27:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7a6da3b1-a088-4de0-97b1-d6293018f22c tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquired lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:27:18 user nova-compute[72504]: DEBUG nova.network.neutron [None req-7a6da3b1-a088-4de0-97b1-d6293018f22c tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:27:18 user nova-compute[72504]: DEBUG nova.network.neutron [None req-7a6da3b1-a088-4de0-97b1-d6293018f22c tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Updating instance_info_cache with network_info: [{"id": "c9241d82-2fb0-4009-9861-d616702811ce", "address": "fa:16:3e:03:16:b6", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9241d82-2f", "ovs_interfaceid": "c9241d82-2fb0-4009-9861-d616702811ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:27:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7a6da3b1-a088-4de0-97b1-d6293018f22c tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Releasing lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:27:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7a6da3b1-a088-4de0-97b1-d6293018f22c tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:27:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:20 user nova-compute[72504]: DEBUG nova.compute.manager [req-16f60363-7d17-4d23-a29c-a9696a880341 req-9aa960f5-ba46-4e5f-884e-316a04f863c4 service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Received event network-vif-unplugged-c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:27:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-16f60363-7d17-4d23-a29c-a9696a880341 req-9aa960f5-ba46-4e5f-884e-316a04f863c4 service nova] Acquiring lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:27:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-16f60363-7d17-4d23-a29c-a9696a880341 req-9aa960f5-ba46-4e5f-884e-316a04f863c4 service nova] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:27:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-16f60363-7d17-4d23-a29c-a9696a880341 req-9aa960f5-ba46-4e5f-884e-316a04f863c4 service nova] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:27:20 user nova-compute[72504]: DEBUG nova.compute.manager [req-16f60363-7d17-4d23-a29c-a9696a880341 req-9aa960f5-ba46-4e5f-884e-316a04f863c4 service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] No waiting events found dispatching network-vif-unplugged-c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:27:20 user nova-compute[72504]: WARNING nova.compute.manager [req-16f60363-7d17-4d23-a29c-a9696a880341 req-9aa960f5-ba46-4e5f-884e-316a04f863c4 service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Received unexpected event network-vif-unplugged-c9241d82-2fb0-4009-9861-d616702811ce for instance with vm_state active and task_state reboot_started.
Aug 01 20:27:21 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-7a6da3b1-a088-4de0-97b1-d6293018f22c tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Instance shutdown successfully.
Aug 01 20:27:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:23 user nova-compute[72504]: DEBUG nova.compute.manager [req-1fc4bdcc-c9c9-49d3-a9d0-b189eefe51f7 req-0920588d-bf8e-4b6f-8d14-45657eaf6ca8 service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Received event network-vif-plugged-c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:27:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1fc4bdcc-c9c9-49d3-a9d0-b189eefe51f7 req-0920588d-bf8e-4b6f-8d14-45657eaf6ca8 service nova] Acquiring lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:27:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1fc4bdcc-c9c9-49d3-a9d0-b189eefe51f7 req-0920588d-bf8e-4b6f-8d14-45657eaf6ca8 service nova] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:27:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1fc4bdcc-c9c9-49d3-a9d0-b189eefe51f7 req-0920588d-bf8e-4b6f-8d14-45657eaf6ca8 service nova] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:27:23 user nova-compute[72504]: DEBUG nova.compute.manager [req-1fc4bdcc-c9c9-49d3-a9d0-b189eefe51f7 req-0920588d-bf8e-4b6f-8d14-45657eaf6ca8 service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] No waiting events found dispatching network-vif-plugged-c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:27:23 user nova-compute[72504]: WARNING nova.compute.manager [req-1fc4bdcc-c9c9-49d3-a9d0-b189eefe51f7 req-0920588d-bf8e-4b6f-8d14-45657eaf6ca8 service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Received unexpected event network-vif-plugged-c9241d82-2fb0-4009-9861-d616702811ce for instance with vm_state active and task_state reboot_started.
Aug 01 20:27:23 user nova-compute[72504]: DEBUG nova.compute.manager [req-1fc4bdcc-c9c9-49d3-a9d0-b189eefe51f7 req-0920588d-bf8e-4b6f-8d14-45657eaf6ca8 service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Received event network-vif-plugged-c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:27:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1fc4bdcc-c9c9-49d3-a9d0-b189eefe51f7 req-0920588d-bf8e-4b6f-8d14-45657eaf6ca8 service nova] Acquiring lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:27:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1fc4bdcc-c9c9-49d3-a9d0-b189eefe51f7 req-0920588d-bf8e-4b6f-8d14-45657eaf6ca8 service nova] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:27:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1fc4bdcc-c9c9-49d3-a9d0-b189eefe51f7 req-0920588d-bf8e-4b6f-8d14-45657eaf6ca8 service nova] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:27:23 user nova-compute[72504]: DEBUG nova.compute.manager [req-1fc4bdcc-c9c9-49d3-a9d0-b189eefe51f7 req-0920588d-bf8e-4b6f-8d14-45657eaf6ca8 service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] No waiting events found dispatching network-vif-plugged-c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:27:23 user nova-compute[72504]: WARNING nova.compute.manager [req-1fc4bdcc-c9c9-49d3-a9d0-b189eefe51f7 req-0920588d-bf8e-4b6f-8d14-45657eaf6ca8 service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Received unexpected event network-vif-plugged-c9241d82-2fb0-4009-9861-d616702811ce for instance with vm_state active and task_state reboot_started.
Aug 01 20:27:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:24 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Removed pending event for 07379d7d-7337-4b7c-9a2a-69454c7f6bd0 due to event {{(pid=72504) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 20:27:24 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690921644.9710443, 07379d7d-7337-4b7c-9a2a-69454c7f6bd0 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:27:24 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] VM Resumed (Lifecycle Event)
Aug 01 20:27:24 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Instance running successfully.
Aug 01 20:27:24 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-7a6da3b1-a088-4de0-97b1-d6293018f22c tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Instance soft rebooted successfully.
Aug 01 20:27:24 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7a6da3b1-a088-4de0-97b1-d6293018f22c tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:27:24 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:27:24 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:27:25 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 01 20:27:25 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690921644.9746063, 07379d7d-7337-4b7c-9a2a-69454c7f6bd0 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:27:25 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] VM Started (Lifecycle Event)
Aug 01 20:27:25 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:27:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7a6da3b1-a088-4de0-97b1-d6293018f22c tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.082s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:27:25 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:27:25 user nova-compute[72504]: DEBUG nova.compute.manager [req-daea3f5f-1756-453e-a12e-120a9717e86f req-844b4554-2417-4490-ae64-fd05ffc6721f service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Received event network-vif-plugged-c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:27:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-daea3f5f-1756-453e-a12e-120a9717e86f req-844b4554-2417-4490-ae64-fd05ffc6721f service nova] Acquiring lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:27:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-daea3f5f-1756-453e-a12e-120a9717e86f req-844b4554-2417-4490-ae64-fd05ffc6721f service nova] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:27:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-daea3f5f-1756-453e-a12e-120a9717e86f req-844b4554-2417-4490-ae64-fd05ffc6721f service nova] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:27:25 user nova-compute[72504]: DEBUG nova.compute.manager [req-daea3f5f-1756-453e-a12e-120a9717e86f req-844b4554-2417-4490-ae64-fd05ffc6721f service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] No waiting events found dispatching network-vif-plugged-c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:27:25 user nova-compute[72504]: WARNING nova.compute.manager [req-daea3f5f-1756-453e-a12e-120a9717e86f req-844b4554-2417-4490-ae64-fd05ffc6721f service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Received unexpected event network-vif-plugged-c9241d82-2fb0-4009-9861-d616702811ce for instance with vm_state active and task_state None.
Aug 01 20:27:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:36 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:27:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:40 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:27:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:46 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:27:46 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:27:48 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:27:48 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:27:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:49 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:27:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:53 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:27:53 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:27:53 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 20:27:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:27:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:27:53 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:27:53 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lazy-loading 'info_cache' on Instance uuid 07379d7d-7337-4b7c-9a2a-69454c7f6bd0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:27:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:54 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Updating instance_info_cache with network_info: [{"id": "c9241d82-2fb0-4009-9861-d616702811ce", "address": "fa:16:3e:03:16:b6", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9241d82-2f", "ovs_interfaceid": "c9241d82-2fb0-4009-9861-d616702811ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:27:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:27:54 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:27:54 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:27:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:27:58 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:27:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:27:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:27:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:27:58 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:27:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:27:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:27:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:27:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:27:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:27:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:27:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:27:59 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:27:59 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:27:59 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:27:59 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:27:59 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8611MB free_disk=25.071170806884766GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:27:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:27:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:27:59 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 07379d7d-7337-4b7c-9a2a-69454c7f6bd0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:27:59 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 27f71b04-7113-416c-961e-0c1610c45715 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:27:59 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:27:59 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:28:00 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:28:00 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:28:00 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:28:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:28:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:28:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:28:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:28:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:28:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:28:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:28:01 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:28:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:28:10 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:28:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:28:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:28:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:28:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:28:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:28:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:28:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:28:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:28:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:28:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:28:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:28:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:28:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:28:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:28:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:28:35 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:28:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:28:42 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:28:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:28:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-01e5a7d5-6f86-4fd7-9a37-fac69ca4a4df req-12982df0-b4ac-4321-8d2c-d1f051e2f432 service nova] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Received event network-changed-56c55251-4056-41f5-9643-2775e2bc3f46 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:28:44 user nova-compute[72504]: DEBUG nova.compute.manager [req-01e5a7d5-6f86-4fd7-9a37-fac69ca4a4df req-12982df0-b4ac-4321-8d2c-d1f051e2f432 service nova] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Refreshing instance network info cache due to event network-changed-56c55251-4056-41f5-9643-2775e2bc3f46. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:28:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-01e5a7d5-6f86-4fd7-9a37-fac69ca4a4df req-12982df0-b4ac-4321-8d2c-d1f051e2f432 service nova] Acquiring lock "refresh_cache-27f71b04-7113-416c-961e-0c1610c45715" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:28:44 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-01e5a7d5-6f86-4fd7-9a37-fac69ca4a4df req-12982df0-b4ac-4321-8d2c-d1f051e2f432 service nova] Acquired lock "refresh_cache-27f71b04-7113-416c-961e-0c1610c45715" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:28:44 user nova-compute[72504]: DEBUG nova.network.neutron [req-01e5a7d5-6f86-4fd7-9a37-fac69ca4a4df req-12982df0-b4ac-4321-8d2c-d1f051e2f432 service nova] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Refreshing network info cache for port 56c55251-4056-41f5-9643-2775e2bc3f46 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:28:45 user nova-compute[72504]: DEBUG nova.network.neutron [req-01e5a7d5-6f86-4fd7-9a37-fac69ca4a4df req-12982df0-b4ac-4321-8d2c-d1f051e2f432 service nova] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Updated VIF entry in instance network info cache for port 56c55251-4056-41f5-9643-2775e2bc3f46. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:28:45 user nova-compute[72504]: DEBUG nova.network.neutron [req-01e5a7d5-6f86-4fd7-9a37-fac69ca4a4df req-12982df0-b4ac-4321-8d2c-d1f051e2f432 service nova] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Updating instance_info_cache with network_info: [{"id": "56c55251-4056-41f5-9643-2775e2bc3f46", "address": "fa:16:3e:ed:b0:63", "network": {"id": "ef0eee7c-6d8a-43f8-b1b0-584de56c03ad", "bridge": "br-int", "label": "tempest-TestStampPattern-741020257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "954dcaf44c2347b597c22547e7234855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c55251-40", "ovs_interfaceid": "56c55251-4056-41f5-9643-2775e2bc3f46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:28:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-01e5a7d5-6f86-4fd7-9a37-fac69ca4a4df req-12982df0-b4ac-4321-8d2c-d1f051e2f432 service nova] Releasing lock "refresh_cache-27f71b04-7113-416c-961e-0c1610c45715" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:28:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:28:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "27f71b04-7113-416c-961e-0c1610c45715" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:28:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "27f71b04-7113-416c-961e-0c1610c45715" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:28:46 user nova-compute[72504]: DEBUG nova.objects.instance [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lazy-loading 'flavor' on Instance uuid 27f71b04-7113-416c-961e-0c1610c45715 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:28:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "27f71b04-7113-416c-961e-0c1610c45715" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:28:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "27f71b04-7113-416c-961e-0c1610c45715" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:28:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "27f71b04-7113-416c-961e-0c1610c45715" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:28:46 user nova-compute[72504]: INFO nova.compute.manager [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Attaching volume 22bb4541-8f35-491d-a8bf-347d1b434863 to /dev/vdb
Aug 01 20:28:46 user nova-compute[72504]: DEBUG os_brick.utils [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:28:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:28:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:28:46 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8ad455-dea4-44b3-b1ba-7475f84a93f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:28:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:28:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:28:46 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[652c23f0-5758-45f1-bc50-84273ae17aff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:28:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:28:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:28:46 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54f08d4-c2e9-44fa-84b0-47bd45ec0215]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:28:46 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99cd43a-1e95-4c78-9bcc-ddf677cfe702]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:28:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:28:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:28:46 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:28:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:28:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:28:46 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:28:46 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[863e252b-c6bf-4856-ba39-a9c0e963df92]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:28:46 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:28:46 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:28:46 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:28:46 user nova-compute[72504]: DEBUG os_brick.utils [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:28:46 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Updating existing volume attachment record: 6eaf3535-2e04-4367-8c21-607e8a1997a5 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:28:46 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:28:48 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:28:48 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:28:48 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:28:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:28:49 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:28:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqXAxVti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:28:53 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:28:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:28:53 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:28:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:28:53 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a004b9-34e7-466b-ba92-01fdfc001648]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:28:53 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[998a3017-488b-4114-bff0-9d91a6bd9b21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863] added
Aug 01 20:28:53 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f1ce3b-c35a-430b-9387-fa9e361fc513]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.040s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9853d245-b20f-48b4-bc76-e7d42ef9b58c]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sqXAxVti {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sqXAxVti" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5cd429-2947-4d96-9e5a-1a844e62d6ff]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sqXAxVti'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce264b4-af75-49eb-b45a-fbd5aa67c6b6]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e17973a-43f2-49fd-bb7d-98196ba4b426]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 (non-flash)
Aug 01 20:28:53 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 (non-flash)
Aug 01 20:28:53 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1348dcc7-b1fe-47b5-af66-7d6b6f943905]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863, portal: 172.16.0.220,3260]
Aug 01 20:28:53 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863, portal: 172.16.0.220,3260] successful.
Aug 01 20:28:53 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecda1978-e796-46d1-bdba-7b9d133d0fe5]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b76caf-45bf-4054-a328-c538f75544db]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 (non-flash)
Aug 01 20:28:53 user nova-compute[72504]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863 (non-flash)
Aug 01 20:28:53 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 (non-flash)
Aug 01 20:28:53 user nova-compute[72504]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863 (non-flash)
Aug 01 20:28:53 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5f4419-f45d-4309-9171-b33b3a37a655]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqXAxVti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:28:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:28:54 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:28:54 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23234326331613239', 'path': '/dev/sdc'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:28:54 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234326331613239', 'path': '/dev/sdc'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:28:54 user nova-compute[72504]: DEBUG nova.objects.instance [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lazy-loading 'flavor' on Instance uuid 27f71b04-7113-416c-961e-0c1610c45715 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:28:54 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 20:28:54 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:28:54 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 20:28:54 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:28:54 user nova-compute[72504]:   <serial>22bb4541-8f35-491d-a8bf-347d1b434863</serial>
Aug 01 20:28:54 user nova-compute[72504]: </disk>
Aug 01 20:28:54 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 20:28:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:28:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:28:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] No VIF found with MAC fa:16:3e:ed:b0:63, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:28:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8d7ce940-0101-4fcb-9e76-12f26361d44b tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "27f71b04-7113-416c-961e-0c1610c45715" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.146s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:28:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:28:55 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:28:55 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:28:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-27f71b04-7113-416c-961e-0c1610c45715" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:28:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-27f71b04-7113-416c-961e-0c1610c45715" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:28:55 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:28:56 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Updating instance_info_cache with network_info: [{"id": "56c55251-4056-41f5-9643-2775e2bc3f46", "address": "fa:16:3e:ed:b0:63", "network": {"id": "ef0eee7c-6d8a-43f8-b1b0-584de56c03ad", "bridge": "br-int", "label": "tempest-TestStampPattern-741020257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "954dcaf44c2347b597c22547e7234855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c55251-40", "ovs_interfaceid": "56c55251-4056-41f5-9643-2775e2bc3f46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:28:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-27f71b04-7113-416c-961e-0c1610c45715" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:28:56 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:28:56 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:28:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "27f71b04-7113-416c-961e-0c1610c45715" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:28:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "27f71b04-7113-416c-961e-0c1610c45715" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:28:57 user nova-compute[72504]: INFO nova.compute.manager [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Detaching volume 22bb4541-8f35-491d-a8bf-347d1b434863
Aug 01 20:28:57 user nova-compute[72504]: INFO nova.virt.block_device [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Attempting to driver detach volume 22bb4541-8f35-491d-a8bf-347d1b434863 from mountpoint /dev/vdb
Aug 01 20:28:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Attempting to detach device vdb from instance 27f71b04-7113-416c-961e-0c1610c45715 from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 20:28:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:28:57 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:28:57 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 20:28:57 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:28:57 user nova-compute[72504]:   <serial>22bb4541-8f35-491d-a8bf-347d1b434863</serial>
Aug 01 20:28:57 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:28:57 user nova-compute[72504]: </disk>
Aug 01 20:28:57 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:28:57 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Successfully detached device vdb from instance 27f71b04-7113-416c-961e-0c1610c45715 from the persistent domain config.
Aug 01 20:28:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 27f71b04-7113-416c-961e-0c1610c45715 from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 20:28:57 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:28:57 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:28:57 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 20:28:57 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:28:57 user nova-compute[72504]:   <serial>22bb4541-8f35-491d-a8bf-347d1b434863</serial>
Aug 01 20:28:57 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:28:57 user nova-compute[72504]: </disk>
Aug 01 20:28:57 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690921738.1071339, 27f71b04-7113-416c-961e-0c1610c45715 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 27f71b04-7113-416c-961e-0c1610c45715 {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 20:28:58 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Successfully detached device vdb from instance 27f71b04-7113-416c-961e-0c1610c45715 from the live domain config.
Aug 01 20:28:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqXAxVti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:28:58 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:28:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ad8e09-e272-4736-8ce5-0975998a2582]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[972868df-1fd3-4032-938d-8ffb53fa92af]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 (non-flash)
Aug 01 20:28:58 user nova-compute[72504]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863 (non-flash)
Aug 01 20:28:58 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 (non-flash)
Aug 01 20:28:58 user nova-compute[72504]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863 (non-flash)
Aug 01 20:28:58 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3f45cadd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863'): ({'sdc'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Removing single pathed devices sdc {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e2f950-9be3-468c-a0ee-c34ae2f714be]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08b6b81-e9ea-4005-8a88-cf2cee690449]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Flushing IO for device /dev/sdc {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[81474f1a-5f00-4779-926f-3df418646dc1]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[685e601f-d819-4283-be20-8574c93034b5]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5874b4-5558-44d0-8904-26eea8aac7f1]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ff0e6a-47a3-454f-a986-3fe84336e58a]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863, portal: 172.16.0.220,3260]
Aug 01 20:28:58 user nova-compute[72504]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863, portal: 172.16.0.220,3260] successful.
Aug 01 20:28:58 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22bb4541-8f35-491d-a8bf-347d1b434863 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[58897317-c882-4a1b-9c0a-ba466c6e0701]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.250s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] <== disconnect_volume: return (251ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:28:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:28:59 user nova-compute[72504]: DEBUG nova.objects.instance [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lazy-loading 'flavor' on Instance uuid 27f71b04-7113-416c-961e-0c1610c45715 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:28:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-125f3c7f-81ac-4bd0-a232-678f96f95f0a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "27f71b04-7113-416c-961e-0c1610c45715" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.537s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:29:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:29:00 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:29:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:29:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:29:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:29:00 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:29:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:29:01 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:29:01 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:29:01 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:29:01 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:29:01 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:29:01 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:29:01 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:29:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:29:02 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:29:02 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:29:02 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8664MB free_disk=25.07000732421875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:29:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:29:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:29:02 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 07379d7d-7337-4b7c-9a2a-69454c7f6bd0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:29:02 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 27f71b04-7113-416c-961e-0c1610c45715 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:29:02 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:29:02 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:29:02 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:29:02 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:29:02 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:29:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.266s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:29:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:29:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:29:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:29:10 user nova-compute[72504]: DEBUG nova.compute.manager [req-6a10c410-af1c-4ee5-9e02-58076b26f950 req-84d89fef-bbe9-45dc-8819-6bf687189e86 service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Received event network-changed-c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:29:10 user nova-compute[72504]: DEBUG nova.compute.manager [req-6a10c410-af1c-4ee5-9e02-58076b26f950 req-84d89fef-bbe9-45dc-8819-6bf687189e86 service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Refreshing instance network info cache due to event network-changed-c9241d82-2fb0-4009-9861-d616702811ce. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:29:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6a10c410-af1c-4ee5-9e02-58076b26f950 req-84d89fef-bbe9-45dc-8819-6bf687189e86 service nova] Acquiring lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:29:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6a10c410-af1c-4ee5-9e02-58076b26f950 req-84d89fef-bbe9-45dc-8819-6bf687189e86 service nova] Acquired lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:29:10 user nova-compute[72504]: DEBUG nova.network.neutron [req-6a10c410-af1c-4ee5-9e02-58076b26f950 req-84d89fef-bbe9-45dc-8819-6bf687189e86 service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Refreshing network info cache for port c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:29:10 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:29:10 user nova-compute[72504]: DEBUG nova.network.neutron [req-6a10c410-af1c-4ee5-9e02-58076b26f950 req-84d89fef-bbe9-45dc-8819-6bf687189e86 service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Updated VIF entry in instance network info cache for port c9241d82-2fb0-4009-9861-d616702811ce. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:29:10 user nova-compute[72504]: DEBUG nova.network.neutron [req-6a10c410-af1c-4ee5-9e02-58076b26f950 req-84d89fef-bbe9-45dc-8819-6bf687189e86 service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Updating instance_info_cache with network_info: [{"id": "c9241d82-2fb0-4009-9861-d616702811ce", "address": "fa:16:3e:03:16:b6", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9241d82-2f", "ovs_interfaceid": "c9241d82-2fb0-4009-9861-d616702811ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:29:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6a10c410-af1c-4ee5-9e02-58076b26f950 req-84d89fef-bbe9-45dc-8819-6bf687189e86 service nova] Releasing lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:29:10 user nova-compute[72504]: DEBUG nova.compute.manager [req-79d26b72-7580-42b5-904e-6a438b03cfea req-463a4ef0-4033-49b9-b5f3-23d9d987431b service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Received event network-changed-c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:29:10 user nova-compute[72504]: DEBUG nova.compute.manager [req-79d26b72-7580-42b5-904e-6a438b03cfea req-463a4ef0-4033-49b9-b5f3-23d9d987431b service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Refreshing instance network info cache due to event network-changed-c9241d82-2fb0-4009-9861-d616702811ce. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:29:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-79d26b72-7580-42b5-904e-6a438b03cfea req-463a4ef0-4033-49b9-b5f3-23d9d987431b service nova] Acquiring lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:29:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-79d26b72-7580-42b5-904e-6a438b03cfea req-463a4ef0-4033-49b9-b5f3-23d9d987431b service nova] Acquired lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:29:10 user nova-compute[72504]: DEBUG nova.network.neutron [req-79d26b72-7580-42b5-904e-6a438b03cfea req-463a4ef0-4033-49b9-b5f3-23d9d987431b service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Refreshing network info cache for port c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:29:11 user nova-compute[72504]: INFO nova.compute.manager [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Detaching volume ba5bb382-bce2-4e9b-8809-4f78caf341f3
Aug 01 20:29:11 user nova-compute[72504]: INFO nova.virt.block_device [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Attempting to driver detach volume ba5bb382-bce2-4e9b-8809-4f78caf341f3 from mountpoint /dev/vdb
Aug 01 20:29:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Attempting to detach device vdb from instance 07379d7d-7337-4b7c-9a2a-69454c7f6bd0 from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:29:11 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:29:11 user nova-compute[72504]:   <source dev="/dev/sdb"/>
Aug 01 20:29:11 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:29:11 user nova-compute[72504]:   <serial>ba5bb382-bce2-4e9b-8809-4f78caf341f3</serial>
Aug 01 20:29:11 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:29:11 user nova-compute[72504]: </disk>
Aug 01 20:29:11 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:29:11 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Successfully detached device vdb from instance 07379d7d-7337-4b7c-9a2a-69454c7f6bd0 from the persistent domain config.
Aug 01 20:29:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 07379d7d-7337-4b7c-9a2a-69454c7f6bd0 from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:29:11 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:29:11 user nova-compute[72504]:   <source dev="/dev/sdb"/>
Aug 01 20:29:11 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:29:11 user nova-compute[72504]:   <serial>ba5bb382-bce2-4e9b-8809-4f78caf341f3</serial>
Aug 01 20:29:11 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:29:11 user nova-compute[72504]: </disk>
Aug 01 20:29:11 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG nova.network.neutron [req-79d26b72-7580-42b5-904e-6a438b03cfea req-463a4ef0-4033-49b9-b5f3-23d9d987431b service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Updated VIF entry in instance network info cache for port c9241d82-2fb0-4009-9861-d616702811ce. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG nova.network.neutron [req-79d26b72-7580-42b5-904e-6a438b03cfea req-463a4ef0-4033-49b9-b5f3-23d9d987431b service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Updating instance_info_cache with network_info: [{"id": "c9241d82-2fb0-4009-9861-d616702811ce", "address": "fa:16:3e:03:16:b6", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9241d82-2f", "ovs_interfaceid": "c9241d82-2fb0-4009-9861-d616702811ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-79d26b72-7580-42b5-904e-6a438b03cfea req-463a4ef0-4033-49b9-b5f3-23d9d987431b service nova] Releasing lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690921751.5554986, 07379d7d-7337-4b7c-9a2a-69454c7f6bd0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 07379d7d-7337-4b7c-9a2a-69454c7f6bd0 {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 20:29:11 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Successfully detached device vdb from instance 07379d7d-7337-4b7c-9a2a-69454c7f6bd0 from the live domain config.
Aug 01 20:29:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cfLeynbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:29:11 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:29:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49b53a3-638d-42ce-aebe-5b7589457092]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8a2f5d-42ac-4cdc-b7fe-17b3b6737969]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 (non-flash)
Aug 01 20:29:11 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 (non-flash)
Aug 01 20:29:11 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff41437a830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3'): ({'sdb'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Removing single pathed devices sdb {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6307beaf-f806-48dd-9858-58c7828d0476]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9b40bd-9106-4680-95fd-53a2410005d1]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Flushing IO for device /dev/sdb {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afa0dbf-8239-4f06-81f2-f9824b18f8f5]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b35c86-cd3c-41a7-b73f-18cc0bee6f3c]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6faf817d-5fbf-4e9e-b3f4-1a8ad530a574]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba6be55-4c60-4e90-a830-90e040ab4a55]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3, portal: 172.16.0.220,3260]
Aug 01 20:29:11 user nova-compute[72504]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3, portal: 172.16.0.220,3260] successful.
Aug 01 20:29:11 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5bb382-bce2-4e9b-8809-4f78caf341f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[770b8143-c7a6-4242-a54f-71f0ccaba02a]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.251s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] <== disconnect_volume: return (252ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:29:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:29:12 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lazy-loading 'flavor' on Instance uuid 07379d7d-7337-4b7c-9a2a-69454c7f6bd0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:29:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e7758ac6-000c-41b3-aa68-b8761f831e0f tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.544s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:29:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:29:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:29:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:29:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:29:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:29:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:29:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:29:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:29:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:29:25 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:29:30 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:29:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:29:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:29:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:29:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:29:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:29:35 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:29:39 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:29:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:29:44 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:29:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:29:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:29:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:29:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:29:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:29:45 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:29:47 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:29:49 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:29:49 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:29:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:29:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:29:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:29:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:29:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:29:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:29:50 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:29:51 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:29:54 user nova-compute[72504]: DEBUG nova.compute.manager [None req-a1b1116a-839e-459d-aa2f-fa88480e1d5a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:29:54 user nova-compute[72504]: INFO nova.compute.manager [None req-a1b1116a-839e-459d-aa2f-fa88480e1d5a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] instance snapshotting
Aug 01 20:29:54 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-a1b1116a-839e-459d-aa2f-fa88480e1d5a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Beginning live snapshot process
Aug 01 20:29:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a1b1116a-839e-459d-aa2f-fa88480e1d5a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json -f qcow2 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:29:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a1b1116a-839e-459d-aa2f-fa88480e1d5a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json -f qcow2" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:29:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a1b1116a-839e-459d-aa2f-fa88480e1d5a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json -f qcow2 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:29:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a1b1116a-839e-459d-aa2f-fa88480e1d5a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json -f qcow2" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:29:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a1b1116a-839e-459d-aa2f-fa88480e1d5a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:29:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a1b1116a-839e-459d-aa2f-fa88480e1d5a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:29:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a1b1116a-839e-459d-aa2f-fa88480e1d5a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpe5nr4pg9/df1a6bf813884c6e81cd25738a65d9f4.delta 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:29:54 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a1b1116a-839e-459d-aa2f-fa88480e1d5a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpe5nr4pg9/df1a6bf813884c6e81cd25738a65d9f4.delta 1073741824" returned: 0 in 0.050s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:29:54 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-a1b1116a-839e-459d-aa2f-fa88480e1d5a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 20:29:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-a1b1116a-839e-459d-aa2f-fa88480e1d5a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] COPY block job progress, current cursor: 65536 final cursor: 75563008 {{(pid=72504) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 20:29:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:29:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-a1b1116a-839e-459d-aa2f-fa88480e1d5a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72504) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 20:29:55 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-a1b1116a-839e-459d-aa2f-fa88480e1d5a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 20:29:56 user nova-compute[72504]: DEBUG nova.privsep.utils [None req-a1b1116a-839e-459d-aa2f-fa88480e1d5a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72504) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 20:29:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a1b1116a-839e-459d-aa2f-fa88480e1d5a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpe5nr4pg9/df1a6bf813884c6e81cd25738a65d9f4.delta /opt/stack/data/nova/instances/snapshots/tmpe5nr4pg9/df1a6bf813884c6e81cd25738a65d9f4 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:29:56 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a1b1116a-839e-459d-aa2f-fa88480e1d5a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpe5nr4pg9/df1a6bf813884c6e81cd25738a65d9f4.delta /opt/stack/data/nova/instances/snapshots/tmpe5nr4pg9/df1a6bf813884c6e81cd25738a65d9f4" returned: 0 in 0.510s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:29:56 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-a1b1116a-839e-459d-aa2f-fa88480e1d5a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Snapshot extracted, beginning image upload
Aug 01 20:29:57 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:29:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:29:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 20:29:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:29:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:29:57 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:29:57 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lazy-loading 'info_cache' on Instance uuid 07379d7d-7337-4b7c-9a2a-69454c7f6bd0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:29:58 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Updating instance_info_cache with network_info: [{"id": "c9241d82-2fb0-4009-9861-d616702811ce", "address": "fa:16:3e:03:16:b6", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9241d82-2f", "ovs_interfaceid": "c9241d82-2fb0-4009-9861-d616702811ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:29:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-07379d7d-7337-4b7c-9a2a-69454c7f6bd0" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:29:58 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:29:58 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:29:58 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-a1b1116a-839e-459d-aa2f-fa88480e1d5a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Snapshot image upload complete
Aug 01 20:29:58 user nova-compute[72504]: INFO nova.compute.manager [None req-a1b1116a-839e-459d-aa2f-fa88480e1d5a tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Took 4.74 seconds to snapshot the instance on the hypervisor.
Aug 01 20:30:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:30:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:30:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:30:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:30:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "762fcd08-984b-4341-9e6a-b098e2d14899" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:30:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "762fcd08-984b-4341-9e6a-b098e2d14899" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:30:00 user nova-compute[72504]: DEBUG nova.compute.manager [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 20:30:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:30:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:30:00 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:30:00 user nova-compute[72504]: INFO nova.compute.claims [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Claim successful on node user
Aug 01 20:30:01 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:30:01 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:30:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.255s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:30:01 user nova-compute[72504]: DEBUG nova.compute.manager [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 20:30:01 user nova-compute[72504]: DEBUG nova.compute.manager [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 20:30:01 user nova-compute[72504]: DEBUG nova.network.neutron [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 20:30:01 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 20:30:01 user nova-compute[72504]: DEBUG nova.compute.manager [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 20:30:01 user nova-compute[72504]: DEBUG nova.policy [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74f57f96a0f3453f91f8bb8554c4e53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954dcaf44c2347b597c22547e7234855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 20:30:01 user nova-compute[72504]: DEBUG nova.compute.manager [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 20:30:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:30:01 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Creating image(s)
Aug 01 20:30:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "/opt/stack/data/nova/instances/762fcd08-984b-4341-9e6a-b098e2d14899/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:30:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "/opt/stack/data/nova/instances/762fcd08-984b-4341-9e6a-b098e2d14899/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:30:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "/opt/stack/data/nova/instances/762fcd08-984b-4341-9e6a-b098e2d14899/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:30:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "0497575ef4cdeae32b2e66efe8f5e021dcf03376" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:30:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "0497575ef4cdeae32b2e66efe8f5e021dcf03376" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:30:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0497575ef4cdeae32b2e66efe8f5e021dcf03376.part --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:30:02 user nova-compute[72504]: DEBUG nova.network.neutron [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Successfully created port: 27c2be2d-a79f-40f8-b80e-6f83b3ca75c6 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 20:30:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0497575ef4cdeae32b2e66efe8f5e021dcf03376.part --force-share --output=json" returned: 0 in 0.175s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:30:02 user nova-compute[72504]: DEBUG nova.virt.images [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] 453ad211-93d4-49d2-8d60-c5298f1d0612 was qcow2, converting to raw {{(pid=72504) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 20:30:02 user nova-compute[72504]: DEBUG nova.privsep.utils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72504) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 20:30:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0497575ef4cdeae32b2e66efe8f5e021dcf03376.part /opt/stack/data/nova/instances/_base/0497575ef4cdeae32b2e66efe8f5e021dcf03376.converted {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:30:02 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:30:02 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:30:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:30:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:30:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:30:02 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:30:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0497575ef4cdeae32b2e66efe8f5e021dcf03376.part /opt/stack/data/nova/instances/_base/0497575ef4cdeae32b2e66efe8f5e021dcf03376.converted" returned: 0 in 0.384s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:30:02 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0497575ef4cdeae32b2e66efe8f5e021dcf03376.converted --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0497575ef4cdeae32b2e66efe8f5e021dcf03376.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "0497575ef4cdeae32b2e66efe8f5e021dcf03376" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.651s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0497575ef4cdeae32b2e66efe8f5e021dcf03376 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0497575ef4cdeae32b2e66efe8f5e021dcf03376 --force-share --output=json" returned: 0 in 0.160s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "0497575ef4cdeae32b2e66efe8f5e021dcf03376" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "0497575ef4cdeae32b2e66efe8f5e021dcf03376" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0497575ef4cdeae32b2e66efe8f5e021dcf03376 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0497575ef4cdeae32b2e66efe8f5e021dcf03376 --force-share --output=json" returned: 0 in 0.176s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0497575ef4cdeae32b2e66efe8f5e021dcf03376,backing_fmt=raw /opt/stack/data/nova/instances/762fcd08-984b-4341-9e6a-b098e2d14899/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0497575ef4cdeae32b2e66efe8f5e021dcf03376,backing_fmt=raw /opt/stack/data/nova/instances/762fcd08-984b-4341-9e6a-b098e2d14899/disk 1073741824" returned: 0 in 0.065s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "0497575ef4cdeae32b2e66efe8f5e021dcf03376" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0497575ef4cdeae32b2e66efe8f5e021dcf03376 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG nova.network.neutron [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Successfully updated port: 27c2be2d-a79f-40f8-b80e-6f83b3ca75c6 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0497575ef4cdeae32b2e66efe8f5e021dcf03376 --force-share --output=json" returned: 0 in 0.181s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG nova.objects.instance [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lazy-loading 'migration_context' on Instance uuid 762fcd08-984b-4341-9e6a-b098e2d14899 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-ae788109-9daf-439b-bd88-211e836a9aed req-2b5c9ae0-36b2-4fb7-99a8-bdcae16b6235 service nova] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Received event network-changed-27c2be2d-a79f-40f8-b80e-6f83b3ca75c6 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-ae788109-9daf-439b-bd88-211e836a9aed req-2b5c9ae0-36b2-4fb7-99a8-bdcae16b6235 service nova] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Refreshing instance network info cache due to event network-changed-27c2be2d-a79f-40f8-b80e-6f83b3ca75c6. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ae788109-9daf-439b-bd88-211e836a9aed req-2b5c9ae0-36b2-4fb7-99a8-bdcae16b6235 service nova] Acquiring lock "refresh_cache-762fcd08-984b-4341-9e6a-b098e2d14899" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ae788109-9daf-439b-bd88-211e836a9aed req-2b5c9ae0-36b2-4fb7-99a8-bdcae16b6235 service nova] Acquired lock "refresh_cache-762fcd08-984b-4341-9e6a-b098e2d14899" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG nova.network.neutron [req-ae788109-9daf-439b-bd88-211e836a9aed req-2b5c9ae0-36b2-4fb7-99a8-bdcae16b6235 service nova] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Refreshing network info cache for port 27c2be2d-a79f-40f8-b80e-6f83b3ca75c6 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "refresh_cache-762fcd08-984b-4341-9e6a-b098e2d14899" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Ensure instance console log exists: /opt/stack/data/nova/instances/762fcd08-984b-4341-9e6a-b098e2d14899/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG nova.network.neutron [req-ae788109-9daf-439b-bd88-211e836a9aed req-2b5c9ae0-36b2-4fb7-99a8-bdcae16b6235 service nova] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:30:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:30:04 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:30:04 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8672MB free_disk=24.876834869384766GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.network.neutron [req-ae788109-9daf-439b-bd88-211e836a9aed req-2b5c9ae0-36b2-4fb7-99a8-bdcae16b6235 service nova] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 07379d7d-7337-4b7c-9a2a-69454c7f6bd0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 27f71b04-7113-416c-961e-0c1610c45715 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 762fcd08-984b-4341-9e6a-b098e2d14899 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ae788109-9daf-439b-bd88-211e836a9aed req-2b5c9ae0-36b2-4fb7-99a8-bdcae16b6235 service nova] Releasing lock "refresh_cache-762fcd08-984b-4341-9e6a-b098e2d14899" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquired lock "refresh_cache-762fcd08-984b-4341-9e6a-b098e2d14899" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.network.neutron [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.network.neutron [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.283s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.network.neutron [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Updating instance_info_cache with network_info: [{"id": "27c2be2d-a79f-40f8-b80e-6f83b3ca75c6", "address": "fa:16:3e:74:ab:e6", "network": {"id": "ef0eee7c-6d8a-43f8-b1b0-584de56c03ad", "bridge": "br-int", "label": "tempest-TestStampPattern-741020257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "954dcaf44c2347b597c22547e7234855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c2be2d-a7", "ovs_interfaceid": "27c2be2d-a79f-40f8-b80e-6f83b3ca75c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Releasing lock "refresh_cache-762fcd08-984b-4341-9e6a-b098e2d14899" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.compute.manager [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Instance network_info: |[{"id": "27c2be2d-a79f-40f8-b80e-6f83b3ca75c6", "address": "fa:16:3e:74:ab:e6", "network": {"id": "ef0eee7c-6d8a-43f8-b1b0-584de56c03ad", "bridge": "br-int", "label": "tempest-TestStampPattern-741020257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "954dcaf44c2347b597c22547e7234855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c2be2d-a7", "ovs_interfaceid": "27c2be2d-a79f-40f8-b80e-6f83b3ca75c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Start _get_guest_xml network_info=[{"id": "27c2be2d-a79f-40f8-b80e-6f83b3ca75c6", "address": "fa:16:3e:74:ab:e6", "network": {"id": "ef0eee7c-6d8a-43f8-b1b0-584de56c03ad", "bridge": "br-int", "label": "tempest-TestStampPattern-741020257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "954dcaf44c2347b597c22547e7234855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c2be2d-a7", "ovs_interfaceid": "27c2be2d-a79f-40f8-b80e-6f83b3ca75c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='68fda970fe424c9b27bf8d02ac73c223',container_format='bare',created_at=2023-08-01T20:29:54Z,direct_url=<?>,disk_format='qcow2',id=453ad211-93d4-49d2-8d60-c5298f1d0612,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-765012114',owner='954dcaf44c2347b597c22547e7234855',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T20:29:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '453ad211-93d4-49d2-8d60-c5298f1d0612'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:30:04 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:30:04 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='68fda970fe424c9b27bf8d02ac73c223',container_format='bare',created_at=2023-08-01T20:29:54Z,direct_url=<?>,disk_format='qcow2',id=453ad211-93d4-49d2-8d60-c5298f1d0612,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-765012114',owner='954dcaf44c2347b597c22547e7234855',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T20:29:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:30:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1286848685',display_name='tempest-TestStampPattern-server-1286848685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1286848685',id=50,image_ref='453ad211-93d4-49d2-8d60-c5298f1d0612',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdI4LVSFCNR3lCoRwal10ZL6scdIAKC39QaHuvFuFnuwr/NWu42mzRscFZm983YeCIxnd4AhvNYO2SqFRb2qJ3zDi2GZAA4BpoLQqSXZ7AgQYEQbMB3T2D4Kl1fpdT5ig==',key_name='tempest-TestStampPattern-981271227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='954dcaf44c2347b597c22547e7234855',ramdisk_id='',reservation_id='r-bhrt1f74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='27f71b04-7113-416c-961e-0c1610c45715',image_min_disk='1',image_min_ram='0',image_owner_id='954dcaf44c2347b597c22547e7234855',image_owner_project_name='tempest-TestStampPattern-1951030330',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1951030330-project-member',image_user_id='74f57f96a0f3453f91f8bb8554c4e53a',network_allocated='True',owner_project_name='tempest-TestStampPattern-1951030330',owner_user_name='tempest-TestStampPattern-1951030330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:30:01Z,user_data=None,user_id='74f57f96a0f3453f91f8bb8554c4e53a',uuid=762fcd08-984b-4341-9e6a-b098e2d14899,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27c2be2d-a79f-40f8-b80e-6f83b3ca75c6", "address": "fa:16:3e:74:ab:e6", "network": {"id": "ef0eee7c-6d8a-43f8-b1b0-584de56c03ad", "bridge": "br-int", "label": "tempest-TestStampPattern-741020257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "954dcaf44c2347b597c22547e7234855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c2be2d-a7", "ovs_interfaceid": "27c2be2d-a79f-40f8-b80e-6f83b3ca75c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Converting VIF {"id": "27c2be2d-a79f-40f8-b80e-6f83b3ca75c6", "address": "fa:16:3e:74:ab:e6", "network": {"id": "ef0eee7c-6d8a-43f8-b1b0-584de56c03ad", "bridge": "br-int", "label": "tempest-TestStampPattern-741020257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "954dcaf44c2347b597c22547e7234855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c2be2d-a7", "ovs_interfaceid": "27c2be2d-a79f-40f8-b80e-6f83b3ca75c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:ab:e6,bridge_name='br-int',has_traffic_filtering=True,id=27c2be2d-a79f-40f8-b80e-6f83b3ca75c6,network=Network(ef0eee7c-6d8a-43f8-b1b0-584de56c03ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27c2be2d-a7') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.objects.instance [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lazy-loading 'pci_devices' on Instance uuid 762fcd08-984b-4341-9e6a-b098e2d14899 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:30:04 user nova-compute[72504]:   <uuid>762fcd08-984b-4341-9e6a-b098e2d14899</uuid>
Aug 01 20:30:04 user nova-compute[72504]:   <name>instance-00000032</name>
Aug 01 20:30:04 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:30:04 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:30:04 user nova-compute[72504]:   <metadata>
Aug 01 20:30:04 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:30:04 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:30:04 user nova-compute[72504]:       <nova:name>tempest-TestStampPattern-server-1286848685</nova:name>
Aug 01 20:30:04 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:30:04</nova:creationTime>
Aug 01 20:30:04 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:30:04 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:30:04 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:30:04 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:30:04 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:30:04 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:30:04 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:30:04 user nova-compute[72504]:       <nova:owner>
Aug 01 20:30:04 user nova-compute[72504]:         <nova:user uuid="74f57f96a0f3453f91f8bb8554c4e53a">tempest-TestStampPattern-1951030330-project-member</nova:user>
Aug 01 20:30:04 user nova-compute[72504]:         <nova:project uuid="954dcaf44c2347b597c22547e7234855">tempest-TestStampPattern-1951030330</nova:project>
Aug 01 20:30:04 user nova-compute[72504]:       </nova:owner>
Aug 01 20:30:04 user nova-compute[72504]:       <nova:root type="image" uuid="453ad211-93d4-49d2-8d60-c5298f1d0612"/>
Aug 01 20:30:04 user nova-compute[72504]:       <nova:ports>
Aug 01 20:30:04 user nova-compute[72504]:         <nova:port uuid="27c2be2d-a79f-40f8-b80e-6f83b3ca75c6">
Aug 01 20:30:04 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 20:30:04 user nova-compute[72504]:         </nova:port>
Aug 01 20:30:04 user nova-compute[72504]:       </nova:ports>
Aug 01 20:30:04 user nova-compute[72504]:     </nova:instance>
Aug 01 20:30:04 user nova-compute[72504]:   </metadata>
Aug 01 20:30:04 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:30:04 user nova-compute[72504]:     <system>
Aug 01 20:30:04 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:30:04 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:30:04 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:30:04 user nova-compute[72504]:       <entry name="serial">762fcd08-984b-4341-9e6a-b098e2d14899</entry>
Aug 01 20:30:04 user nova-compute[72504]:       <entry name="uuid">762fcd08-984b-4341-9e6a-b098e2d14899</entry>
Aug 01 20:30:04 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:30:04 user nova-compute[72504]:     </system>
Aug 01 20:30:04 user nova-compute[72504]:   </sysinfo>
Aug 01 20:30:04 user nova-compute[72504]:   <os>
Aug 01 20:30:04 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:30:04 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:30:04 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:30:04 user nova-compute[72504]:   </os>
Aug 01 20:30:04 user nova-compute[72504]:   <features>
Aug 01 20:30:04 user nova-compute[72504]:     <acpi/>
Aug 01 20:30:04 user nova-compute[72504]:     <apic/>
Aug 01 20:30:04 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:30:04 user nova-compute[72504]:   </features>
Aug 01 20:30:04 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:30:04 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:30:04 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:30:04 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:30:04 user nova-compute[72504]:   </clock>
Aug 01 20:30:04 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:30:04 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:30:04 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:30:04 user nova-compute[72504]:   </cpu>
Aug 01 20:30:04 user nova-compute[72504]:   <devices>
Aug 01 20:30:04 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 20:30:04 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 20:30:04 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/762fcd08-984b-4341-9e6a-b098e2d14899/disk"/>
Aug 01 20:30:04 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:30:04 user nova-compute[72504]:     </disk>
Aug 01 20:30:04 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:30:04 user nova-compute[72504]:       <mac address="fa:16:3e:74:ab:e6"/>
Aug 01 20:30:04 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:30:04 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:30:04 user nova-compute[72504]:       <target dev="tap27c2be2d-a7"/>
Aug 01 20:30:04 user nova-compute[72504]:     </interface>
Aug 01 20:30:04 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:30:04 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/762fcd08-984b-4341-9e6a-b098e2d14899/console.log" append="off"/>
Aug 01 20:30:04 user nova-compute[72504]:     </serial>
Aug 01 20:30:04 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:30:04 user nova-compute[72504]:     <video>
Aug 01 20:30:04 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:30:04 user nova-compute[72504]:     </video>
Aug 01 20:30:04 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:30:04 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:30:04 user nova-compute[72504]:     </rng>
Aug 01 20:30:04 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:30:04 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:30:04 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:30:04 user nova-compute[72504]:     </memballoon>
Aug 01 20:30:04 user nova-compute[72504]:   </devices>
Aug 01 20:30:04 user nova-compute[72504]: </domain>
Aug 01 20:30:04 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:30:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1286848685',display_name='tempest-TestStampPattern-server-1286848685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1286848685',id=50,image_ref='453ad211-93d4-49d2-8d60-c5298f1d0612',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdI4LVSFCNR3lCoRwal10ZL6scdIAKC39QaHuvFuFnuwr/NWu42mzRscFZm983YeCIxnd4AhvNYO2SqFRb2qJ3zDi2GZAA4BpoLQqSXZ7AgQYEQbMB3T2D4Kl1fpdT5ig==',key_name='tempest-TestStampPattern-981271227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='954dcaf44c2347b597c22547e7234855',ramdisk_id='',reservation_id='r-bhrt1f74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='27f71b04-7113-416c-961e-0c1610c45715',image_min_disk='1',image_min_ram='0',image_owner_id='954dcaf44c2347b597c22547e7234855',image_owner_project_name='tempest-TestStampPattern-1951030330',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1951030330-project-member',image_user_id='74f57f96a0f3453f91f8bb8554c4e53a',network_allocated='True',owner_project_name='tempest-TestStampPattern-1951030330',owner_user_name='tempest-TestStampPattern-1951030330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:30:01Z,user_data=None,user_id='74f57f96a0f3453f91f8bb8554c4e53a',uuid=762fcd08-984b-4341-9e6a-b098e2d14899,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27c2be2d-a79f-40f8-b80e-6f83b3ca75c6", "address": "fa:16:3e:74:ab:e6", "network": {"id": "ef0eee7c-6d8a-43f8-b1b0-584de56c03ad", "bridge": "br-int", "label": "tempest-TestStampPattern-741020257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "954dcaf44c2347b597c22547e7234855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c2be2d-a7", "ovs_interfaceid": "27c2be2d-a79f-40f8-b80e-6f83b3ca75c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Converting VIF {"id": "27c2be2d-a79f-40f8-b80e-6f83b3ca75c6", "address": "fa:16:3e:74:ab:e6", "network": {"id": "ef0eee7c-6d8a-43f8-b1b0-584de56c03ad", "bridge": "br-int", "label": "tempest-TestStampPattern-741020257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "954dcaf44c2347b597c22547e7234855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c2be2d-a7", "ovs_interfaceid": "27c2be2d-a79f-40f8-b80e-6f83b3ca75c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:ab:e6,bridge_name='br-int',has_traffic_filtering=True,id=27c2be2d-a79f-40f8-b80e-6f83b3ca75c6,network=Network(ef0eee7c-6d8a-43f8-b1b0-584de56c03ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27c2be2d-a7') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG os_vif [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:ab:e6,bridge_name='br-int',has_traffic_filtering=True,id=27c2be2d-a79f-40f8-b80e-6f83b3ca75c6,network=Network(ef0eee7c-6d8a-43f8-b1b0-584de56c03ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27c2be2d-a7') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27c2be2d-a7, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap27c2be2d-a7, col_values=(('external_ids', {'iface-id': '27c2be2d-a79f-40f8-b80e-6f83b3ca75c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:ab:e6', 'vm-uuid': '762fcd08-984b-4341-9e6a-b098e2d14899'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:04 user nova-compute[72504]: INFO os_vif [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:ab:e6,bridge_name='br-int',has_traffic_filtering=True,id=27c2be2d-a79f-40f8-b80e-6f83b3ca75c6,network=Network(ef0eee7c-6d8a-43f8-b1b0-584de56c03ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27c2be2d-a7')
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:30:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] No VIF found with MAC fa:16:3e:74:ab:e6, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:30:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:06 user nova-compute[72504]: DEBUG nova.compute.manager [req-3ad0f5fb-f66d-4a6e-91eb-0b6a8fc5bb04 req-3328fa75-d02d-4d73-8f45-48c5ef91d208 service nova] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Received event network-vif-plugged-27c2be2d-a79f-40f8-b80e-6f83b3ca75c6 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:30:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3ad0f5fb-f66d-4a6e-91eb-0b6a8fc5bb04 req-3328fa75-d02d-4d73-8f45-48c5ef91d208 service nova] Acquiring lock "762fcd08-984b-4341-9e6a-b098e2d14899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:30:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3ad0f5fb-f66d-4a6e-91eb-0b6a8fc5bb04 req-3328fa75-d02d-4d73-8f45-48c5ef91d208 service nova] Lock "762fcd08-984b-4341-9e6a-b098e2d14899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:30:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3ad0f5fb-f66d-4a6e-91eb-0b6a8fc5bb04 req-3328fa75-d02d-4d73-8f45-48c5ef91d208 service nova] Lock "762fcd08-984b-4341-9e6a-b098e2d14899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:30:06 user nova-compute[72504]: DEBUG nova.compute.manager [req-3ad0f5fb-f66d-4a6e-91eb-0b6a8fc5bb04 req-3328fa75-d02d-4d73-8f45-48c5ef91d208 service nova] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] No waiting events found dispatching network-vif-plugged-27c2be2d-a79f-40f8-b80e-6f83b3ca75c6 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:30:06 user nova-compute[72504]: WARNING nova.compute.manager [req-3ad0f5fb-f66d-4a6e-91eb-0b6a8fc5bb04 req-3328fa75-d02d-4d73-8f45-48c5ef91d208 service nova] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Received unexpected event network-vif-plugged-27c2be2d-a79f-40f8-b80e-6f83b3ca75c6 for instance with vm_state building and task_state spawning.
Aug 01 20:30:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c131eb50-31d9-48ba-af69-5fd973752052 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:30:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c131eb50-31d9-48ba-af69-5fd973752052 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:30:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c131eb50-31d9-48ba-af69-5fd973752052 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:30:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c131eb50-31d9-48ba-af69-5fd973752052 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:30:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c131eb50-31d9-48ba-af69-5fd973752052 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:30:06 user nova-compute[72504]: INFO nova.compute.manager [None req-c131eb50-31d9-48ba-af69-5fd973752052 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Terminating instance
Aug 01 20:30:06 user nova-compute[72504]: DEBUG nova.compute.manager [None req-c131eb50-31d9-48ba-af69-5fd973752052 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:30:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:06 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:07 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Instance destroyed successfully.
Aug 01 20:30:07 user nova-compute[72504]: DEBUG nova.objects.instance [None req-c131eb50-31d9-48ba-af69-5fd973752052 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lazy-loading 'resources' on Instance uuid 07379d7d-7337-4b7c-9a2a-69454c7f6bd0 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:30:07 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-c131eb50-31d9-48ba-af69-5fd973752052 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2041375816',display_name='tempest-TestMinimumBasicScenario-server-2041375816',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2041375816',id=48,image_ref='14534198-33da-4241-b4ea-8ccc019a85e1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLehmylpaCdal4Jqd8WaFkEfiZW2L1clsbF//05KMkNDqEcpl0EZbm2TzEFmXpF4uVTxvfJcw8Q1QqJKuWUwE7fCr1E92qXwnO85qh82bjj+2dWKu/NGJQAY8KDt9btYFw==',key_name='tempest-TestMinimumBasicScenario-1903276268',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:25:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72d4446b451947be88bc15a1a938b859',ramdisk_id='',reservation_id='r-zcj9lrw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='14534198-33da-4241-b4ea-8ccc019a85e1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-869578324',owner_user_name='tempest-TestMinimumBasicScenario-869578324-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:27:25Z,user_data=None,user_id='c0015fa066434b679e0126a916f96393',uuid=07379d7d-7337-4b7c-9a2a-69454c7f6bd0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9241d82-2fb0-4009-9861-d616702811ce", "address": "fa:16:3e:03:16:b6", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9241d82-2f", "ovs_interfaceid": "c9241d82-2fb0-4009-9861-d616702811ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:30:07 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-c131eb50-31d9-48ba-af69-5fd973752052 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Converting VIF {"id": "c9241d82-2fb0-4009-9861-d616702811ce", "address": "fa:16:3e:03:16:b6", "network": {"id": "786ed785-b5d5-43d6-b39e-3d8c490dc3f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561423092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d4446b451947be88bc15a1a938b859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9241d82-2f", "ovs_interfaceid": "c9241d82-2fb0-4009-9861-d616702811ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:30:07 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-c131eb50-31d9-48ba-af69-5fd973752052 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:16:b6,bridge_name='br-int',has_traffic_filtering=True,id=c9241d82-2fb0-4009-9861-d616702811ce,network=Network(786ed785-b5d5-43d6-b39e-3d8c490dc3f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9241d82-2f') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:30:07 user nova-compute[72504]: DEBUG os_vif [None req-c131eb50-31d9-48ba-af69-5fd973752052 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:16:b6,bridge_name='br-int',has_traffic_filtering=True,id=c9241d82-2fb0-4009-9861-d616702811ce,network=Network(786ed785-b5d5-43d6-b39e-3d8c490dc3f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9241d82-2f') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:30:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9241d82-2f, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:30:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:30:07 user nova-compute[72504]: INFO os_vif [None req-c131eb50-31d9-48ba-af69-5fd973752052 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:16:b6,bridge_name='br-int',has_traffic_filtering=True,id=c9241d82-2fb0-4009-9861-d616702811ce,network=Network(786ed785-b5d5-43d6-b39e-3d8c490dc3f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9241d82-2f')
Aug 01 20:30:07 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-c131eb50-31d9-48ba-af69-5fd973752052 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Deleting instance files /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0_del
Aug 01 20:30:07 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-c131eb50-31d9-48ba-af69-5fd973752052 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Deletion of /opt/stack/data/nova/instances/07379d7d-7337-4b7c-9a2a-69454c7f6bd0_del complete
Aug 01 20:30:07 user nova-compute[72504]: INFO nova.compute.manager [None req-c131eb50-31d9-48ba-af69-5fd973752052 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 01 20:30:07 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-c131eb50-31d9-48ba-af69-5fd973752052 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:30:07 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:30:07 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:30:08 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:30:08 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Took 0.45 seconds to deallocate network for instance.
Aug 01 20:30:08 user nova-compute[72504]: DEBUG nova.compute.manager [req-e02b80af-0877-45d2-bcc6-2e7abf5160d6 req-687ede6f-eebb-47f4-be8b-342e546c9b05 service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Received event network-vif-deleted-c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:30:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c131eb50-31d9-48ba-af69-5fd973752052 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:30:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c131eb50-31d9-48ba-af69-5fd973752052 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:30:08 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-c131eb50-31d9-48ba-af69-5fd973752052 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:30:08 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-c131eb50-31d9-48ba-af69-5fd973752052 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:30:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c131eb50-31d9-48ba-af69-5fd973752052 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:30:08 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-c131eb50-31d9-48ba-af69-5fd973752052 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Deleted allocations for instance 07379d7d-7337-4b7c-9a2a-69454c7f6bd0
Aug 01 20:30:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c131eb50-31d9-48ba-af69-5fd973752052 tempest-TestMinimumBasicScenario-869578324 tempest-TestMinimumBasicScenario-869578324-project-member] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.657s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:30:08 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690921808.495441, 762fcd08-984b-4341-9e6a-b098e2d14899 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:30:08 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] VM Resumed (Lifecycle Event)
Aug 01 20:30:08 user nova-compute[72504]: DEBUG nova.compute.manager [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:30:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:30:08 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Instance spawned successfully.
Aug 01 20:30:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 20:30:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:30:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:30:08 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:30:08 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:30:08 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:30:08 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690921808.4970713, 762fcd08-984b-4341-9e6a-b098e2d14899 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:30:08 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] VM Started (Lifecycle Event)
Aug 01 20:30:08 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:30:08 user nova-compute[72504]: INFO nova.compute.manager [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Took 7.15 seconds to spawn the instance on the hypervisor.
Aug 01 20:30:08 user nova-compute[72504]: DEBUG nova.compute.manager [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:30:08 user nova-compute[72504]: DEBUG nova.compute.manager [req-6f9f3b43-47c6-4ee2-aaf6-7a31a800c21e req-e36d4270-019e-42cc-8ed7-7d3aa7d649fe service nova] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Received event network-vif-plugged-27c2be2d-a79f-40f8-b80e-6f83b3ca75c6 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:30:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6f9f3b43-47c6-4ee2-aaf6-7a31a800c21e req-e36d4270-019e-42cc-8ed7-7d3aa7d649fe service nova] Acquiring lock "762fcd08-984b-4341-9e6a-b098e2d14899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:30:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6f9f3b43-47c6-4ee2-aaf6-7a31a800c21e req-e36d4270-019e-42cc-8ed7-7d3aa7d649fe service nova] Lock "762fcd08-984b-4341-9e6a-b098e2d14899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:30:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6f9f3b43-47c6-4ee2-aaf6-7a31a800c21e req-e36d4270-019e-42cc-8ed7-7d3aa7d649fe service nova] Lock "762fcd08-984b-4341-9e6a-b098e2d14899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:30:08 user nova-compute[72504]: DEBUG nova.compute.manager [req-6f9f3b43-47c6-4ee2-aaf6-7a31a800c21e req-e36d4270-019e-42cc-8ed7-7d3aa7d649fe service nova] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] No waiting events found dispatching network-vif-plugged-27c2be2d-a79f-40f8-b80e-6f83b3ca75c6 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:30:08 user nova-compute[72504]: WARNING nova.compute.manager [req-6f9f3b43-47c6-4ee2-aaf6-7a31a800c21e req-e36d4270-019e-42cc-8ed7-7d3aa7d649fe service nova] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Received unexpected event network-vif-plugged-27c2be2d-a79f-40f8-b80e-6f83b3ca75c6 for instance with vm_state building and task_state spawning.
Aug 01 20:30:08 user nova-compute[72504]: DEBUG nova.compute.manager [req-6f9f3b43-47c6-4ee2-aaf6-7a31a800c21e req-e36d4270-019e-42cc-8ed7-7d3aa7d649fe service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Received event network-vif-unplugged-c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:30:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6f9f3b43-47c6-4ee2-aaf6-7a31a800c21e req-e36d4270-019e-42cc-8ed7-7d3aa7d649fe service nova] Acquiring lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:30:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6f9f3b43-47c6-4ee2-aaf6-7a31a800c21e req-e36d4270-019e-42cc-8ed7-7d3aa7d649fe service nova] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:30:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6f9f3b43-47c6-4ee2-aaf6-7a31a800c21e req-e36d4270-019e-42cc-8ed7-7d3aa7d649fe service nova] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:30:08 user nova-compute[72504]: DEBUG nova.compute.manager [req-6f9f3b43-47c6-4ee2-aaf6-7a31a800c21e req-e36d4270-019e-42cc-8ed7-7d3aa7d649fe service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] No waiting events found dispatching network-vif-unplugged-c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:30:08 user nova-compute[72504]: WARNING nova.compute.manager [req-6f9f3b43-47c6-4ee2-aaf6-7a31a800c21e req-e36d4270-019e-42cc-8ed7-7d3aa7d649fe service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Received unexpected event network-vif-unplugged-c9241d82-2fb0-4009-9861-d616702811ce for instance with vm_state deleted and task_state None.
Aug 01 20:30:08 user nova-compute[72504]: DEBUG nova.compute.manager [req-6f9f3b43-47c6-4ee2-aaf6-7a31a800c21e req-e36d4270-019e-42cc-8ed7-7d3aa7d649fe service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Received event network-vif-plugged-c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:30:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6f9f3b43-47c6-4ee2-aaf6-7a31a800c21e req-e36d4270-019e-42cc-8ed7-7d3aa7d649fe service nova] Acquiring lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:30:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6f9f3b43-47c6-4ee2-aaf6-7a31a800c21e req-e36d4270-019e-42cc-8ed7-7d3aa7d649fe service nova] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:30:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-6f9f3b43-47c6-4ee2-aaf6-7a31a800c21e req-e36d4270-019e-42cc-8ed7-7d3aa7d649fe service nova] Lock "07379d7d-7337-4b7c-9a2a-69454c7f6bd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:30:08 user nova-compute[72504]: DEBUG nova.compute.manager [req-6f9f3b43-47c6-4ee2-aaf6-7a31a800c21e req-e36d4270-019e-42cc-8ed7-7d3aa7d649fe service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] No waiting events found dispatching network-vif-plugged-c9241d82-2fb0-4009-9861-d616702811ce {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:30:08 user nova-compute[72504]: WARNING nova.compute.manager [req-6f9f3b43-47c6-4ee2-aaf6-7a31a800c21e req-e36d4270-019e-42cc-8ed7-7d3aa7d649fe service nova] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Received unexpected event network-vif-plugged-c9241d82-2fb0-4009-9861-d616702811ce for instance with vm_state deleted and task_state None.
Aug 01 20:30:08 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:30:08 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:30:08 user nova-compute[72504]: INFO nova.compute.manager [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Took 7.84 seconds to build instance.
Aug 01 20:30:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-c437e887-38e8-4fb6-8564-2ad8e50219e7 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "762fcd08-984b-4341-9e6a-b098e2d14899" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:30:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:22 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690921807.560168, 07379d7d-7337-4b7c-9a2a-69454c7f6bd0 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:30:22 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] VM Stopped (Lifecycle Event)
Aug 01 20:30:22 user nova-compute[72504]: DEBUG nova.compute.manager [None req-480b0d36-e354-4a91-97cb-f5de65ef120c None None] [instance: 07379d7d-7337-4b7c-9a2a-69454c7f6bd0] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:30:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:30:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:30:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:30:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:30:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:37 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:30:37 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:30:37 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Cleaning up deleted instances {{(pid=72504) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 20:30:37 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] There are 0 instances to clean {{(pid=72504) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 20:30:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:46 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:30:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:49 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:30:51 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:30:51 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:30:51 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:30:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:52 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:30:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:58 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:30:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:30:59 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:30:59 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:31:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-27f71b04-7113-416c-961e-0c1610c45715" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:31:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-27f71b04-7113-416c-961e-0c1610c45715" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:31:00 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:31:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:00 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Updating instance_info_cache with network_info: [{"id": "56c55251-4056-41f5-9643-2775e2bc3f46", "address": "fa:16:3e:ed:b0:63", "network": {"id": "ef0eee7c-6d8a-43f8-b1b0-584de56c03ad", "bridge": "br-int", "label": "tempest-TestStampPattern-741020257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "954dcaf44c2347b597c22547e7234855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c55251-40", "ovs_interfaceid": "56c55251-4056-41f5-9643-2775e2bc3f46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:31:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-27f71b04-7113-416c-961e-0c1610c45715" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:31:00 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:31:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:04 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:31:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:31:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:31:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:31:04 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:31:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:31:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:31:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:31:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:31:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762fcd08-984b-4341-9e6a-b098e2d14899/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:31:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762fcd08-984b-4341-9e6a-b098e2d14899/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:31:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762fcd08-984b-4341-9e6a-b098e2d14899/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:31:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762fcd08-984b-4341-9e6a-b098e2d14899/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:31:06 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:31:06 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:31:06 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8690MB free_disk=24.99038314819336GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:31:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:31:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:31:06 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 27f71b04-7113-416c-961e-0c1610c45715 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:31:06 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 762fcd08-984b-4341-9e6a-b098e2d14899 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:31:06 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:31:06 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:31:06 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:31:06 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:31:06 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:31:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:31:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:07 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:31:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Acquiring lock "186d897a-b557-4563-aa0f-26e02aa4fbd4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:31:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:31:27 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 20:31:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:31:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:31:27 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:31:27 user nova-compute[72504]: INFO nova.compute.claims [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Claim successful on node user
Aug 01 20:31:28 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:31:28 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:31:28 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.227s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:31:28 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 20:31:28 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 20:31:28 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 20:31:28 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 20:31:28 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 20:31:28 user nova-compute[72504]: DEBUG nova.policy [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72cd9ab910d04112bfc53a255878e99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce38c80e818b4b76bc202f9cf7e85dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 20:31:28 user nova-compute[72504]: INFO nova.virt.block_device [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Booting with volume 419d5485-33f6-41fb-8226-3d40993549f0 at /dev/vda
Aug 01 20:31:28 user nova-compute[72504]: DEBUG os_brick.utils [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:31:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:31:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:31:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0d0de1-e92a-4f67-82cb-520c4ee653d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:31:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:31:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:31:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[743ce6e7-c627-4a11-b260-bd385a5cc2cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:31:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:31:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:31:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf893b8-3c86-46f9-b826-592a90524c09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:31:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c36a85-51f0-4c71-921e-5c2b47a66c66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:31:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:31:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:31:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:31:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:31:28 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:31:28 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:31:28 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2b499f-5c79-4ec4-9fcd-5f4136349369]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:31:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:31:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:31:28 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:31:28 user nova-compute[72504]: DEBUG os_brick.utils [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:31:28 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Updating existing volume attachment record: f1b74eb6-eca5-400e-b2d6-696e307c4888 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:31:28 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Successfully created port: 424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 20:31:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:29 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Successfully updated port: 424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 20:31:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Acquiring lock "refresh_cache-186d897a-b557-4563-aa0f-26e02aa4fbd4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:31:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Acquired lock "refresh_cache-186d897a-b557-4563-aa0f-26e02aa4fbd4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:31:29 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:31:29 user nova-compute[72504]: DEBUG nova.compute.manager [req-ffc2f1d3-2d29-48a4-8d21-0ee3c5703860 req-46816135-0567-444e-a375-adfb374ce4ac service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received event network-changed-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:31:29 user nova-compute[72504]: DEBUG nova.compute.manager [req-ffc2f1d3-2d29-48a4-8d21-0ee3c5703860 req-46816135-0567-444e-a375-adfb374ce4ac service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Refreshing instance network info cache due to event network-changed-424a5b00-62a6-4ef6-86ce-c916150a4908. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:31:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ffc2f1d3-2d29-48a4-8d21-0ee3c5703860 req-46816135-0567-444e-a375-adfb374ce4ac service nova] Acquiring lock "refresh_cache-186d897a-b557-4563-aa0f-26e02aa4fbd4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:31:29 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:31:30 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Updating instance_info_cache with network_info: [{"id": "424a5b00-62a6-4ef6-86ce-c916150a4908", "address": "fa:16:3e:01:e3:82", "network": {"id": "792d24df-f071-491a-8070-40b1fe36b4ca", "bridge": "br-int", "label": "tempest-TestShelveInstance-979146441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce38c80e818b4b76bc202f9cf7e85dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424a5b00-62", "ovs_interfaceid": "424a5b00-62a6-4ef6-86ce-c916150a4908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:31:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Releasing lock "refresh_cache-186d897a-b557-4563-aa0f-26e02aa4fbd4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:31:30 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Instance network_info: |[{"id": "424a5b00-62a6-4ef6-86ce-c916150a4908", "address": "fa:16:3e:01:e3:82", "network": {"id": "792d24df-f071-491a-8070-40b1fe36b4ca", "bridge": "br-int", "label": "tempest-TestShelveInstance-979146441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce38c80e818b4b76bc202f9cf7e85dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424a5b00-62", "ovs_interfaceid": "424a5b00-62a6-4ef6-86ce-c916150a4908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 20:31:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ffc2f1d3-2d29-48a4-8d21-0ee3c5703860 req-46816135-0567-444e-a375-adfb374ce4ac service nova] Acquired lock "refresh_cache-186d897a-b557-4563-aa0f-26e02aa4fbd4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:31:30 user nova-compute[72504]: DEBUG nova.network.neutron [req-ffc2f1d3-2d29-48a4-8d21-0ee3c5703860 req-46816135-0567-444e-a375-adfb374ce4ac service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Refreshing network info cache for port 424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:31:30 user nova-compute[72504]: DEBUG nova.network.neutron [req-ffc2f1d3-2d29-48a4-8d21-0ee3c5703860 req-46816135-0567-444e-a375-adfb374ce4ac service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Updated VIF entry in instance network info cache for port 424a5b00-62a6-4ef6-86ce-c916150a4908. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:31:30 user nova-compute[72504]: DEBUG nova.network.neutron [req-ffc2f1d3-2d29-48a4-8d21-0ee3c5703860 req-46816135-0567-444e-a375-adfb374ce4ac service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Updating instance_info_cache with network_info: [{"id": "424a5b00-62a6-4ef6-86ce-c916150a4908", "address": "fa:16:3e:01:e3:82", "network": {"id": "792d24df-f071-491a-8070-40b1fe36b4ca", "bridge": "br-int", "label": "tempest-TestShelveInstance-979146441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce38c80e818b4b76bc202f9cf7e85dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424a5b00-62", "ovs_interfaceid": "424a5b00-62a6-4ef6-86ce-c916150a4908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:31:30 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ffc2f1d3-2d29-48a4-8d21-0ee3c5703860 req-46816135-0567-444e-a375-adfb374ce4ac service nova] Releasing lock "refresh_cache-186d897a-b557-4563-aa0f-26e02aa4fbd4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:31:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:31:35 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Creating image(s)
Aug 01 20:31:35 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Did not create local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Ensure instance console log exists: /opt/stack/data/nova/instances/186d897a-b557-4563-aa0f-26e02aa4fbd4/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Start _get_guest_xml network_info=[{"id": "424a5b00-62a6-4ef6-86ce-c916150a4908", "address": "fa:16:3e:01:e3:82", "network": {"id": "792d24df-f071-491a-8070-40b1fe36b4ca", "bridge": "br-int", "label": "tempest-TestShelveInstance-979146441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce38c80e818b4b76bc202f9cf7e85dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424a5b00-62", "ovs_interfaceid": "424a5b00-62a6-4ef6-86ce-c916150a4908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EczbQDLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '186d897a-b557-4563-aa0f-26e02aa4fbd4', 'attached_at': '', 'detached_at': '', 'volume_id': '419d5485-33f6-41fb-8226-3d40993549f0', 'serial': '419d5485-33f6-41fb-8226-3d40993549f0'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': 'f1b74eb6-eca5-400e-b2d6-696e307c4888', 'volume_type': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:31:35 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:31:35 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:31:35 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EczbQDLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:31:35 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:31:35 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:31:35 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:31:35 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:31:35 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e39533b-ff02-4a9d-b92d-e82ef9402e7f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:31:35 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8b570e-0f3d-4459-be32-7d2a26788eed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0] added
Aug 01 20:31:35 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d591cbd9-74c7-44cb-8b70-10805a894d4d]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a2d05a-d4de-4a7f-851d-b145f7322098]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EczbQDLd {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EczbQDLd" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c779196-8088-4584-bf73-ccc93e89b2ed]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EczbQDLd'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a504db27-be8b-430a-ba59-3ea75fed6968]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72504) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[03afd582-f60a-4540-bfae-2cc240a16f9f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 20:31:35 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 20:31:35 user nova-compute[72504]:  {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:31:35 user nova-compute[72504]: WARNING os_brick.initiator.connectors.iscsi [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 20:31:35 user nova-compute[72504]: 
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1692581f-602e-4b6e-b286-54b5dddb85cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0, portal: 172.16.0.220,3260]
Aug 01 20:31:35 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0, portal: 172.16.0.220,3260] successful.
Aug 01 20:31:35 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7022b4c0-023b-4acf-ac3a-c4c03b4b739d]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b74e0ef-f51c-4829-bfb6-c6d71e15d12a]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 (non-flash)
Aug 01 20:31:35 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 (non-flash)
Aug 01 20:31:35 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4491bd2b-53a2-4b7d-924c-4a9182d0f2b9]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:31:35 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EczbQDLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:31:36 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:31:36 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26533633033613133', 'path': '/dev/sdb'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:31:36 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533633033613133', 'path': '/dev/sdb'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:31:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:31:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1642579278',display_name='tempest-TestShelveInstance-server-1642579278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1642579278',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpuG7s0jqI71B8afSxNYy1/BXabWzAKku1KOu6d5796bfaxJZ1lLhEY7CICYoOUv95/Q1IFPq79ii5uPeUjW1sjyMz+cBS5rqVp3t877RxH3AgqgFjZP1TbN1jeZGGbZA==',key_name='tempest-TestShelveInstance-316934371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce38c80e818b4b76bc202f9cf7e85dce',ramdisk_id='',reservation_id='r-ly1n1up5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1437414457',owner_user_name='tempest-TestShelveInstance-1437414457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:31:28Z,user_data=None,user_id='72cd9ab910d04112bfc53a255878e99b',uuid=186d897a-b557-4563-aa0f-26e02aa4fbd4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "424a5b00-62a6-4ef6-86ce-c916150a4908", "address": "fa:16:3e:01:e3:82", "network": {"id": "792d24df-f071-491a-8070-40b1fe36b4ca", "bridge": "br-int", "label": "tempest-TestShelveInstance-979146441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce38c80e818b4b76bc202f9cf7e85dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424a5b00-62", "ovs_interfaceid": "424a5b00-62a6-4ef6-86ce-c916150a4908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:31:37 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Converting VIF {"id": "424a5b00-62a6-4ef6-86ce-c916150a4908", "address": "fa:16:3e:01:e3:82", "network": {"id": "792d24df-f071-491a-8070-40b1fe36b4ca", "bridge": "br-int", "label": "tempest-TestShelveInstance-979146441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce38c80e818b4b76bc202f9cf7e85dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424a5b00-62", "ovs_interfaceid": "424a5b00-62a6-4ef6-86ce-c916150a4908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:31:37 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:e3:82,bridge_name='br-int',has_traffic_filtering=True,id=424a5b00-62a6-4ef6-86ce-c916150a4908,network=Network(792d24df-f071-491a-8070-40b1fe36b4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424a5b00-62') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:31:37 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lazy-loading 'pci_devices' on Instance uuid 186d897a-b557-4563-aa0f-26e02aa4fbd4 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:31:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:31:37 user nova-compute[72504]:   <uuid>186d897a-b557-4563-aa0f-26e02aa4fbd4</uuid>
Aug 01 20:31:37 user nova-compute[72504]:   <name>instance-00000033</name>
Aug 01 20:31:37 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:31:37 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:31:37 user nova-compute[72504]:   <metadata>
Aug 01 20:31:37 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:31:37 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:31:37 user nova-compute[72504]:       <nova:name>tempest-TestShelveInstance-server-1642579278</nova:name>
Aug 01 20:31:37 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:31:35</nova:creationTime>
Aug 01 20:31:37 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:31:37 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:31:37 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:31:37 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:31:37 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:31:37 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:31:37 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:31:37 user nova-compute[72504]:       <nova:owner>
Aug 01 20:31:37 user nova-compute[72504]:         <nova:user uuid="72cd9ab910d04112bfc53a255878e99b">tempest-TestShelveInstance-1437414457-project-member</nova:user>
Aug 01 20:31:37 user nova-compute[72504]:         <nova:project uuid="ce38c80e818b4b76bc202f9cf7e85dce">tempest-TestShelveInstance-1437414457</nova:project>
Aug 01 20:31:37 user nova-compute[72504]:       </nova:owner>
Aug 01 20:31:37 user nova-compute[72504]:       <nova:ports>
Aug 01 20:31:37 user nova-compute[72504]:         <nova:port uuid="424a5b00-62a6-4ef6-86ce-c916150a4908">
Aug 01 20:31:37 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 20:31:37 user nova-compute[72504]:         </nova:port>
Aug 01 20:31:37 user nova-compute[72504]:       </nova:ports>
Aug 01 20:31:37 user nova-compute[72504]:     </nova:instance>
Aug 01 20:31:37 user nova-compute[72504]:   </metadata>
Aug 01 20:31:37 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:31:37 user nova-compute[72504]:     <system>
Aug 01 20:31:37 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:31:37 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:31:37 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:31:37 user nova-compute[72504]:       <entry name="serial">186d897a-b557-4563-aa0f-26e02aa4fbd4</entry>
Aug 01 20:31:37 user nova-compute[72504]:       <entry name="uuid">186d897a-b557-4563-aa0f-26e02aa4fbd4</entry>
Aug 01 20:31:37 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:31:37 user nova-compute[72504]:     </system>
Aug 01 20:31:37 user nova-compute[72504]:   </sysinfo>
Aug 01 20:31:37 user nova-compute[72504]:   <os>
Aug 01 20:31:37 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:31:37 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:31:37 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:31:37 user nova-compute[72504]:   </os>
Aug 01 20:31:37 user nova-compute[72504]:   <features>
Aug 01 20:31:37 user nova-compute[72504]:     <acpi/>
Aug 01 20:31:37 user nova-compute[72504]:     <apic/>
Aug 01 20:31:37 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:31:37 user nova-compute[72504]:   </features>
Aug 01 20:31:37 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:31:37 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:31:37 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:31:37 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:31:37 user nova-compute[72504]:   </clock>
Aug 01 20:31:37 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:31:37 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:31:37 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:31:37 user nova-compute[72504]:   </cpu>
Aug 01 20:31:37 user nova-compute[72504]:   <devices>
Aug 01 20:31:37 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 20:31:37 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:31:37 user nova-compute[72504]:       <source dev="/dev/sdb"/>
Aug 01 20:31:37 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:31:37 user nova-compute[72504]:       <serial>419d5485-33f6-41fb-8226-3d40993549f0</serial>
Aug 01 20:31:37 user nova-compute[72504]:     </disk>
Aug 01 20:31:37 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:31:37 user nova-compute[72504]:       <mac address="fa:16:3e:01:e3:82"/>
Aug 01 20:31:37 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:31:37 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:31:37 user nova-compute[72504]:       <target dev="tap424a5b00-62"/>
Aug 01 20:31:37 user nova-compute[72504]:     </interface>
Aug 01 20:31:37 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:31:37 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/186d897a-b557-4563-aa0f-26e02aa4fbd4/console.log" append="off"/>
Aug 01 20:31:37 user nova-compute[72504]:     </serial>
Aug 01 20:31:37 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:31:37 user nova-compute[72504]:     <video>
Aug 01 20:31:37 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:31:37 user nova-compute[72504]:     </video>
Aug 01 20:31:37 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:31:37 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:31:37 user nova-compute[72504]:     </rng>
Aug 01 20:31:37 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:31:37 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:31:37 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:31:37 user nova-compute[72504]:     </memballoon>
Aug 01 20:31:37 user nova-compute[72504]:   </devices>
Aug 01 20:31:37 user nova-compute[72504]: </domain>
Aug 01 20:31:37 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:31:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:31:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1642579278',display_name='tempest-TestShelveInstance-server-1642579278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1642579278',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpuG7s0jqI71B8afSxNYy1/BXabWzAKku1KOu6d5796bfaxJZ1lLhEY7CICYoOUv95/Q1IFPq79ii5uPeUjW1sjyMz+cBS5rqVp3t877RxH3AgqgFjZP1TbN1jeZGGbZA==',key_name='tempest-TestShelveInstance-316934371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce38c80e818b4b76bc202f9cf7e85dce',ramdisk_id='',reservation_id='r-ly1n1up5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1437414457',owner_user_name='tempest-TestShelveInstance-1437414457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:31:28Z,user_data=None,user_id='72cd9ab910d04112bfc53a255878e99b',uuid=186d897a-b557-4563-aa0f-26e02aa4fbd4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "424a5b00-62a6-4ef6-86ce-c916150a4908", "address": "fa:16:3e:01:e3:82", "network": {"id": "792d24df-f071-491a-8070-40b1fe36b4ca", "bridge": "br-int", "label": "tempest-TestShelveInstance-979146441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce38c80e818b4b76bc202f9cf7e85dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424a5b00-62", "ovs_interfaceid": "424a5b00-62a6-4ef6-86ce-c916150a4908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:31:37 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Converting VIF {"id": "424a5b00-62a6-4ef6-86ce-c916150a4908", "address": "fa:16:3e:01:e3:82", "network": {"id": "792d24df-f071-491a-8070-40b1fe36b4ca", "bridge": "br-int", "label": "tempest-TestShelveInstance-979146441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce38c80e818b4b76bc202f9cf7e85dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424a5b00-62", "ovs_interfaceid": "424a5b00-62a6-4ef6-86ce-c916150a4908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:31:37 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:e3:82,bridge_name='br-int',has_traffic_filtering=True,id=424a5b00-62a6-4ef6-86ce-c916150a4908,network=Network(792d24df-f071-491a-8070-40b1fe36b4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424a5b00-62') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:31:37 user nova-compute[72504]: DEBUG os_vif [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:e3:82,bridge_name='br-int',has_traffic_filtering=True,id=424a5b00-62a6-4ef6-86ce-c916150a4908,network=Network(792d24df-f071-491a-8070-40b1fe36b4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424a5b00-62') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:31:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:31:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:31:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap424a5b00-62, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:31:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap424a5b00-62, col_values=(('external_ids', {'iface-id': '424a5b00-62a6-4ef6-86ce-c916150a4908', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:e3:82', 'vm-uuid': '186d897a-b557-4563-aa0f-26e02aa4fbd4'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:31:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:31:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:37 user nova-compute[72504]: INFO os_vif [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:e3:82,bridge_name='br-int',has_traffic_filtering=True,id=424a5b00-62a6-4ef6-86ce-c916150a4908,network=Network(792d24df-f071-491a-8070-40b1fe36b4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424a5b00-62')
Aug 01 20:31:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:31:37 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] No VIF found with MAC fa:16:3e:01:e3:82, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:31:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:38 user nova-compute[72504]: DEBUG nova.compute.manager [req-1983bc41-d116-40d1-a879-4a6cf3d24f29 req-fa394fcb-c83c-4dc8-bcb6-4db400456ed2 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received event network-vif-plugged-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:31:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1983bc41-d116-40d1-a879-4a6cf3d24f29 req-fa394fcb-c83c-4dc8-bcb6-4db400456ed2 service nova] Acquiring lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:31:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1983bc41-d116-40d1-a879-4a6cf3d24f29 req-fa394fcb-c83c-4dc8-bcb6-4db400456ed2 service nova] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:31:38 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1983bc41-d116-40d1-a879-4a6cf3d24f29 req-fa394fcb-c83c-4dc8-bcb6-4db400456ed2 service nova] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:31:38 user nova-compute[72504]: DEBUG nova.compute.manager [req-1983bc41-d116-40d1-a879-4a6cf3d24f29 req-fa394fcb-c83c-4dc8-bcb6-4db400456ed2 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] No waiting events found dispatching network-vif-plugged-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:31:38 user nova-compute[72504]: WARNING nova.compute.manager [req-1983bc41-d116-40d1-a879-4a6cf3d24f29 req-fa394fcb-c83c-4dc8-bcb6-4db400456ed2 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received unexpected event network-vif-plugged-424a5b00-62a6-4ef6-86ce-c916150a4908 for instance with vm_state building and task_state spawning.
Aug 01 20:31:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:39 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:31:40 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690921900.404938, 186d897a-b557-4563-aa0f-26e02aa4fbd4 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:31:40 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] VM Resumed (Lifecycle Event)
Aug 01 20:31:40 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:31:40 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:31:40 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Instance spawned successfully.
Aug 01 20:31:40 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 20:31:40 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:31:40 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:31:40 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:31:40 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:31:40 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:31:40 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:31:40 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:31:40 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:31:40 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:31:40 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690921900.4064062, 186d897a-b557-4563-aa0f-26e02aa4fbd4 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:31:40 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] VM Started (Lifecycle Event)
Aug 01 20:31:40 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:31:40 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:31:40 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:31:40 user nova-compute[72504]: INFO nova.compute.manager [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Took 4.90 seconds to spawn the instance on the hypervisor.
Aug 01 20:31:40 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:31:40 user nova-compute[72504]: INFO nova.compute.manager [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Took 12.76 seconds to build instance.
Aug 01 20:31:40 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e8f2943c-1a79-4254-84a1-769d9befa56b tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.854s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:31:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-f864ff26-4d94-4075-9732-fc6dd765ffde req-14d688ee-6100-4afa-a64b-9ccbfb901e19 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received event network-vif-plugged-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:31:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f864ff26-4d94-4075-9732-fc6dd765ffde req-14d688ee-6100-4afa-a64b-9ccbfb901e19 service nova] Acquiring lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:31:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f864ff26-4d94-4075-9732-fc6dd765ffde req-14d688ee-6100-4afa-a64b-9ccbfb901e19 service nova] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:31:41 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f864ff26-4d94-4075-9732-fc6dd765ffde req-14d688ee-6100-4afa-a64b-9ccbfb901e19 service nova] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:31:41 user nova-compute[72504]: DEBUG nova.compute.manager [req-f864ff26-4d94-4075-9732-fc6dd765ffde req-14d688ee-6100-4afa-a64b-9ccbfb901e19 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] No waiting events found dispatching network-vif-plugged-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:31:41 user nova-compute[72504]: WARNING nova.compute.manager [req-f864ff26-4d94-4075-9732-fc6dd765ffde req-14d688ee-6100-4afa-a64b-9ccbfb901e19 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received unexpected event network-vif-plugged-424a5b00-62a6-4ef6-86ce-c916150a4908 for instance with vm_state active and task_state None.
Aug 01 20:31:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:47 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:31:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:51 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:31:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:52 user nova-compute[72504]: DEBUG nova.compute.manager [req-823ff88a-cd43-47dc-9e04-9df69e95b206 req-2bd90f34-d87e-4f35-80ff-223a0a7c6c3b service nova] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Received event network-changed-27c2be2d-a79f-40f8-b80e-6f83b3ca75c6 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:31:52 user nova-compute[72504]: DEBUG nova.compute.manager [req-823ff88a-cd43-47dc-9e04-9df69e95b206 req-2bd90f34-d87e-4f35-80ff-223a0a7c6c3b service nova] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Refreshing instance network info cache due to event network-changed-27c2be2d-a79f-40f8-b80e-6f83b3ca75c6. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:31:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-823ff88a-cd43-47dc-9e04-9df69e95b206 req-2bd90f34-d87e-4f35-80ff-223a0a7c6c3b service nova] Acquiring lock "refresh_cache-762fcd08-984b-4341-9e6a-b098e2d14899" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:31:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-823ff88a-cd43-47dc-9e04-9df69e95b206 req-2bd90f34-d87e-4f35-80ff-223a0a7c6c3b service nova] Acquired lock "refresh_cache-762fcd08-984b-4341-9e6a-b098e2d14899" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:31:52 user nova-compute[72504]: DEBUG nova.network.neutron [req-823ff88a-cd43-47dc-9e04-9df69e95b206 req-2bd90f34-d87e-4f35-80ff-223a0a7c6c3b service nova] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Refreshing network info cache for port 27c2be2d-a79f-40f8-b80e-6f83b3ca75c6 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:31:52 user nova-compute[72504]: DEBUG nova.network.neutron [req-823ff88a-cd43-47dc-9e04-9df69e95b206 req-2bd90f34-d87e-4f35-80ff-223a0a7c6c3b service nova] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Updated VIF entry in instance network info cache for port 27c2be2d-a79f-40f8-b80e-6f83b3ca75c6. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:31:52 user nova-compute[72504]: DEBUG nova.network.neutron [req-823ff88a-cd43-47dc-9e04-9df69e95b206 req-2bd90f34-d87e-4f35-80ff-223a0a7c6c3b service nova] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Updating instance_info_cache with network_info: [{"id": "27c2be2d-a79f-40f8-b80e-6f83b3ca75c6", "address": "fa:16:3e:74:ab:e6", "network": {"id": "ef0eee7c-6d8a-43f8-b1b0-584de56c03ad", "bridge": "br-int", "label": "tempest-TestStampPattern-741020257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "954dcaf44c2347b597c22547e7234855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c2be2d-a7", "ovs_interfaceid": "27c2be2d-a79f-40f8-b80e-6f83b3ca75c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:31:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-823ff88a-cd43-47dc-9e04-9df69e95b206 req-2bd90f34-d87e-4f35-80ff-223a0a7c6c3b service nova] Releasing lock "refresh_cache-762fcd08-984b-4341-9e6a-b098e2d14899" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:31:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "762fcd08-984b-4341-9e6a-b098e2d14899" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:31:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "762fcd08-984b-4341-9e6a-b098e2d14899" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:31:52 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:31:52 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:31:52 user nova-compute[72504]: DEBUG nova.objects.instance [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lazy-loading 'flavor' on Instance uuid 762fcd08-984b-4341-9e6a-b098e2d14899 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:31:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "762fcd08-984b-4341-9e6a-b098e2d14899" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:31:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "762fcd08-984b-4341-9e6a-b098e2d14899" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:31:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "762fcd08-984b-4341-9e6a-b098e2d14899" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:31:53 user nova-compute[72504]: INFO nova.compute.manager [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Attaching volume f8737a6a-a182-47d1-a37c-3814d1054928 to /dev/vdb
Aug 01 20:31:53 user nova-compute[72504]: DEBUG os_brick.utils [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:31:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:31:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:31:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6874492c-f245-48d0-9f90-be0d1942d7c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:31:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:31:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:31:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[873a0e21-2c86-4928-86ff-8d37cc10a0fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:31:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:31:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:31:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[247ae869-10bb-4669-909f-48028edd89a1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:31:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab40dfc3-3d8d-4118-8967-83725c740694]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:31:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:31:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:31:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:31:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:31:53 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:31:53 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:31:53 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6556fb10-0eb5-487c-bd27-92d029ddded5]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:31:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:31:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:31:53 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:31:53 user nova-compute[72504]: DEBUG os_brick.utils [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:31:53 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Updating existing volume attachment record: e9f1533a-f84a-4ddb-a134-81e83fa8d303 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:31:53 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:31:53 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:31:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:31:59 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:31:59 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:31:59 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 20:31:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-27f71b04-7113-416c-961e-0c1610c45715" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:31:59 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-27f71b04-7113-416c-961e-0c1610c45715" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:31:59 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:31:59 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lazy-loading 'info_cache' on Instance uuid 27f71b04-7113-416c-961e-0c1610c45715 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Updating instance_info_cache with network_info: [{"id": "56c55251-4056-41f5-9643-2775e2bc3f46", "address": "fa:16:3e:ed:b0:63", "network": {"id": "ef0eee7c-6d8a-43f8-b1b0-584de56c03ad", "bridge": "br-int", "label": "tempest-TestStampPattern-741020257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "954dcaf44c2347b597c22547e7234855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c55251-40", "ovs_interfaceid": "56c55251-4056-41f5-9643-2775e2bc3f46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-27f71b04-7113-416c-961e-0c1610c45715" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVuelqXM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:32:00 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:32:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:32:00 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:32:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:32:00 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f0f27a-4164-4e81-93c2-b6a620d1656d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:32:00 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ec506a-659d-474b-8181-9cc4954e975b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928] added
Aug 01 20:32:00 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a584d51f-b511-43f1-b644-784c416f0798]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[855cdc06-cdaa-46aa-8e35-7ca1b5cf59e9]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mVuelqXM {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mVuelqXM" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[127e7658-5e54-4196-a9fa-9465837b98c6]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mVuelqXM'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[323d4f82-a2d9-4999-b4c0-199c8a984b1c]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[338ce59e-b18a-4bf8-9ec3-da036a8eed3f]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 (non-flash)
Aug 01 20:32:00 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 (non-flash)
Aug 01 20:32:00 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40046b1-2835-49ac-9936-aa4c036bc5d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928, portal: 172.16.0.220,3260]
Aug 01 20:32:00 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928, portal: 172.16.0.220,3260] successful.
Aug 01 20:32:00 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2995f8-aa0a-4f70-a300-deedd1b96944]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bd6584-0cdc-4128-a886-90e2d5135ed5]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 (non-flash)
Aug 01 20:32:00 user nova-compute[72504]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928 (non-flash)
Aug 01 20:32:00 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 (non-flash)
Aug 01 20:32:00 user nova-compute[72504]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928 (non-flash)
Aug 01 20:32:00 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f13fd0-ae7f-47b0-9145-90bba925e7ec]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:32:00 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVuelqXM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:32:01 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:32:01 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26237343239383961', 'path': '/dev/sdc'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:32:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237343239383961', 'path': '/dev/sdc'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:32:01 user nova-compute[72504]: DEBUG nova.objects.instance [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lazy-loading 'flavor' on Instance uuid 762fcd08-984b-4341-9e6a-b098e2d14899 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:32:01 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 20:32:01 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:32:01 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 20:32:01 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:32:01 user nova-compute[72504]:   <serial>f8737a6a-a182-47d1-a37c-3814d1054928</serial>
Aug 01 20:32:01 user nova-compute[72504]: </disk>
Aug 01 20:32:01 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 20:32:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:32:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:32:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:32:02 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] No VIF found with MAC fa:16:3e:74:ab:e6, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:32:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-8f58f9d4-eec9-4cdb-97a4-4f1c79b87aa4 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "762fcd08-984b-4341-9e6a-b098e2d14899" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.499s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:32:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "762fcd08-984b-4341-9e6a-b098e2d14899" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:32:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "762fcd08-984b-4341-9e6a-b098e2d14899" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:32:03 user nova-compute[72504]: INFO nova.compute.manager [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Detaching volume f8737a6a-a182-47d1-a37c-3814d1054928
Aug 01 20:32:03 user nova-compute[72504]: INFO nova.virt.block_device [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Attempting to driver detach volume f8737a6a-a182-47d1-a37c-3814d1054928 from mountpoint /dev/vdb
Aug 01 20:32:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Attempting to detach device vdb from instance 762fcd08-984b-4341-9e6a-b098e2d14899 from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:32:04 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:32:04 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 20:32:04 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:32:04 user nova-compute[72504]:   <serial>f8737a6a-a182-47d1-a37c-3814d1054928</serial>
Aug 01 20:32:04 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:32:04 user nova-compute[72504]: </disk>
Aug 01 20:32:04 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:32:04 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Successfully detached device vdb from instance 762fcd08-984b-4341-9e6a-b098e2d14899 from the persistent domain config.
Aug 01 20:32:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 762fcd08-984b-4341-9e6a-b098e2d14899 from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:32:04 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:32:04 user nova-compute[72504]:   <source dev="/dev/sdc"/>
Aug 01 20:32:04 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:32:04 user nova-compute[72504]:   <serial>f8737a6a-a182-47d1-a37c-3814d1054928</serial>
Aug 01 20:32:04 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:32:04 user nova-compute[72504]: </disk>
Aug 01 20:32:04 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690921924.4335513, 762fcd08-984b-4341-9e6a-b098e2d14899 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 762fcd08-984b-4341-9e6a-b098e2d14899 {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 20:32:04 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Successfully detached device vdb from instance 762fcd08-984b-4341-9e6a-b098e2d14899 from the live domain config.
Aug 01 20:32:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVuelqXM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:32:04 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:32:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[321bee5d-8650-4980-a410-0ab43eb848e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc340eb-f1e8-4c88-8d23-1c21c073cd40]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 (non-flash)
Aug 01 20:32:04 user nova-compute[72504]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928 (non-flash)
Aug 01 20:32:04 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 (non-flash)
Aug 01 20:32:04 user nova-compute[72504]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928 (non-flash)
Aug 01 20:32:04 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3f45c9480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928'): ({'sdc'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Removing single pathed devices sdc {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[958afb8a-6f39-4d5c-a06b-b8870cc87388]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e3e452-ad08-4151-81d4-cb04d7ec950c]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Flushing IO for device /dev/sdc {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5207ee-41b2-4d3e-b821-e11601474b6e]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1a7239-bd22-4e72-bfda-c09fd27d510d]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] SCSI volumes sdc have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42d2aeb-909f-4288-98c2-3eda285b5bd6]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4ca010-5971-42d4-a5a6-200cff79e9e7]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928, portal: 172.16.0.220,3260]
Aug 01 20:32:04 user nova-compute[72504]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928, portal: 172.16.0.220,3260] successful.
Aug 01 20:32:04 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8737a6a-a182-47d1-a37c-3814d1054928 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0d6798-b9be-4e47-b3c4-f3517dbcbd1b]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] <== disconnect_volume: return (269ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:32:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:32:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:32:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:32:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:32:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762fcd08-984b-4341-9e6a-b098e2d14899/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:32:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762fcd08-984b-4341-9e6a-b098e2d14899/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:32:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762fcd08-984b-4341-9e6a-b098e2d14899/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:32:05 user nova-compute[72504]: DEBUG nova.objects.instance [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lazy-loading 'flavor' on Instance uuid 762fcd08-984b-4341-9e6a-b098e2d14899 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:32:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-62ee32e5-4ab7-4150-97d3-b5ea3927f901 tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "762fcd08-984b-4341-9e6a-b098e2d14899" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.567s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:32:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762fcd08-984b-4341-9e6a-b098e2d14899/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:32:05 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:32:05 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:32:05 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8533MB free_disk=24.979183197021484GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:32:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:32:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:32:06 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 27f71b04-7113-416c-961e-0c1610c45715 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:32:06 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 762fcd08-984b-4341-9e6a-b098e2d14899 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:32:06 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 186d897a-b557-4563-aa0f-26e02aa4fbd4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:32:06 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:32:06 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:32:06 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Refreshing inventories for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 20:32:06 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Updating ProviderTree inventory for provider b951a798-e88c-472c-8347-2c5f6a05d47c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 20:32:06 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Updating inventory in ProviderTree for provider b951a798-e88c-472c-8347-2c5f6a05d47c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 20:32:06 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Refreshing aggregate associations for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c, aggregates: None {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 20:32:06 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Refreshing trait associations for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c, traits: HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 20:32:06 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:32:06 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:32:06 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:32:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.509s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:32:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:32:07 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:32:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:32:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:32:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:32:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:32:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:32:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:32:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:32:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:32:39 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:32:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:32:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:32:49 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:32:51 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:32:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:32:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:32:54 user nova-compute[72504]: DEBUG nova.compute.manager [req-fe724d63-27d2-41d8-be07-fc637142e5b8 req-da3a55bb-d7e4-4ab2-830d-28dd762447d2 service nova] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Received event network-changed-27c2be2d-a79f-40f8-b80e-6f83b3ca75c6 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:32:54 user nova-compute[72504]: DEBUG nova.compute.manager [req-fe724d63-27d2-41d8-be07-fc637142e5b8 req-da3a55bb-d7e4-4ab2-830d-28dd762447d2 service nova] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Refreshing instance network info cache due to event network-changed-27c2be2d-a79f-40f8-b80e-6f83b3ca75c6. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:32:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-fe724d63-27d2-41d8-be07-fc637142e5b8 req-da3a55bb-d7e4-4ab2-830d-28dd762447d2 service nova] Acquiring lock "refresh_cache-762fcd08-984b-4341-9e6a-b098e2d14899" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:32:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-fe724d63-27d2-41d8-be07-fc637142e5b8 req-da3a55bb-d7e4-4ab2-830d-28dd762447d2 service nova] Acquired lock "refresh_cache-762fcd08-984b-4341-9e6a-b098e2d14899" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:32:54 user nova-compute[72504]: DEBUG nova.network.neutron [req-fe724d63-27d2-41d8-be07-fc637142e5b8 req-da3a55bb-d7e4-4ab2-830d-28dd762447d2 service nova] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Refreshing network info cache for port 27c2be2d-a79f-40f8-b80e-6f83b3ca75c6 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:32:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7fbd7008-f192-404d-9c6b-2d6da4fad87f tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "762fcd08-984b-4341-9e6a-b098e2d14899" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:32:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7fbd7008-f192-404d-9c6b-2d6da4fad87f tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "762fcd08-984b-4341-9e6a-b098e2d14899" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:32:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7fbd7008-f192-404d-9c6b-2d6da4fad87f tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "762fcd08-984b-4341-9e6a-b098e2d14899-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:32:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7fbd7008-f192-404d-9c6b-2d6da4fad87f tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "762fcd08-984b-4341-9e6a-b098e2d14899-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:32:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7fbd7008-f192-404d-9c6b-2d6da4fad87f tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "762fcd08-984b-4341-9e6a-b098e2d14899-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:32:54 user nova-compute[72504]: INFO nova.compute.manager [None req-7fbd7008-f192-404d-9c6b-2d6da4fad87f tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Terminating instance
Aug 01 20:32:54 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7fbd7008-f192-404d-9c6b-2d6da4fad87f tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:32:54 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:32:54 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:32:54 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:32:54 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:32:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:32:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:32:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-583b9af7-3c09-4992-9738-85ae2f6fe469 req-75b1c4fe-a569-464b-b5a3-fe8db1347365 service nova] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Received event network-vif-unplugged-27c2be2d-a79f-40f8-b80e-6f83b3ca75c6 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:32:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-583b9af7-3c09-4992-9738-85ae2f6fe469 req-75b1c4fe-a569-464b-b5a3-fe8db1347365 service nova] Acquiring lock "762fcd08-984b-4341-9e6a-b098e2d14899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:32:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-583b9af7-3c09-4992-9738-85ae2f6fe469 req-75b1c4fe-a569-464b-b5a3-fe8db1347365 service nova] Lock "762fcd08-984b-4341-9e6a-b098e2d14899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:32:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-583b9af7-3c09-4992-9738-85ae2f6fe469 req-75b1c4fe-a569-464b-b5a3-fe8db1347365 service nova] Lock "762fcd08-984b-4341-9e6a-b098e2d14899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:32:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-583b9af7-3c09-4992-9738-85ae2f6fe469 req-75b1c4fe-a569-464b-b5a3-fe8db1347365 service nova] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] No waiting events found dispatching network-vif-unplugged-27c2be2d-a79f-40f8-b80e-6f83b3ca75c6 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:32:55 user nova-compute[72504]: DEBUG nova.compute.manager [req-583b9af7-3c09-4992-9738-85ae2f6fe469 req-75b1c4fe-a569-464b-b5a3-fe8db1347365 service nova] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Received event network-vif-unplugged-27c2be2d-a79f-40f8-b80e-6f83b3ca75c6 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:32:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:32:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:32:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:32:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:32:55 user nova-compute[72504]: DEBUG nova.network.neutron [req-fe724d63-27d2-41d8-be07-fc637142e5b8 req-da3a55bb-d7e4-4ab2-830d-28dd762447d2 service nova] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Updated VIF entry in instance network info cache for port 27c2be2d-a79f-40f8-b80e-6f83b3ca75c6. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:32:55 user nova-compute[72504]: DEBUG nova.network.neutron [req-fe724d63-27d2-41d8-be07-fc637142e5b8 req-da3a55bb-d7e4-4ab2-830d-28dd762447d2 service nova] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Updating instance_info_cache with network_info: [{"id": "27c2be2d-a79f-40f8-b80e-6f83b3ca75c6", "address": "fa:16:3e:74:ab:e6", "network": {"id": "ef0eee7c-6d8a-43f8-b1b0-584de56c03ad", "bridge": "br-int", "label": "tempest-TestStampPattern-741020257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "954dcaf44c2347b597c22547e7234855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c2be2d-a7", "ovs_interfaceid": "27c2be2d-a79f-40f8-b80e-6f83b3ca75c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:32:55 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Instance destroyed successfully.
Aug 01 20:32:55 user nova-compute[72504]: DEBUG nova.objects.instance [None req-7fbd7008-f192-404d-9c6b-2d6da4fad87f tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lazy-loading 'resources' on Instance uuid 762fcd08-984b-4341-9e6a-b098e2d14899 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:32:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-fe724d63-27d2-41d8-be07-fc637142e5b8 req-da3a55bb-d7e4-4ab2-830d-28dd762447d2 service nova] Releasing lock "refresh_cache-762fcd08-984b-4341-9e6a-b098e2d14899" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:32:55 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-7fbd7008-f192-404d-9c6b-2d6da4fad87f tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:30:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1286848685',display_name='tempest-TestStampPattern-server-1286848685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1286848685',id=50,image_ref='453ad211-93d4-49d2-8d60-c5298f1d0612',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdI4LVSFCNR3lCoRwal10ZL6scdIAKC39QaHuvFuFnuwr/NWu42mzRscFZm983YeCIxnd4AhvNYO2SqFRb2qJ3zDi2GZAA4BpoLQqSXZ7AgQYEQbMB3T2D4Kl1fpdT5ig==',key_name='tempest-TestStampPattern-981271227',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:30:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='954dcaf44c2347b597c22547e7234855',ramdisk_id='',reservation_id='r-bhrt1f74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='27f71b04-7113-416c-961e-0c1610c45715',image_min_disk='1',image_min_ram='0',image_owner_id='954dcaf44c2347b597c22547e7234855',image_owner_project_name='tempest-TestStampPattern-1951030330',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1951030330-project-member',image_user_id='74f57f96a0f3453f91f8bb8554c4e53a',owner_project_name='tempest-TestStampPattern-1951030330',owner_user_name='tempest-TestStampPattern-1951030330-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:30:09Z,user_data=None,user_id='74f57f96a0f3453f91f8bb8554c4e53a',uuid=762fcd08-984b-4341-9e6a-b098e2d14899,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27c2be2d-a79f-40f8-b80e-6f83b3ca75c6", "address": "fa:16:3e:74:ab:e6", "network": {"id": "ef0eee7c-6d8a-43f8-b1b0-584de56c03ad", "bridge": "br-int", "label": "tempest-TestStampPattern-741020257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "954dcaf44c2347b597c22547e7234855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c2be2d-a7", "ovs_interfaceid": "27c2be2d-a79f-40f8-b80e-6f83b3ca75c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:32:55 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-7fbd7008-f192-404d-9c6b-2d6da4fad87f tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Converting VIF {"id": "27c2be2d-a79f-40f8-b80e-6f83b3ca75c6", "address": "fa:16:3e:74:ab:e6", "network": {"id": "ef0eee7c-6d8a-43f8-b1b0-584de56c03ad", "bridge": "br-int", "label": "tempest-TestStampPattern-741020257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "954dcaf44c2347b597c22547e7234855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c2be2d-a7", "ovs_interfaceid": "27c2be2d-a79f-40f8-b80e-6f83b3ca75c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:32:55 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-7fbd7008-f192-404d-9c6b-2d6da4fad87f tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:ab:e6,bridge_name='br-int',has_traffic_filtering=True,id=27c2be2d-a79f-40f8-b80e-6f83b3ca75c6,network=Network(ef0eee7c-6d8a-43f8-b1b0-584de56c03ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27c2be2d-a7') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:32:55 user nova-compute[72504]: DEBUG os_vif [None req-7fbd7008-f192-404d-9c6b-2d6da4fad87f tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:ab:e6,bridge_name='br-int',has_traffic_filtering=True,id=27c2be2d-a79f-40f8-b80e-6f83b3ca75c6,network=Network(ef0eee7c-6d8a-43f8-b1b0-584de56c03ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27c2be2d-a7') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:32:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:32:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27c2be2d-a7, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:32:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:32:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:32:55 user nova-compute[72504]: INFO os_vif [None req-7fbd7008-f192-404d-9c6b-2d6da4fad87f tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:ab:e6,bridge_name='br-int',has_traffic_filtering=True,id=27c2be2d-a79f-40f8-b80e-6f83b3ca75c6,network=Network(ef0eee7c-6d8a-43f8-b1b0-584de56c03ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27c2be2d-a7')
Aug 01 20:32:55 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-7fbd7008-f192-404d-9c6b-2d6da4fad87f tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Deleting instance files /opt/stack/data/nova/instances/762fcd08-984b-4341-9e6a-b098e2d14899_del
Aug 01 20:32:55 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-7fbd7008-f192-404d-9c6b-2d6da4fad87f tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Deletion of /opt/stack/data/nova/instances/762fcd08-984b-4341-9e6a-b098e2d14899_del complete
Aug 01 20:32:55 user nova-compute[72504]: INFO nova.compute.manager [None req-7fbd7008-f192-404d-9c6b-2d6da4fad87f tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 01 20:32:55 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-7fbd7008-f192-404d-9c6b-2d6da4fad87f tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:32:55 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:32:55 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:32:56 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:32:56 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Took 0.42 seconds to deallocate network for instance.
Aug 01 20:32:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7fbd7008-f192-404d-9c6b-2d6da4fad87f tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:32:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7fbd7008-f192-404d-9c6b-2d6da4fad87f tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:32:56 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-7fbd7008-f192-404d-9c6b-2d6da4fad87f tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:32:56 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-7fbd7008-f192-404d-9c6b-2d6da4fad87f tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:32:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7fbd7008-f192-404d-9c6b-2d6da4fad87f tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:32:56 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-7fbd7008-f192-404d-9c6b-2d6da4fad87f tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Deleted allocations for instance 762fcd08-984b-4341-9e6a-b098e2d14899
Aug 01 20:32:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7fbd7008-f192-404d-9c6b-2d6da4fad87f tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "762fcd08-984b-4341-9e6a-b098e2d14899" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.597s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:32:56 user nova-compute[72504]: DEBUG nova.compute.manager [req-21ab7cd4-b044-41b8-8886-7411786c6f14 req-f778f50c-cee8-43a6-b803-e5c2bf1bd962 service nova] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Received event network-vif-deleted-27c2be2d-a79f-40f8-b80e-6f83b3ca75c6 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:32:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-ea8badac-485a-4a4b-bcbd-06a079473a08 req-7f6b39e4-2e4b-4d1e-bab9-e5cd417cf1fd service nova] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Received event network-vif-plugged-27c2be2d-a79f-40f8-b80e-6f83b3ca75c6 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:32:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ea8badac-485a-4a4b-bcbd-06a079473a08 req-7f6b39e4-2e4b-4d1e-bab9-e5cd417cf1fd service nova] Acquiring lock "762fcd08-984b-4341-9e6a-b098e2d14899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:32:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ea8badac-485a-4a4b-bcbd-06a079473a08 req-7f6b39e4-2e4b-4d1e-bab9-e5cd417cf1fd service nova] Lock "762fcd08-984b-4341-9e6a-b098e2d14899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:32:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ea8badac-485a-4a4b-bcbd-06a079473a08 req-7f6b39e4-2e4b-4d1e-bab9-e5cd417cf1fd service nova] Lock "762fcd08-984b-4341-9e6a-b098e2d14899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:32:57 user nova-compute[72504]: DEBUG nova.compute.manager [req-ea8badac-485a-4a4b-bcbd-06a079473a08 req-7f6b39e4-2e4b-4d1e-bab9-e5cd417cf1fd service nova] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] No waiting events found dispatching network-vif-plugged-27c2be2d-a79f-40f8-b80e-6f83b3ca75c6 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:32:57 user nova-compute[72504]: WARNING nova.compute.manager [req-ea8badac-485a-4a4b-bcbd-06a079473a08 req-7f6b39e4-2e4b-4d1e-bab9-e5cd417cf1fd service nova] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Received unexpected event network-vif-plugged-27c2be2d-a79f-40f8-b80e-6f83b3ca75c6 for instance with vm_state deleted and task_state None.
Aug 01 20:33:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:00 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:33:01 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:33:01 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:33:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-186d897a-b557-4563-aa0f-26e02aa4fbd4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:33:01 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-186d897a-b557-4563-aa0f-26e02aa4fbd4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:33:01 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:33:02 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Updating instance_info_cache with network_info: [{"id": "424a5b00-62a6-4ef6-86ce-c916150a4908", "address": "fa:16:3e:01:e3:82", "network": {"id": "792d24df-f071-491a-8070-40b1fe36b4ca", "bridge": "br-int", "label": "tempest-TestShelveInstance-979146441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce38c80e818b4b76bc202f9cf7e85dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424a5b00-62", "ovs_interfaceid": "424a5b00-62a6-4ef6-86ce-c916150a4908", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:33:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-186d897a-b557-4563-aa0f-26e02aa4fbd4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:33:02 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:33:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:33:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:33:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:33:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:33:05 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:06 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:33:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:33:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:33:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:33:06 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:33:06 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:33:06 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:33:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:33:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:33:07 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:33:07 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:33:07 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:33:07 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8684MB free_disk=24.97964859008789GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:33:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:33:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:33:07 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 27f71b04-7113-416c-961e-0c1610c45715 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:33:07 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 186d897a-b557-4563-aa0f-26e02aa4fbd4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:33:07 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:33:07 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:33:07 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:33:07 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:33:07 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:33:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:33:10 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690921975.577623, 762fcd08-984b-4341-9e6a-b098e2d14899 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:33:10 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] VM Stopped (Lifecycle Event)
Aug 01 20:33:10 user nova-compute[72504]: DEBUG nova.compute.manager [None req-0e9ce204-b908-40aa-bde4-9a2fcca1d93e None None] [instance: 762fcd08-984b-4341-9e6a-b098e2d14899] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:33:10 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:15 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:19 user nova-compute[72504]: DEBUG nova.compute.manager [req-e85c30c9-9614-4d31-8549-72977c40f103 req-29d7b6a4-0ce6-4e7d-809d-44138d684050 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received event network-changed-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:33:19 user nova-compute[72504]: DEBUG nova.compute.manager [req-e85c30c9-9614-4d31-8549-72977c40f103 req-29d7b6a4-0ce6-4e7d-809d-44138d684050 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Refreshing instance network info cache due to event network-changed-424a5b00-62a6-4ef6-86ce-c916150a4908. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:33:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e85c30c9-9614-4d31-8549-72977c40f103 req-29d7b6a4-0ce6-4e7d-809d-44138d684050 service nova] Acquiring lock "refresh_cache-186d897a-b557-4563-aa0f-26e02aa4fbd4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:33:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e85c30c9-9614-4d31-8549-72977c40f103 req-29d7b6a4-0ce6-4e7d-809d-44138d684050 service nova] Acquired lock "refresh_cache-186d897a-b557-4563-aa0f-26e02aa4fbd4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:33:19 user nova-compute[72504]: DEBUG nova.network.neutron [req-e85c30c9-9614-4d31-8549-72977c40f103 req-29d7b6a4-0ce6-4e7d-809d-44138d684050 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Refreshing network info cache for port 424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:33:20 user nova-compute[72504]: DEBUG nova.network.neutron [req-e85c30c9-9614-4d31-8549-72977c40f103 req-29d7b6a4-0ce6-4e7d-809d-44138d684050 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Updated VIF entry in instance network info cache for port 424a5b00-62a6-4ef6-86ce-c916150a4908. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:33:20 user nova-compute[72504]: DEBUG nova.network.neutron [req-e85c30c9-9614-4d31-8549-72977c40f103 req-29d7b6a4-0ce6-4e7d-809d-44138d684050 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Updating instance_info_cache with network_info: [{"id": "424a5b00-62a6-4ef6-86ce-c916150a4908", "address": "fa:16:3e:01:e3:82", "network": {"id": "792d24df-f071-491a-8070-40b1fe36b4ca", "bridge": "br-int", "label": "tempest-TestShelveInstance-979146441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce38c80e818b4b76bc202f9cf7e85dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424a5b00-62", "ovs_interfaceid": "424a5b00-62a6-4ef6-86ce-c916150a4908", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:33:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-e85c30c9-9614-4d31-8549-72977c40f103 req-29d7b6a4-0ce6-4e7d-809d-44138d684050 service nova] Releasing lock "refresh_cache-186d897a-b557-4563-aa0f-26e02aa4fbd4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:33:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Acquiring lock "186d897a-b557-4563-aa0f-26e02aa4fbd4" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:33:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:33:20 user nova-compute[72504]: INFO nova.compute.manager [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Shelve offloading
Aug 01 20:33:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:20 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Instance destroyed successfully.
Aug 01 20:33:20 user nova-compute[72504]: DEBUG nova.compute.manager [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:33:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Acquiring lock "refresh_cache-186d897a-b557-4563-aa0f-26e02aa4fbd4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:33:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Acquired lock "refresh_cache-186d897a-b557-4563-aa0f-26e02aa4fbd4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:33:20 user nova-compute[72504]: DEBUG nova.network.neutron [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:33:20 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG nova.network.neutron [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Updating instance_info_cache with network_info: [{"id": "424a5b00-62a6-4ef6-86ce-c916150a4908", "address": "fa:16:3e:01:e3:82", "network": {"id": "792d24df-f071-491a-8070-40b1fe36b4ca", "bridge": "br-int", "label": "tempest-TestShelveInstance-979146441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce38c80e818b4b76bc202f9cf7e85dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424a5b00-62", "ovs_interfaceid": "424a5b00-62a6-4ef6-86ce-c916150a4908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Releasing lock "refresh_cache-186d897a-b557-4563-aa0f-26e02aa4fbd4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG nova.compute.manager [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received event network-vif-unplugged-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] Acquiring lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG nova.compute.manager [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] No waiting events found dispatching network-vif-unplugged-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:33:21 user nova-compute[72504]: WARNING nova.compute.manager [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received unexpected event network-vif-unplugged-424a5b00-62a6-4ef6-86ce-c916150a4908 for instance with vm_state active and task_state shelving.
Aug 01 20:33:21 user nova-compute[72504]: DEBUG nova.compute.manager [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received event network-vif-plugged-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] Acquiring lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG nova.compute.manager [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] No waiting events found dispatching network-vif-plugged-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:33:21 user nova-compute[72504]: WARNING nova.compute.manager [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received unexpected event network-vif-plugged-424a5b00-62a6-4ef6-86ce-c916150a4908 for instance with vm_state active and task_state shelving.
Aug 01 20:33:21 user nova-compute[72504]: DEBUG nova.compute.manager [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received event network-vif-plugged-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] Acquiring lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG nova.compute.manager [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] No waiting events found dispatching network-vif-plugged-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:33:21 user nova-compute[72504]: WARNING nova.compute.manager [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received unexpected event network-vif-plugged-424a5b00-62a6-4ef6-86ce-c916150a4908 for instance with vm_state active and task_state shelving.
Aug 01 20:33:21 user nova-compute[72504]: DEBUG nova.compute.manager [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received event network-vif-plugged-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] Acquiring lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG nova.compute.manager [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] No waiting events found dispatching network-vif-plugged-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:33:21 user nova-compute[72504]: WARNING nova.compute.manager [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received unexpected event network-vif-plugged-424a5b00-62a6-4ef6-86ce-c916150a4908 for instance with vm_state active and task_state shelving.
Aug 01 20:33:21 user nova-compute[72504]: DEBUG nova.compute.manager [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received event network-vif-unplugged-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] Acquiring lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG nova.compute.manager [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] No waiting events found dispatching network-vif-unplugged-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:33:21 user nova-compute[72504]: WARNING nova.compute.manager [req-b8fbf67e-8ec3-4dd5-9ad0-6e069dbddeaa req-90e60254-4fee-4ec9-b4a2-cb54ded61f88 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received unexpected event network-vif-unplugged-424a5b00-62a6-4ef6-86ce-c916150a4908 for instance with vm_state active and task_state shelving.
Aug 01 20:33:21 user nova-compute[72504]: DEBUG nova.compute.manager [req-a79cd323-d4c2-4e02-be07-25ca1e27f08e req-4fb81b29-ba04-4558-8a37-4d9fed9e6776 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received event network-vif-unplugged-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a79cd323-d4c2-4e02-be07-25ca1e27f08e req-4fb81b29-ba04-4558-8a37-4d9fed9e6776 service nova] Acquiring lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a79cd323-d4c2-4e02-be07-25ca1e27f08e req-4fb81b29-ba04-4558-8a37-4d9fed9e6776 service nova] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-a79cd323-d4c2-4e02-be07-25ca1e27f08e req-4fb81b29-ba04-4558-8a37-4d9fed9e6776 service nova] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG nova.compute.manager [req-a79cd323-d4c2-4e02-be07-25ca1e27f08e req-4fb81b29-ba04-4558-8a37-4d9fed9e6776 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] No waiting events found dispatching network-vif-unplugged-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:33:21 user nova-compute[72504]: WARNING nova.compute.manager [req-a79cd323-d4c2-4e02-be07-25ca1e27f08e req-4fb81b29-ba04-4558-8a37-4d9fed9e6776 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received unexpected event network-vif-unplugged-424a5b00-62a6-4ef6-86ce-c916150a4908 for instance with vm_state active and task_state shelving.
Aug 01 20:33:21 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Instance destroyed successfully.
Aug 01 20:33:21 user nova-compute[72504]: DEBUG nova.objects.instance [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lazy-loading 'resources' on Instance uuid 186d897a-b557-4563-aa0f-26e02aa4fbd4 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:31:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1642579278',display_name='tempest-TestShelveInstance-server-1642579278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1642579278',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpuG7s0jqI71B8afSxNYy1/BXabWzAKku1KOu6d5796bfaxJZ1lLhEY7CICYoOUv95/Q1IFPq79ii5uPeUjW1sjyMz+cBS5rqVp3t877RxH3AgqgFjZP1TbN1jeZGGbZA==',key_name='tempest-TestShelveInstance-316934371',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:31:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce38c80e818b4b76bc202f9cf7e85dce',ramdisk_id='',reservation_id='r-ly1n1up5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1437414457',owner_user_name='tempest-TestShelveInstance-1437414457-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:31:41Z,user_data=None,user_id='72cd9ab910d04112bfc53a255878e99b',uuid=186d897a-b557-4563-aa0f-26e02aa4fbd4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "424a5b00-62a6-4ef6-86ce-c916150a4908", "address": "fa:16:3e:01:e3:82", "network": {"id": "792d24df-f071-491a-8070-40b1fe36b4ca", "bridge": "br-int", "label": "tempest-TestShelveInstance-979146441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce38c80e818b4b76bc202f9cf7e85dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424a5b00-62", "ovs_interfaceid": "424a5b00-62a6-4ef6-86ce-c916150a4908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Converting VIF {"id": "424a5b00-62a6-4ef6-86ce-c916150a4908", "address": "fa:16:3e:01:e3:82", "network": {"id": "792d24df-f071-491a-8070-40b1fe36b4ca", "bridge": "br-int", "label": "tempest-TestShelveInstance-979146441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce38c80e818b4b76bc202f9cf7e85dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424a5b00-62", "ovs_interfaceid": "424a5b00-62a6-4ef6-86ce-c916150a4908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:e3:82,bridge_name='br-int',has_traffic_filtering=True,id=424a5b00-62a6-4ef6-86ce-c916150a4908,network=Network(792d24df-f071-491a-8070-40b1fe36b4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424a5b00-62') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG os_vif [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:e3:82,bridge_name='br-int',has_traffic_filtering=True,id=424a5b00-62a6-4ef6-86ce-c916150a4908,network=Network(792d24df-f071-491a-8070-40b1fe36b4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424a5b00-62') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap424a5b00-62, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:33:21 user nova-compute[72504]: INFO os_vif [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:e3:82,bridge_name='br-int',has_traffic_filtering=True,id=424a5b00-62a6-4ef6-86ce-c916150a4908,network=Network(792d24df-f071-491a-8070-40b1fe36b4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424a5b00-62')
Aug 01 20:33:21 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EczbQDLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:33:21 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:33:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:33:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[304da94d-d26e-41f3-9a93-6d92cd562463]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a730ce-1ed6-4db4-9b8b-02bfac20321d]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 (non-flash)
Aug 01 20:33:22 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 (non-flash)
Aug 01 20:33:22 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3f45c9ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0'): ({'sdb'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Removing single pathed devices sdb {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21c5fab-5270-4b64-bab7-591fb9beb78e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[22704e9b-fad9-46bd-9d0f-f715a7fb28a3]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Flushing IO for device /dev/sdb {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70253e7-42ed-4527-a3a4-e4964b435f77]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.068s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2974a7e5-65d6-45bf-a4ea-a2ee2bc7a260]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[129c4473-5b3f-4738-825b-0eaae6c5de5f]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9176292-84d2-4d6e-8661-0a582b2d86d0]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0, portal: 172.16.0.220,3260]
Aug 01 20:33:22 user nova-compute[72504]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0, portal: 172.16.0.220,3260] successful.
Aug 01 20:33:22 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2f88f3-0553-44b0-9d0e-24884bc147dc]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] <== disconnect_volume: return (299ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:33:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:33:22 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Deleting instance files /opt/stack/data/nova/instances/186d897a-b557-4563-aa0f-26e02aa4fbd4_del
Aug 01 20:33:22 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Deletion of /opt/stack/data/nova/instances/186d897a-b557-4563-aa0f-26e02aa4fbd4_del complete
Aug 01 20:33:23 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Deleted allocations for instance 186d897a-b557-4563-aa0f-26e02aa4fbd4
Aug 01 20:33:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:33:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:33:23 user nova-compute[72504]: DEBUG nova.objects.instance [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lazy-loading 'numa_topology' on Instance uuid 186d897a-b557-4563-aa0f-26e02aa4fbd4 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:33:23 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:33:23 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:33:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:33:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-0debce7c-e707-44b5-88c8-5d52cf5c3433 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.385s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:33:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:26 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:31 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:35 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690922000.9549763, 186d897a-b557-4563-aa0f-26e02aa4fbd4 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:33:35 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] VM Stopped (Lifecycle Event)
Aug 01 20:33:35 user nova-compute[72504]: DEBUG nova.compute.manager [None req-fd359e08-d66f-45ae-894b-6773f4f84f97 None None] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:33:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:41 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:42 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:33:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:51 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:33:51 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:52 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:33:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:53 user nova-compute[72504]: DEBUG nova.compute.manager [req-f02b4c5b-774a-4c69-a677-d35c04e32445 req-40b53344-0731-4785-afde-c1185703402b service nova] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Received event network-changed-56c55251-4056-41f5-9643-2775e2bc3f46 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:33:53 user nova-compute[72504]: DEBUG nova.compute.manager [req-f02b4c5b-774a-4c69-a677-d35c04e32445 req-40b53344-0731-4785-afde-c1185703402b service nova] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Refreshing instance network info cache due to event network-changed-56c55251-4056-41f5-9643-2775e2bc3f46. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:33:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f02b4c5b-774a-4c69-a677-d35c04e32445 req-40b53344-0731-4785-afde-c1185703402b service nova] Acquiring lock "refresh_cache-27f71b04-7113-416c-961e-0c1610c45715" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:33:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f02b4c5b-774a-4c69-a677-d35c04e32445 req-40b53344-0731-4785-afde-c1185703402b service nova] Acquired lock "refresh_cache-27f71b04-7113-416c-961e-0c1610c45715" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:33:53 user nova-compute[72504]: DEBUG nova.network.neutron [req-f02b4c5b-774a-4c69-a677-d35c04e32445 req-40b53344-0731-4785-afde-c1185703402b service nova] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Refreshing network info cache for port 56c55251-4056-41f5-9643-2775e2bc3f46 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:33:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-17906a55-346a-4007-ac4e-4b2a9636999d tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "27f71b04-7113-416c-961e-0c1610c45715" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:33:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-17906a55-346a-4007-ac4e-4b2a9636999d tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "27f71b04-7113-416c-961e-0c1610c45715" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:33:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-17906a55-346a-4007-ac4e-4b2a9636999d tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "27f71b04-7113-416c-961e-0c1610c45715-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:33:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-17906a55-346a-4007-ac4e-4b2a9636999d tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "27f71b04-7113-416c-961e-0c1610c45715-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:33:53 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-17906a55-346a-4007-ac4e-4b2a9636999d tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "27f71b04-7113-416c-961e-0c1610c45715-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:33:53 user nova-compute[72504]: INFO nova.compute.manager [None req-17906a55-346a-4007-ac4e-4b2a9636999d tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Terminating instance
Aug 01 20:33:53 user nova-compute[72504]: DEBUG nova.compute.manager [None req-17906a55-346a-4007-ac4e-4b2a9636999d tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:33:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:54 user nova-compute[72504]: DEBUG nova.compute.manager [req-8b6be05c-ca1c-45f9-98a3-650827e2eb23 req-1c614fd1-2e79-4712-a412-c5d58116cc18 service nova] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Received event network-vif-unplugged-56c55251-4056-41f5-9643-2775e2bc3f46 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:33:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-8b6be05c-ca1c-45f9-98a3-650827e2eb23 req-1c614fd1-2e79-4712-a412-c5d58116cc18 service nova] Acquiring lock "27f71b04-7113-416c-961e-0c1610c45715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:33:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-8b6be05c-ca1c-45f9-98a3-650827e2eb23 req-1c614fd1-2e79-4712-a412-c5d58116cc18 service nova] Lock "27f71b04-7113-416c-961e-0c1610c45715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:33:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-8b6be05c-ca1c-45f9-98a3-650827e2eb23 req-1c614fd1-2e79-4712-a412-c5d58116cc18 service nova] Lock "27f71b04-7113-416c-961e-0c1610c45715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:33:54 user nova-compute[72504]: DEBUG nova.compute.manager [req-8b6be05c-ca1c-45f9-98a3-650827e2eb23 req-1c614fd1-2e79-4712-a412-c5d58116cc18 service nova] [instance: 27f71b04-7113-416c-961e-0c1610c45715] No waiting events found dispatching network-vif-unplugged-56c55251-4056-41f5-9643-2775e2bc3f46 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:33:54 user nova-compute[72504]: DEBUG nova.compute.manager [req-8b6be05c-ca1c-45f9-98a3-650827e2eb23 req-1c614fd1-2e79-4712-a412-c5d58116cc18 service nova] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Received event network-vif-unplugged-56c55251-4056-41f5-9643-2775e2bc3f46 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:33:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:54 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Instance destroyed successfully.
Aug 01 20:33:54 user nova-compute[72504]: DEBUG nova.objects.instance [None req-17906a55-346a-4007-ac4e-4b2a9636999d tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lazy-loading 'resources' on Instance uuid 27f71b04-7113-416c-961e-0c1610c45715 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:33:54 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-17906a55-346a-4007-ac4e-4b2a9636999d tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1439760497',display_name='tempest-TestStampPattern-server-1439760497',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1439760497',id=49,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdI4LVSFCNR3lCoRwal10ZL6scdIAKC39QaHuvFuFnuwr/NWu42mzRscFZm983YeCIxnd4AhvNYO2SqFRb2qJ3zDi2GZAA4BpoLQqSXZ7AgQYEQbMB3T2D4Kl1fpdT5ig==',key_name='tempest-TestStampPattern-981271227',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:26:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='954dcaf44c2347b597c22547e7234855',ramdisk_id='',reservation_id='r-ruqgqkdg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1951030330',owner_user_name='tempest-TestStampPattern-1951030330-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:29:59Z,user_data=None,user_id='74f57f96a0f3453f91f8bb8554c4e53a',uuid=27f71b04-7113-416c-961e-0c1610c45715,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56c55251-4056-41f5-9643-2775e2bc3f46", "address": "fa:16:3e:ed:b0:63", "network": {"id": "ef0eee7c-6d8a-43f8-b1b0-584de56c03ad", "bridge": "br-int", "label": "tempest-TestStampPattern-741020257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "954dcaf44c2347b597c22547e7234855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c55251-40", "ovs_interfaceid": "56c55251-4056-41f5-9643-2775e2bc3f46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:33:54 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-17906a55-346a-4007-ac4e-4b2a9636999d tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Converting VIF {"id": "56c55251-4056-41f5-9643-2775e2bc3f46", "address": "fa:16:3e:ed:b0:63", "network": {"id": "ef0eee7c-6d8a-43f8-b1b0-584de56c03ad", "bridge": "br-int", "label": "tempest-TestStampPattern-741020257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "954dcaf44c2347b597c22547e7234855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c55251-40", "ovs_interfaceid": "56c55251-4056-41f5-9643-2775e2bc3f46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:33:54 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-17906a55-346a-4007-ac4e-4b2a9636999d tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:b0:63,bridge_name='br-int',has_traffic_filtering=True,id=56c55251-4056-41f5-9643-2775e2bc3f46,network=Network(ef0eee7c-6d8a-43f8-b1b0-584de56c03ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c55251-40') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:33:54 user nova-compute[72504]: DEBUG os_vif [None req-17906a55-346a-4007-ac4e-4b2a9636999d tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:b0:63,bridge_name='br-int',has_traffic_filtering=True,id=56c55251-4056-41f5-9643-2775e2bc3f46,network=Network(ef0eee7c-6d8a-43f8-b1b0-584de56c03ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c55251-40') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:33:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56c55251-40, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:33:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:33:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:33:54 user nova-compute[72504]: INFO os_vif [None req-17906a55-346a-4007-ac4e-4b2a9636999d tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:b0:63,bridge_name='br-int',has_traffic_filtering=True,id=56c55251-4056-41f5-9643-2775e2bc3f46,network=Network(ef0eee7c-6d8a-43f8-b1b0-584de56c03ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c55251-40')
Aug 01 20:33:54 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-17906a55-346a-4007-ac4e-4b2a9636999d tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Deleting instance files /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715_del
Aug 01 20:33:54 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-17906a55-346a-4007-ac4e-4b2a9636999d tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Deletion of /opt/stack/data/nova/instances/27f71b04-7113-416c-961e-0c1610c45715_del complete
Aug 01 20:33:54 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:33:54 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:33:54 user nova-compute[72504]: DEBUG nova.network.neutron [req-f02b4c5b-774a-4c69-a677-d35c04e32445 req-40b53344-0731-4785-afde-c1185703402b service nova] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Updated VIF entry in instance network info cache for port 56c55251-4056-41f5-9643-2775e2bc3f46. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:33:54 user nova-compute[72504]: DEBUG nova.network.neutron [req-f02b4c5b-774a-4c69-a677-d35c04e32445 req-40b53344-0731-4785-afde-c1185703402b service nova] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Updating instance_info_cache with network_info: [{"id": "56c55251-4056-41f5-9643-2775e2bc3f46", "address": "fa:16:3e:ed:b0:63", "network": {"id": "ef0eee7c-6d8a-43f8-b1b0-584de56c03ad", "bridge": "br-int", "label": "tempest-TestStampPattern-741020257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "954dcaf44c2347b597c22547e7234855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c55251-40", "ovs_interfaceid": "56c55251-4056-41f5-9643-2775e2bc3f46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:33:54 user nova-compute[72504]: INFO nova.compute.manager [None req-17906a55-346a-4007-ac4e-4b2a9636999d tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 01 20:33:54 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-17906a55-346a-4007-ac4e-4b2a9636999d tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:33:54 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:33:54 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 27f71b04-7113-416c-961e-0c1610c45715] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:33:54 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f02b4c5b-774a-4c69-a677-d35c04e32445 req-40b53344-0731-4785-afde-c1185703402b service nova] Releasing lock "refresh_cache-27f71b04-7113-416c-961e-0c1610c45715" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:33:55 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:33:55 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Took 0.42 seconds to deallocate network for instance.
Aug 01 20:33:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-17906a55-346a-4007-ac4e-4b2a9636999d tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:33:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-17906a55-346a-4007-ac4e-4b2a9636999d tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:33:55 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-17906a55-346a-4007-ac4e-4b2a9636999d tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:33:55 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-17906a55-346a-4007-ac4e-4b2a9636999d tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:33:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-17906a55-346a-4007-ac4e-4b2a9636999d tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:33:55 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-17906a55-346a-4007-ac4e-4b2a9636999d tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Deleted allocations for instance 27f71b04-7113-416c-961e-0c1610c45715
Aug 01 20:33:55 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-17906a55-346a-4007-ac4e-4b2a9636999d tempest-TestStampPattern-1951030330 tempest-TestStampPattern-1951030330-project-member] Lock "27f71b04-7113-416c-961e-0c1610c45715" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.585s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:33:55 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:33:56 user nova-compute[72504]: DEBUG nova.compute.manager [req-fbf42fa0-031a-4bce-a821-490846cadf55 req-74bcefb7-a17a-430a-8e17-5abfa820c63d service nova] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Received event network-vif-plugged-56c55251-4056-41f5-9643-2775e2bc3f46 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:33:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-fbf42fa0-031a-4bce-a821-490846cadf55 req-74bcefb7-a17a-430a-8e17-5abfa820c63d service nova] Acquiring lock "27f71b04-7113-416c-961e-0c1610c45715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:33:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-fbf42fa0-031a-4bce-a821-490846cadf55 req-74bcefb7-a17a-430a-8e17-5abfa820c63d service nova] Lock "27f71b04-7113-416c-961e-0c1610c45715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:33:56 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-fbf42fa0-031a-4bce-a821-490846cadf55 req-74bcefb7-a17a-430a-8e17-5abfa820c63d service nova] Lock "27f71b04-7113-416c-961e-0c1610c45715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:33:56 user nova-compute[72504]: DEBUG nova.compute.manager [req-fbf42fa0-031a-4bce-a821-490846cadf55 req-74bcefb7-a17a-430a-8e17-5abfa820c63d service nova] [instance: 27f71b04-7113-416c-961e-0c1610c45715] No waiting events found dispatching network-vif-plugged-56c55251-4056-41f5-9643-2775e2bc3f46 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:33:56 user nova-compute[72504]: WARNING nova.compute.manager [req-fbf42fa0-031a-4bce-a821-490846cadf55 req-74bcefb7-a17a-430a-8e17-5abfa820c63d service nova] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Received unexpected event network-vif-plugged-56c55251-4056-41f5-9643-2775e2bc3f46 for instance with vm_state deleted and task_state None.
Aug 01 20:33:56 user nova-compute[72504]: DEBUG nova.compute.manager [req-fbf42fa0-031a-4bce-a821-490846cadf55 req-74bcefb7-a17a-430a-8e17-5abfa820c63d service nova] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Received event network-vif-deleted-56c55251-4056-41f5-9643-2775e2bc3f46 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:33:56 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:33:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:34:00 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:34:01 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:34:01 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:34:01 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 20:34:01 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Didn't find any instances for network info cache update. {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 20:34:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:34:07 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:34:08 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:34:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:34:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:34:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:34:08 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:34:09 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:34:09 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:34:09 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8898MB free_disk=25.103816986083984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:34:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:34:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:34:09 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:34:09 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:34:09 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:34:09 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:34:09 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:34:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:34:09 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690922034.7283974, 27f71b04-7113-416c-961e-0c1610c45715 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:34:09 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 27f71b04-7113-416c-961e-0c1610c45715] VM Stopped (Lifecycle Event)
Aug 01 20:34:09 user nova-compute[72504]: DEBUG nova.compute.manager [None req-cff70f03-4dc6-4b4d-8093-41ea3471d942 None None] [instance: 27f71b04-7113-416c-961e-0c1610c45715] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:34:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:34:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:34:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:34:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:34:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:34:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:34:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:34:42 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:34:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:34:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:34:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:34:52 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:34:53 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:34:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:34:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:34:55 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:34:55 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:34:55 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:34:56 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:34:57 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:34:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:35:01 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:35:01 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:35:01 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 20:35:01 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Didn't find any instances for network info cache update. {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 20:35:02 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:35:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:35:08 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:35:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:35:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:35:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:35:08 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:35:09 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:35:09 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:35:09 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8986MB free_disk=25.102622985839844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:35:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:35:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:35:09 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:35:09 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:35:09 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:35:09 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:35:09 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:35:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.126s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:35:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:35:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Acquiring lock "186d897a-b557-4563-aa0f-26e02aa4fbd4" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:35:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:35:11 user nova-compute[72504]: INFO nova.compute.manager [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Unshelving
Aug 01 20:35:11 user nova-compute[72504]: INFO nova.virt.block_device [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Booting with volume 419d5485-33f6-41fb-8226-3d40993549f0 at /dev/vda
Aug 01 20:35:11 user nova-compute[72504]: DEBUG os_brick.utils [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:35:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:35:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:35:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a82052-93b3-4268-873f-ba9b6dc86d8c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:35:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:35:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:35:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f250c8-eaea-4264-9c57-cd61dd2a442f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:35:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:35:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:35:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e209a8-f901-48e1-a2c0-aaf2dd997564]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:35:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb63ca9-761a-47eb-ab09-b0d3d2d95ecc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:35:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:35:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:35:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:35:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:35:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:35:12 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:35:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7203b5-96fa-4269-8b2f-97ca95dfa52a]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:35:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:35:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:35:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:35:12 user nova-compute[72504]: DEBUG os_brick.utils [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:35:12 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Updating existing volume attachment record: 905ca84c-1f94-4d05-82b7-e73ba5d3056b {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:35:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:35:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:35:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:35:19 user nova-compute[72504]: DEBUG nova.objects.instance [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lazy-loading 'pci_requests' on Instance uuid 186d897a-b557-4563-aa0f-26e02aa4fbd4 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:35:19 user nova-compute[72504]: DEBUG nova.objects.instance [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lazy-loading 'numa_topology' on Instance uuid 186d897a-b557-4563-aa0f-26e02aa4fbd4 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:35:19 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:35:19 user nova-compute[72504]: INFO nova.compute.claims [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Claim successful on node user
Aug 01 20:35:19 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:35:19 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:35:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.224s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:35:19 user nova-compute[72504]: INFO nova.network.neutron [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Updating port 424a5b00-62a6-4ef6-86ce-c916150a4908 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 01 20:35:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Acquiring lock "refresh_cache-186d897a-b557-4563-aa0f-26e02aa4fbd4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Acquired lock "refresh_cache-186d897a-b557-4563-aa0f-26e02aa4fbd4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG nova.network.neutron [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG nova.compute.manager [req-35b9b5c1-293f-43ae-a6f4-a67e5409b804 req-ce42357c-847e-4020-b10a-b2c38504dac6 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received event network-changed-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG nova.compute.manager [req-35b9b5c1-293f-43ae-a6f4-a67e5409b804 req-ce42357c-847e-4020-b10a-b2c38504dac6 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Refreshing instance network info cache due to event network-changed-424a5b00-62a6-4ef6-86ce-c916150a4908. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-35b9b5c1-293f-43ae-a6f4-a67e5409b804 req-ce42357c-847e-4020-b10a-b2c38504dac6 service nova] Acquiring lock "refresh_cache-186d897a-b557-4563-aa0f-26e02aa4fbd4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG nova.network.neutron [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Updating instance_info_cache with network_info: [{"id": "424a5b00-62a6-4ef6-86ce-c916150a4908", "address": "fa:16:3e:01:e3:82", "network": {"id": "792d24df-f071-491a-8070-40b1fe36b4ca", "bridge": "br-int", "label": "tempest-TestShelveInstance-979146441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce38c80e818b4b76bc202f9cf7e85dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424a5b00-62", "ovs_interfaceid": "424a5b00-62a6-4ef6-86ce-c916150a4908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Releasing lock "refresh_cache-186d897a-b557-4563-aa0f-26e02aa4fbd4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:35:20 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Creating image(s)
Aug 01 20:35:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Did not create local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Ensure instance console log exists: /opt/stack/data/nova/instances/186d897a-b557-4563-aa0f-26e02aa4fbd4/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Start _get_guest_xml network_info=[{"id": "424a5b00-62a6-4ef6-86ce-c916150a4908", "address": "fa:16:3e:01:e3:82", "network": {"id": "792d24df-f071-491a-8070-40b1fe36b4ca", "bridge": "br-int", "label": "tempest-TestShelveInstance-979146441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce38c80e818b4b76bc202f9cf7e85dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424a5b00-62", "ovs_interfaceid": "424a5b00-62a6-4ef6-86ce-c916150a4908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EczbQDLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '186d897a-b557-4563-aa0f-26e02aa4fbd4', 'attached_at': '', 'detached_at': '', 'volume_id': '419d5485-33f6-41fb-8226-3d40993549f0', 'serial': '419d5485-33f6-41fb-8226-3d40993549f0'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': '905ca84c-1f94-4d05-82b7-e73ba5d3056b', 'volume_type': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-35b9b5c1-293f-43ae-a6f4-a67e5409b804 req-ce42357c-847e-4020-b10a-b2c38504dac6 service nova] Acquired lock "refresh_cache-186d897a-b557-4563-aa0f-26e02aa4fbd4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG nova.network.neutron [req-35b9b5c1-293f-43ae-a6f4-a67e5409b804 req-ce42357c-847e-4020-b10a-b2c38504dac6 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Refreshing network info cache for port 424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:35:20 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:35:20 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:35:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG nova.objects.instance [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lazy-loading 'vcpu_model' on Instance uuid 186d897a-b557-4563-aa0f-26e02aa4fbd4 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EczbQDLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:35:20 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:35:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:35:20 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:35:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:35:20 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[321dfdbf-b52d-4f40-9bf0-7206c9f6e061]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:35:20 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f433d42c-4780-47f2-9952-5892332d2fc9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0] added
Aug 01 20:35:20 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee32e344-18d4-429a-8d63-7a2751f05533]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[928dee00-bb40-4330-bdb5-a4fc0d92b0aa]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EczbQDLd {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EczbQDLd" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[acecaec1-dc5a-4882-b6d8-fe55d41f5b6c]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EczbQDLd'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e76bcb5-0949-44d8-b7a8-56842f2f524c]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9cdf23-b88a-486c-971f-2c7dd3bb9a3a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 20:35:20 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 20:35:20 user nova-compute[72504]:  {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:35:20 user nova-compute[72504]: WARNING os_brick.initiator.connectors.iscsi [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 20:35:20 user nova-compute[72504]: 
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c6e385-3886-414a-9a84-90ece0ab1710]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0, portal: 172.16.0.220,3260]
Aug 01 20:35:20 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0, portal: 172.16.0.220,3260] successful.
Aug 01 20:35:20 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bf71e4-8eab-492b-9cea-f44b40cdf67f]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7731274-fe57-4180-b872-aa6aced96712]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 (non-flash)
Aug 01 20:35:20 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 (non-flash)
Aug 01 20:35:20 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:35:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:35:21 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:35:21 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bf67d4-7e52-4049-a5d0-2ed3d54ae225]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:35:21 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:35:21 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EczbQDLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:35:21 user nova-compute[72504]: DEBUG nova.network.neutron [req-35b9b5c1-293f-43ae-a6f4-a67e5409b804 req-ce42357c-847e-4020-b10a-b2c38504dac6 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Updated VIF entry in instance network info cache for port 424a5b00-62a6-4ef6-86ce-c916150a4908. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:35:21 user nova-compute[72504]: DEBUG nova.network.neutron [req-35b9b5c1-293f-43ae-a6f4-a67e5409b804 req-ce42357c-847e-4020-b10a-b2c38504dac6 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Updating instance_info_cache with network_info: [{"id": "424a5b00-62a6-4ef6-86ce-c916150a4908", "address": "fa:16:3e:01:e3:82", "network": {"id": "792d24df-f071-491a-8070-40b1fe36b4ca", "bridge": "br-int", "label": "tempest-TestShelveInstance-979146441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce38c80e818b4b76bc202f9cf7e85dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424a5b00-62", "ovs_interfaceid": "424a5b00-62a6-4ef6-86ce-c916150a4908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:35:21 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-35b9b5c1-293f-43ae-a6f4-a67e5409b804 req-ce42357c-847e-4020-b10a-b2c38504dac6 service nova] Releasing lock "refresh_cache-186d897a-b557-4563-aa0f-26e02aa4fbd4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:35:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:35:22 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26533633033613133', 'path': '/dev/sdb'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:35:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533633033613133', 'path': '/dev/sdb'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:35:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T20:31:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1642579278',display_name='tempest-TestShelveInstance-server-1642579278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1642579278',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-316934371',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:31:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ce38c80e818b4b76bc202f9cf7e85dce',ramdisk_id='',reservation_id='r-ly1n1up5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1437414457',owner_user_name='tempest-TestShelveInstance-1437414457-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:35:12Z,user_data=None,user_id='72cd9ab910d04112bfc53a255878e99b',uuid=186d897a-b557-4563-aa0f-26e02aa4fbd4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "424a5b00-62a6-4ef6-86ce-c916150a4908", "address": "fa:16:3e:01:e3:82", "network": {"id": "792d24df-f071-491a-8070-40b1fe36b4ca", "bridge": "br-int", "label": "tempest-TestShelveInstance-979146441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce38c80e818b4b76bc202f9cf7e85dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424a5b00-62", "ovs_interfaceid": "424a5b00-62a6-4ef6-86ce-c916150a4908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:35:22 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Converting VIF {"id": "424a5b00-62a6-4ef6-86ce-c916150a4908", "address": "fa:16:3e:01:e3:82", "network": {"id": "792d24df-f071-491a-8070-40b1fe36b4ca", "bridge": "br-int", "label": "tempest-TestShelveInstance-979146441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce38c80e818b4b76bc202f9cf7e85dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424a5b00-62", "ovs_interfaceid": "424a5b00-62a6-4ef6-86ce-c916150a4908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:35:22 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:e3:82,bridge_name='br-int',has_traffic_filtering=True,id=424a5b00-62a6-4ef6-86ce-c916150a4908,network=Network(792d24df-f071-491a-8070-40b1fe36b4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424a5b00-62') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:35:22 user nova-compute[72504]: DEBUG nova.objects.instance [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lazy-loading 'pci_devices' on Instance uuid 186d897a-b557-4563-aa0f-26e02aa4fbd4 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:35:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:35:22 user nova-compute[72504]:   <uuid>186d897a-b557-4563-aa0f-26e02aa4fbd4</uuid>
Aug 01 20:35:22 user nova-compute[72504]:   <name>instance-00000033</name>
Aug 01 20:35:22 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:35:22 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:35:22 user nova-compute[72504]:   <metadata>
Aug 01 20:35:22 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:35:22 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:35:22 user nova-compute[72504]:       <nova:name>tempest-TestShelveInstance-server-1642579278</nova:name>
Aug 01 20:35:22 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:35:20</nova:creationTime>
Aug 01 20:35:22 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:35:22 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:35:22 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:35:22 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:35:22 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:35:22 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:35:22 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:35:22 user nova-compute[72504]:       <nova:owner>
Aug 01 20:35:22 user nova-compute[72504]:         <nova:user uuid="72cd9ab910d04112bfc53a255878e99b">tempest-TestShelveInstance-1437414457-project-member</nova:user>
Aug 01 20:35:22 user nova-compute[72504]:         <nova:project uuid="ce38c80e818b4b76bc202f9cf7e85dce">tempest-TestShelveInstance-1437414457</nova:project>
Aug 01 20:35:22 user nova-compute[72504]:       </nova:owner>
Aug 01 20:35:22 user nova-compute[72504]:       <nova:ports>
Aug 01 20:35:22 user nova-compute[72504]:         <nova:port uuid="424a5b00-62a6-4ef6-86ce-c916150a4908">
Aug 01 20:35:22 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 20:35:22 user nova-compute[72504]:         </nova:port>
Aug 01 20:35:22 user nova-compute[72504]:       </nova:ports>
Aug 01 20:35:22 user nova-compute[72504]:     </nova:instance>
Aug 01 20:35:22 user nova-compute[72504]:   </metadata>
Aug 01 20:35:22 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:35:22 user nova-compute[72504]:     <system>
Aug 01 20:35:22 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:35:22 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:35:22 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:35:22 user nova-compute[72504]:       <entry name="serial">186d897a-b557-4563-aa0f-26e02aa4fbd4</entry>
Aug 01 20:35:22 user nova-compute[72504]:       <entry name="uuid">186d897a-b557-4563-aa0f-26e02aa4fbd4</entry>
Aug 01 20:35:22 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:35:22 user nova-compute[72504]:     </system>
Aug 01 20:35:22 user nova-compute[72504]:   </sysinfo>
Aug 01 20:35:22 user nova-compute[72504]:   <os>
Aug 01 20:35:22 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:35:22 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:35:22 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:35:22 user nova-compute[72504]:   </os>
Aug 01 20:35:22 user nova-compute[72504]:   <features>
Aug 01 20:35:22 user nova-compute[72504]:     <acpi/>
Aug 01 20:35:22 user nova-compute[72504]:     <apic/>
Aug 01 20:35:22 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:35:22 user nova-compute[72504]:   </features>
Aug 01 20:35:22 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:35:22 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:35:22 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:35:22 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:35:22 user nova-compute[72504]:   </clock>
Aug 01 20:35:22 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:35:22 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:35:22 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:35:22 user nova-compute[72504]:   </cpu>
Aug 01 20:35:22 user nova-compute[72504]:   <devices>
Aug 01 20:35:22 user nova-compute[72504]:     <disk type="block" device="disk">
Aug 01 20:35:22 user nova-compute[72504]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:35:22 user nova-compute[72504]:       <source dev="/dev/sdb"/>
Aug 01 20:35:22 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:35:22 user nova-compute[72504]:       <serial>419d5485-33f6-41fb-8226-3d40993549f0</serial>
Aug 01 20:35:22 user nova-compute[72504]:     </disk>
Aug 01 20:35:22 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:35:22 user nova-compute[72504]:       <mac address="fa:16:3e:01:e3:82"/>
Aug 01 20:35:22 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:35:22 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:35:22 user nova-compute[72504]:       <target dev="tap424a5b00-62"/>
Aug 01 20:35:22 user nova-compute[72504]:     </interface>
Aug 01 20:35:22 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:35:22 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/186d897a-b557-4563-aa0f-26e02aa4fbd4/console.log" append="off"/>
Aug 01 20:35:22 user nova-compute[72504]:     </serial>
Aug 01 20:35:22 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:35:22 user nova-compute[72504]:     <video>
Aug 01 20:35:22 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:35:22 user nova-compute[72504]:     </video>
Aug 01 20:35:22 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:35:22 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:35:22 user nova-compute[72504]:     </rng>
Aug 01 20:35:22 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:35:22 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:35:22 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:35:22 user nova-compute[72504]:     </memballoon>
Aug 01 20:35:22 user nova-compute[72504]:   </devices>
Aug 01 20:35:22 user nova-compute[72504]: </domain>
Aug 01 20:35:22 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:35:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T20:31:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1642579278',display_name='tempest-TestShelveInstance-server-1642579278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1642579278',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-316934371',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:31:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ce38c80e818b4b76bc202f9cf7e85dce',ramdisk_id='',reservation_id='r-ly1n1up5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1437414457',owner_user_name='tempest-TestShelveInstance-1437414457-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:35:12Z,user_data=None,user_id='72cd9ab910d04112bfc53a255878e99b',uuid=186d897a-b557-4563-aa0f-26e02aa4fbd4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "424a5b00-62a6-4ef6-86ce-c916150a4908", "address": "fa:16:3e:01:e3:82", "network": {"id": "792d24df-f071-491a-8070-40b1fe36b4ca", "bridge": "br-int", "label": "tempest-TestShelveInstance-979146441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce38c80e818b4b76bc202f9cf7e85dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424a5b00-62", "ovs_interfaceid": "424a5b00-62a6-4ef6-86ce-c916150a4908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:35:22 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Converting VIF {"id": "424a5b00-62a6-4ef6-86ce-c916150a4908", "address": "fa:16:3e:01:e3:82", "network": {"id": "792d24df-f071-491a-8070-40b1fe36b4ca", "bridge": "br-int", "label": "tempest-TestShelveInstance-979146441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce38c80e818b4b76bc202f9cf7e85dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424a5b00-62", "ovs_interfaceid": "424a5b00-62a6-4ef6-86ce-c916150a4908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:35:22 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:e3:82,bridge_name='br-int',has_traffic_filtering=True,id=424a5b00-62a6-4ef6-86ce-c916150a4908,network=Network(792d24df-f071-491a-8070-40b1fe36b4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424a5b00-62') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:35:22 user nova-compute[72504]: DEBUG os_vif [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:e3:82,bridge_name='br-int',has_traffic_filtering=True,id=424a5b00-62a6-4ef6-86ce-c916150a4908,network=Network(792d24df-f071-491a-8070-40b1fe36b4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424a5b00-62') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:35:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:35:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:35:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:35:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:35:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap424a5b00-62, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:35:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap424a5b00-62, col_values=(('external_ids', {'iface-id': '424a5b00-62a6-4ef6-86ce-c916150a4908', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:e3:82', 'vm-uuid': '186d897a-b557-4563-aa0f-26e02aa4fbd4'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:35:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:35:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:35:22 user nova-compute[72504]: INFO os_vif [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:e3:82,bridge_name='br-int',has_traffic_filtering=True,id=424a5b00-62a6-4ef6-86ce-c916150a4908,network=Network(792d24df-f071-491a-8070-40b1fe36b4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424a5b00-62')
Aug 01 20:35:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:35:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] No VIF found with MAC fa:16:3e:01:e3:82, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:35:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:35:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:35:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:35:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:35:23 user nova-compute[72504]: DEBUG nova.compute.manager [req-f086ec6e-19d8-4872-9edd-3b149f67a073 req-4fa3b4d9-7a47-4fec-870c-560d94161a8a service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received event network-vif-plugged-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:35:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f086ec6e-19d8-4872-9edd-3b149f67a073 req-4fa3b4d9-7a47-4fec-870c-560d94161a8a service nova] Acquiring lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:35:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f086ec6e-19d8-4872-9edd-3b149f67a073 req-4fa3b4d9-7a47-4fec-870c-560d94161a8a service nova] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:35:23 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-f086ec6e-19d8-4872-9edd-3b149f67a073 req-4fa3b4d9-7a47-4fec-870c-560d94161a8a service nova] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:35:23 user nova-compute[72504]: DEBUG nova.compute.manager [req-f086ec6e-19d8-4872-9edd-3b149f67a073 req-4fa3b4d9-7a47-4fec-870c-560d94161a8a service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] No waiting events found dispatching network-vif-plugged-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:35:23 user nova-compute[72504]: WARNING nova.compute.manager [req-f086ec6e-19d8-4872-9edd-3b149f67a073 req-4fa3b4d9-7a47-4fec-870c-560d94161a8a service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received unexpected event network-vif-plugged-424a5b00-62a6-4ef6-86ce-c916150a4908 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 20:35:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:35:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:35:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:35:25 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690922125.4519677, 186d897a-b557-4563-aa0f-26e02aa4fbd4 => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:35:25 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] VM Resumed (Lifecycle Event)
Aug 01 20:35:25 user nova-compute[72504]: DEBUG nova.compute.manager [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:35:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:35:25 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Instance spawned successfully.
Aug 01 20:35:25 user nova-compute[72504]: DEBUG nova.compute.manager [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:35:25 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:35:25 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:35:25 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:35:25 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690922125.4534554, 186d897a-b557-4563-aa0f-26e02aa4fbd4 => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:35:25 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] VM Started (Lifecycle Event)
Aug 01 20:35:25 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:35:25 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:35:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-b863ff21-1c91-464c-a235-ac3106127fd2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.734s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:35:25 user nova-compute[72504]: DEBUG nova.compute.manager [req-7c81fc9f-028f-4711-b080-588a1aa7eea6 req-2ffcca6f-9385-43be-a2fb-5bab32863c43 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received event network-vif-plugged-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:35:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7c81fc9f-028f-4711-b080-588a1aa7eea6 req-2ffcca6f-9385-43be-a2fb-5bab32863c43 service nova] Acquiring lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:35:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7c81fc9f-028f-4711-b080-588a1aa7eea6 req-2ffcca6f-9385-43be-a2fb-5bab32863c43 service nova] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:35:25 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-7c81fc9f-028f-4711-b080-588a1aa7eea6 req-2ffcca6f-9385-43be-a2fb-5bab32863c43 service nova] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:35:25 user nova-compute[72504]: DEBUG nova.compute.manager [req-7c81fc9f-028f-4711-b080-588a1aa7eea6 req-2ffcca6f-9385-43be-a2fb-5bab32863c43 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] No waiting events found dispatching network-vif-plugged-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:35:25 user nova-compute[72504]: WARNING nova.compute.manager [req-7c81fc9f-028f-4711-b080-588a1aa7eea6 req-2ffcca6f-9385-43be-a2fb-5bab32863c43 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received unexpected event network-vif-plugged-424a5b00-62a6-4ef6-86ce-c916150a4908 for instance with vm_state active and task_state None.
Aug 01 20:35:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:35:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:35:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:35:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:35:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:35:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:35:42 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:35:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:35:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:35:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:35:51 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:35:51 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Cleaning up deleted instances {{(pid=72504) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 20:35:51 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] There are 0 instances to clean {{(pid=72504) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 20:35:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:35:53 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:35:53 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:35:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:35:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:35:57 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:35:57 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:35:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:35:58 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:36:01 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:36:01 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:36:01 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 20:36:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:36:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-186d897a-b557-4563-aa0f-26e02aa4fbd4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:36:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-186d897a-b557-4563-aa0f-26e02aa4fbd4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:36:02 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:36:02 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lazy-loading 'info_cache' on Instance uuid 186d897a-b557-4563-aa0f-26e02aa4fbd4 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:36:02 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Updating instance_info_cache with network_info: [{"id": "424a5b00-62a6-4ef6-86ce-c916150a4908", "address": "fa:16:3e:01:e3:82", "network": {"id": "792d24df-f071-491a-8070-40b1fe36b4ca", "bridge": "br-int", "label": "tempest-TestShelveInstance-979146441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce38c80e818b4b76bc202f9cf7e85dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424a5b00-62", "ovs_interfaceid": "424a5b00-62a6-4ef6-86ce-c916150a4908", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:36:02 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-186d897a-b557-4563-aa0f-26e02aa4fbd4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:36:02 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:36:04 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:36:07 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:36:07 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:36:08 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:36:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:36:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:36:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:36:08 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:36:08 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:36:09 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:36:09 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:36:09 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8831MB free_disk=25.10103988647461GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:36:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:36:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:36:09 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance 186d897a-b557-4563-aa0f-26e02aa4fbd4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:36:09 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:36:09 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:36:09 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:36:09 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:36:09 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:36:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:36:12 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:36:17 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:36:18 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:36:22 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:36:27 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:36:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:36:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:36:37 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:36:37 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72504) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 20:36:42 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:36:43 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:36:47 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:36:52 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:36:53 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:36:54 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:36:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:36:57 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:36:57 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Triggering sync for uuid 186d897a-b557-4563-aa0f-26e02aa4fbd4 {{(pid=72504) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 20:36:57 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "186d897a-b557-4563-aa0f-26e02aa4fbd4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:36:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:36:58 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:36:58 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:36:59 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:36:59 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:36:59 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:37:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:37:02 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-74ca868e-c05a-43b6-8ca4-cda21f8886a0 req-92566ef5-02c0-494f-b7a8-eaa2cba6a4b9 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received event network-changed-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-74ca868e-c05a-43b6-8ca4-cda21f8886a0 req-92566ef5-02c0-494f-b7a8-eaa2cba6a4b9 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Refreshing instance network info cache due to event network-changed-424a5b00-62a6-4ef6-86ce-c916150a4908. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-74ca868e-c05a-43b6-8ca4-cda21f8886a0 req-92566ef5-02c0-494f-b7a8-eaa2cba6a4b9 service nova] Acquiring lock "refresh_cache-186d897a-b557-4563-aa0f-26e02aa4fbd4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-74ca868e-c05a-43b6-8ca4-cda21f8886a0 req-92566ef5-02c0-494f-b7a8-eaa2cba6a4b9 service nova] Acquired lock "refresh_cache-186d897a-b557-4563-aa0f-26e02aa4fbd4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG nova.network.neutron [req-74ca868e-c05a-43b6-8ca4-cda21f8886a0 req-92566ef5-02c0-494f-b7a8-eaa2cba6a4b9 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Refreshing network info cache for port 424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Acquiring lock "186d897a-b557-4563-aa0f-26e02aa4fbd4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Acquiring lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:37:03 user nova-compute[72504]: INFO nova.compute.manager [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Terminating instance
Aug 01 20:37:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-15abed9c-ce6c-4be2-a605-2c15061d5095 req-dd3ff3cb-b162-4b82-b476-219ba822f1ed service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received event network-vif-unplugged-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-15abed9c-ce6c-4be2-a605-2c15061d5095 req-dd3ff3cb-b162-4b82-b476-219ba822f1ed service nova] Acquiring lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-15abed9c-ce6c-4be2-a605-2c15061d5095 req-dd3ff3cb-b162-4b82-b476-219ba822f1ed service nova] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-15abed9c-ce6c-4be2-a605-2c15061d5095 req-dd3ff3cb-b162-4b82-b476-219ba822f1ed service nova] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-15abed9c-ce6c-4be2-a605-2c15061d5095 req-dd3ff3cb-b162-4b82-b476-219ba822f1ed service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] No waiting events found dispatching network-vif-unplugged-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG nova.compute.manager [req-15abed9c-ce6c-4be2-a605-2c15061d5095 req-dd3ff3cb-b162-4b82-b476-219ba822f1ed service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received event network-vif-unplugged-424a5b00-62a6-4ef6-86ce-c916150a4908 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG nova.network.neutron [req-74ca868e-c05a-43b6-8ca4-cda21f8886a0 req-92566ef5-02c0-494f-b7a8-eaa2cba6a4b9 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Updated VIF entry in instance network info cache for port 424a5b00-62a6-4ef6-86ce-c916150a4908. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG nova.network.neutron [req-74ca868e-c05a-43b6-8ca4-cda21f8886a0 req-92566ef5-02c0-494f-b7a8-eaa2cba6a4b9 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Updating instance_info_cache with network_info: [{"id": "424a5b00-62a6-4ef6-86ce-c916150a4908", "address": "fa:16:3e:01:e3:82", "network": {"id": "792d24df-f071-491a-8070-40b1fe36b4ca", "bridge": "br-int", "label": "tempest-TestShelveInstance-979146441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce38c80e818b4b76bc202f9cf7e85dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424a5b00-62", "ovs_interfaceid": "424a5b00-62a6-4ef6-86ce-c916150a4908", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-74ca868e-c05a-43b6-8ca4-cda21f8886a0 req-92566ef5-02c0-494f-b7a8-eaa2cba6a4b9 service nova] Releasing lock "refresh_cache-186d897a-b557-4563-aa0f-26e02aa4fbd4" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Skipping network cache update for instance because it is being deleted. {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Didn't find any instances for network info cache update. {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 20:37:03 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Instance destroyed successfully.
Aug 01 20:37:03 user nova-compute[72504]: DEBUG nova.objects.instance [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lazy-loading 'resources' on Instance uuid 186d897a-b557-4563-aa0f-26e02aa4fbd4 {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T20:31:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1642579278',display_name='tempest-TestShelveInstance-server-1642579278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1642579278',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpuG7s0jqI71B8afSxNYy1/BXabWzAKku1KOu6d5796bfaxJZ1lLhEY7CICYoOUv95/Q1IFPq79ii5uPeUjW1sjyMz+cBS5rqVp3t877RxH3AgqgFjZP1TbN1jeZGGbZA==',key_name='tempest-TestShelveInstance-316934371',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:35:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce38c80e818b4b76bc202f9cf7e85dce',ramdisk_id='',reservation_id='r-ly1n1up5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1437414457',owner_user_name='tempest-TestShelveInstance-1437414457-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:35:26Z,user_data=None,user_id='72cd9ab910d04112bfc53a255878e99b',uuid=186d897a-b557-4563-aa0f-26e02aa4fbd4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "424a5b00-62a6-4ef6-86ce-c916150a4908", "address": "fa:16:3e:01:e3:82", "network": {"id": "792d24df-f071-491a-8070-40b1fe36b4ca", "bridge": "br-int", "label": "tempest-TestShelveInstance-979146441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce38c80e818b4b76bc202f9cf7e85dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424a5b00-62", "ovs_interfaceid": "424a5b00-62a6-4ef6-86ce-c916150a4908", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Converting VIF {"id": "424a5b00-62a6-4ef6-86ce-c916150a4908", "address": "fa:16:3e:01:e3:82", "network": {"id": "792d24df-f071-491a-8070-40b1fe36b4ca", "bridge": "br-int", "label": "tempest-TestShelveInstance-979146441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce38c80e818b4b76bc202f9cf7e85dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424a5b00-62", "ovs_interfaceid": "424a5b00-62a6-4ef6-86ce-c916150a4908", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:e3:82,bridge_name='br-int',has_traffic_filtering=True,id=424a5b00-62a6-4ef6-86ce-c916150a4908,network=Network(792d24df-f071-491a-8070-40b1fe36b4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424a5b00-62') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG os_vif [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:e3:82,bridge_name='br-int',has_traffic_filtering=True,id=424a5b00-62a6-4ef6-86ce-c916150a4908,network=Network(792d24df-f071-491a-8070-40b1fe36b4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424a5b00-62') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap424a5b00-62, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:37:03 user nova-compute[72504]: INFO os_vif [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:e3:82,bridge_name='br-int',has_traffic_filtering=True,id=424a5b00-62a6-4ef6-86ce-c916150a4908,network=Network(792d24df-f071-491a-8070-40b1fe36b4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424a5b00-62')
Aug 01 20:37:03 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EczbQDLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:37:03 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:37:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f262a1-9398-451d-9edb-395bd82ae361]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa87d2f6-4f1a-42e4-b6d6-0ba24f7ac088]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 (non-flash)
Aug 01 20:37:03 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 (non-flash)
Aug 01 20:37:03 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff40c128820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0'): ({'sdb'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Removing single pathed devices sdb {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:37:03 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55a5b89-eddc-464d-a02f-d1b631cdcac1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b87b78-4ab0-4283-bd48-325b0cb5a46c]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Flushing IO for device /dev/sdb {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f299ec26-f4c0-49b6-938d-bb929cd98056]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.065s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b40125-7c76-4f46-bbf8-601b27556cb9]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d20da6a-f423-4e0e-bb42-11e0548f0716]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb970ee5-0249-4371-bcc3-1831b5f198e6]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0, portal: 172.16.0.220,3260]
Aug 01 20:37:04 user nova-compute[72504]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0, portal: 172.16.0.220,3260] successful.
Aug 01 20:37:04 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419d5485-33f6-41fb-8226-3d40993549f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2863786a-595e-4688-9643-bf7330cdb489]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] <== disconnect_volume: return (306ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:37:04 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Deleting instance files /opt/stack/data/nova/instances/186d897a-b557-4563-aa0f-26e02aa4fbd4_del
Aug 01 20:37:04 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Deletion of /opt/stack/data/nova/instances/186d897a-b557-4563-aa0f-26e02aa4fbd4_del complete
Aug 01 20:37:04 user nova-compute[72504]: INFO nova.compute.manager [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 01 20:37:04 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:37:04 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:37:05 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:37:05 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Took 0.72 seconds to deallocate network for instance.
Aug 01 20:37:05 user nova-compute[72504]: DEBUG nova.compute.manager [req-6cf07816-7e7f-4644-ad76-f0245249848a req-c1192db9-b277-4d6d-887d-7dfeb69d72a0 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received event network-vif-deleted-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:37:05 user nova-compute[72504]: DEBUG nova.compute.manager [req-923ef62b-f966-406a-a7aa-81ab3111d91e req-20facd2b-9b00-4880-b1ca-e5b53cc0b128 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received event network-vif-plugged-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:37:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-923ef62b-f966-406a-a7aa-81ab3111d91e req-20facd2b-9b00-4880-b1ca-e5b53cc0b128 service nova] Acquiring lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:37:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-923ef62b-f966-406a-a7aa-81ab3111d91e req-20facd2b-9b00-4880-b1ca-e5b53cc0b128 service nova] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:37:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-923ef62b-f966-406a-a7aa-81ab3111d91e req-20facd2b-9b00-4880-b1ca-e5b53cc0b128 service nova] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:37:05 user nova-compute[72504]: DEBUG nova.compute.manager [req-923ef62b-f966-406a-a7aa-81ab3111d91e req-20facd2b-9b00-4880-b1ca-e5b53cc0b128 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] No waiting events found dispatching network-vif-plugged-424a5b00-62a6-4ef6-86ce-c916150a4908 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:37:05 user nova-compute[72504]: WARNING nova.compute.manager [req-923ef62b-f966-406a-a7aa-81ab3111d91e req-20facd2b-9b00-4880-b1ca-e5b53cc0b128 service nova] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Received unexpected event network-vif-plugged-424a5b00-62a6-4ef6-86ce-c916150a4908 for instance with vm_state active and task_state deleting.
Aug 01 20:37:05 user nova-compute[72504]: INFO nova.compute.manager [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Took 0.75 seconds to detach 1 volumes for instance.
Aug 01 20:37:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Deleting volume: 419d5485-33f6-41fb-8226-3d40993549f0 {{(pid=72504) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 20:37:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:37:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:37:06 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:37:06 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:37:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.209s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:37:06 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Deleted allocations for instance 186d897a-b557-4563-aa0f-26e02aa4fbd4
Aug 01 20:37:06 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-73420dde-f03b-4e21-80fd-cce3679999d2 tempest-TestShelveInstance-1437414457 tempest-TestShelveInstance-1437414457-project-member] Lock "186d897a-b557-4563-aa0f-26e02aa4fbd4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.130s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:37:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:37:09 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:37:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:37:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:37:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:37:09 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:37:10 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:37:10 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:37:10 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8964MB free_disk=25.100242614746094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:37:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:37:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:37:10 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:37:10 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:37:10 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Refreshing inventories for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 20:37:10 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Updating ProviderTree inventory for provider b951a798-e88c-472c-8347-2c5f6a05d47c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 20:37:10 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Updating inventory in ProviderTree for provider b951a798-e88c-472c-8347-2c5f6a05d47c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 20:37:10 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Refreshing aggregate associations for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c, aggregates: None {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 20:37:10 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Refreshing trait associations for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c, traits: HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 20:37:10 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:37:10 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:37:10 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:37:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.299s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:37:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:37:18 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690922223.8829482, 186d897a-b557-4563-aa0f-26e02aa4fbd4 => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:37:18 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] VM Stopped (Lifecycle Event)
Aug 01 20:37:18 user nova-compute[72504]: DEBUG nova.compute.manager [None req-a61ef615-49b4-4ead-9356-b99b7700ab17 None None] [instance: 186d897a-b557-4563-aa0f-26e02aa4fbd4] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:37:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:37:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:37:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:37:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:37:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:37:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:37:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:37:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:37:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:37:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:37:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:37:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:37:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:37:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:37:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:37:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:37:46 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:37:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:37:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:37:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:37:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:37:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:37:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:37:53 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:37:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:37:56 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:37:57 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:37:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:37:59 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:37:59 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:38:00 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:38:00 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:38:00 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:04 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:38:05 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:38:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:38:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 20:38:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Didn't find any instances for network info cache update. {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 20:38:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:38:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:38:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:38:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:38:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:09 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:38:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:38:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:38:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:38:09 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:38:10 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:38:10 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:38:10 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=9049MB free_disk=25.09484100341797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:38:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:38:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:38:10 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:38:10 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:38:10 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:38:10 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:38:10 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:38:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.111s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:38:11 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:38:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:38:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:32 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:36 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:38:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:38:45 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Starting instance... {{(pid=72504) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 20:38:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:38:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:38:45 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72504) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 20:38:45 user nova-compute[72504]: INFO nova.compute.claims [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Claim successful on node user
Aug 01 20:38:45 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:38:45 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:38:45 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.324s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:38:46 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Start building networks asynchronously for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 20:38:46 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Allocating IP information in the background. {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 20:38:46 user nova-compute[72504]: DEBUG nova.network.neutron [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] allocate_for_instance() {{(pid=72504) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 20:38:46 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 20:38:46 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Start building block device mappings for instance. {{(pid=72504) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 20:38:46 user nova-compute[72504]: DEBUG nova.policy [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf8f02d29dda43559e81ac57aea60a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50747fa9b7f4bfaa00f791648e6bb11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72504) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 20:38:46 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Start spawning the instance on the hypervisor. {{(pid=72504) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 20:38:46 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Creating instance directory {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 20:38:46 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Creating image(s)
Aug 01 20:38:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "/opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:38:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "/opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:38:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "/opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:38:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:38:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.173s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:38:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "906578d509ea230f2ca13807fee3df330cb039c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:38:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:38:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:38:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.195s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:38:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk 1073741824 {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:38:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5,backing_fmt=raw /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk 1073741824" returned: 0 in 0.066s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:38:46 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "906578d509ea230f2ca13807fee3df330cb039c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:38:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:38:46 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:38:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/906578d509ea230f2ca13807fee3df330cb039c5 --force-share --output=json" returned: 0 in 0.178s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:38:46 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk. size=1073741824 {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 20:38:46 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:38:47 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:38:47 user nova-compute[72504]: DEBUG nova.virt.disk.api [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Cannot resize image /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk to a smaller size. {{(pid=72504) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 20:38:47 user nova-compute[72504]: DEBUG nova.objects.instance [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lazy-loading 'migration_context' on Instance uuid e416f888-2093-4bc2-99c8-bc5f62a4d06d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:38:47 user nova-compute[72504]: DEBUG nova.network.neutron [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Successfully created port: 69d142c3-a14a-47c8-9c0c-37f166ae1355 {{(pid=72504) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 20:38:47 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Created local disks {{(pid=72504) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 20:38:47 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Ensure instance console log exists: /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/console.log {{(pid=72504) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 20:38:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:38:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:38:47 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.network.neutron [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Successfully updated port: 69d142c3-a14a-47c8-9c0c-37f166ae1355 {{(pid=72504) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquired lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.network.neutron [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Building network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.network.neutron [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Instance cache missing network info. {{(pid=72504) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.compute.manager [req-2c56c020-e5f3-4966-b379-8aa0e487e879 req-86ec7277-41b9-42b1-bd74-a94ca8431faa service nova] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Received event network-changed-69d142c3-a14a-47c8-9c0c-37f166ae1355 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.compute.manager [req-2c56c020-e5f3-4966-b379-8aa0e487e879 req-86ec7277-41b9-42b1-bd74-a94ca8431faa service nova] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Refreshing instance network info cache due to event network-changed-69d142c3-a14a-47c8-9c0c-37f166ae1355. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2c56c020-e5f3-4966-b379-8aa0e487e879 req-86ec7277-41b9-42b1-bd74-a94ca8431faa service nova] Acquiring lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.network.neutron [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Updating instance_info_cache with network_info: [{"id": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "address": "fa:16:3e:e2:6c:cd", "network": {"id": "9cf1b4e4-7f56-4588-a148-3ce6993fb7bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-133441995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c50747fa9b7f4bfaa00f791648e6bb11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d142c3-a1", "ovs_interfaceid": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Releasing lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Instance network_info: |[{"id": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "address": "fa:16:3e:e2:6c:cd", "network": {"id": "9cf1b4e4-7f56-4588-a148-3ce6993fb7bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-133441995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c50747fa9b7f4bfaa00f791648e6bb11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d142c3-a1", "ovs_interfaceid": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72504) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2c56c020-e5f3-4966-b379-8aa0e487e879 req-86ec7277-41b9-42b1-bd74-a94ca8431faa service nova] Acquired lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.network.neutron [req-2c56c020-e5f3-4966-b379-8aa0e487e879 req-86ec7277-41b9-42b1-bd74-a94ca8431faa service nova] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Refreshing network info cache for port 69d142c3-a14a-47c8-9c0c-37f166ae1355 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Start _get_guest_xml network_info=[{"id": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "address": "fa:16:3e:e2:6c:cd", "network": {"id": "9cf1b4e4-7f56-4588-a148-3ce6993fb7bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-133441995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c50747fa9b7f4bfaa00f791648e6bb11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d142c3-a1", "ovs_interfaceid": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'size': 0, 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '3f5e9e2d-95fb-46b2-b205-6c41a2b0b089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 20:38:48 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:38:48 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] CPU controller missing on host. {{(pid=72504) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.host [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] CPU controller found on host. {{(pid=72504) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72504) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T19:45:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T19:45:36Z,direct_url=<?>,disk_format='qcow2',id=3f5e9e2d-95fb-46b2-b205-6c41a2b0b089,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1f3ccc9682a3432089e1cf9400f15af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T19:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Flavor limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Image limits 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Flavor pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Image pref 0:0:0 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72504) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Got 1 possible topologies {{(pid=72504) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.virt.hardware [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72504) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:38:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1143692478',display_name='tempest-SnapshotDataIntegrityTests-server-1143692478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1143692478',id=52,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3JWWNoHxQu8NzWqGkrQ1x/vzh0KDAoETAwBgXiU4rFa6CpcNZnixVMjA+EX5Xz2hu+VZ6Z4h14tRkPA86R6fo7snsjX9ejw9Tz3gxD+RvEnPmRI1EmpXV3zVzAhMFGkw==',key_name='tempest-keypair-588718392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c50747fa9b7f4bfaa00f791648e6bb11',ramdisk_id='',reservation_id='r-oq3cvc6p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1717350197',owner_user_name='tempest-SnapshotDataIntegrityTests-1717350197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:38:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf8f02d29dda43559e81ac57aea60a62',uuid=e416f888-2093-4bc2-99c8-bc5f62a4d06d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "address": "fa:16:3e:e2:6c:cd", "network": {"id": "9cf1b4e4-7f56-4588-a148-3ce6993fb7bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-133441995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c50747fa9b7f4bfaa00f791648e6bb11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d142c3-a1", "ovs_interfaceid": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72504) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Converting VIF {"id": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "address": "fa:16:3e:e2:6c:cd", "network": {"id": "9cf1b4e4-7f56-4588-a148-3ce6993fb7bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-133441995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c50747fa9b7f4bfaa00f791648e6bb11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d142c3-a1", "ovs_interfaceid": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:6c:cd,bridge_name='br-int',has_traffic_filtering=True,id=69d142c3-a14a-47c8-9c0c-37f166ae1355,network=Network(9cf1b4e4-7f56-4588-a148-3ce6993fb7bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69d142c3-a1') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.objects.instance [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lazy-loading 'pci_devices' on Instance uuid e416f888-2093-4bc2-99c8-bc5f62a4d06d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 20:38:48 user nova-compute[72504]:   <uuid>e416f888-2093-4bc2-99c8-bc5f62a4d06d</uuid>
Aug 01 20:38:48 user nova-compute[72504]:   <name>instance-00000034</name>
Aug 01 20:38:48 user nova-compute[72504]:   <memory>524288</memory>
Aug 01 20:38:48 user nova-compute[72504]:   <vcpu>1</vcpu>
Aug 01 20:38:48 user nova-compute[72504]:   <metadata>
Aug 01 20:38:48 user nova-compute[72504]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 20:38:48 user nova-compute[72504]:       <nova:package version="0.0.0"/>
Aug 01 20:38:48 user nova-compute[72504]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1143692478</nova:name>
Aug 01 20:38:48 user nova-compute[72504]:       <nova:creationTime>2023-08-01 20:38:48</nova:creationTime>
Aug 01 20:38:48 user nova-compute[72504]:       <nova:flavor name="m1.tiny">
Aug 01 20:38:48 user nova-compute[72504]:         <nova:memory>512</nova:memory>
Aug 01 20:38:48 user nova-compute[72504]:         <nova:disk>1</nova:disk>
Aug 01 20:38:48 user nova-compute[72504]:         <nova:swap>0</nova:swap>
Aug 01 20:38:48 user nova-compute[72504]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 20:38:48 user nova-compute[72504]:         <nova:vcpus>1</nova:vcpus>
Aug 01 20:38:48 user nova-compute[72504]:       </nova:flavor>
Aug 01 20:38:48 user nova-compute[72504]:       <nova:owner>
Aug 01 20:38:48 user nova-compute[72504]:         <nova:user uuid="bf8f02d29dda43559e81ac57aea60a62">tempest-SnapshotDataIntegrityTests-1717350197-project-member</nova:user>
Aug 01 20:38:48 user nova-compute[72504]:         <nova:project uuid="c50747fa9b7f4bfaa00f791648e6bb11">tempest-SnapshotDataIntegrityTests-1717350197</nova:project>
Aug 01 20:38:48 user nova-compute[72504]:       </nova:owner>
Aug 01 20:38:48 user nova-compute[72504]:       <nova:root type="image" uuid="3f5e9e2d-95fb-46b2-b205-6c41a2b0b089"/>
Aug 01 20:38:48 user nova-compute[72504]:       <nova:ports>
Aug 01 20:38:48 user nova-compute[72504]:         <nova:port uuid="69d142c3-a14a-47c8-9c0c-37f166ae1355">
Aug 01 20:38:48 user nova-compute[72504]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 20:38:48 user nova-compute[72504]:         </nova:port>
Aug 01 20:38:48 user nova-compute[72504]:       </nova:ports>
Aug 01 20:38:48 user nova-compute[72504]:     </nova:instance>
Aug 01 20:38:48 user nova-compute[72504]:   </metadata>
Aug 01 20:38:48 user nova-compute[72504]:   <sysinfo type="smbios">
Aug 01 20:38:48 user nova-compute[72504]:     <system>
Aug 01 20:38:48 user nova-compute[72504]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 20:38:48 user nova-compute[72504]:       <entry name="product">OpenStack Nova</entry>
Aug 01 20:38:48 user nova-compute[72504]:       <entry name="version">0.0.0</entry>
Aug 01 20:38:48 user nova-compute[72504]:       <entry name="serial">e416f888-2093-4bc2-99c8-bc5f62a4d06d</entry>
Aug 01 20:38:48 user nova-compute[72504]:       <entry name="uuid">e416f888-2093-4bc2-99c8-bc5f62a4d06d</entry>
Aug 01 20:38:48 user nova-compute[72504]:       <entry name="family">Virtual Machine</entry>
Aug 01 20:38:48 user nova-compute[72504]:     </system>
Aug 01 20:38:48 user nova-compute[72504]:   </sysinfo>
Aug 01 20:38:48 user nova-compute[72504]:   <os>
Aug 01 20:38:48 user nova-compute[72504]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 20:38:48 user nova-compute[72504]:     <boot dev="hd"/>
Aug 01 20:38:48 user nova-compute[72504]:     <smbios mode="sysinfo"/>
Aug 01 20:38:48 user nova-compute[72504]:   </os>
Aug 01 20:38:48 user nova-compute[72504]:   <features>
Aug 01 20:38:48 user nova-compute[72504]:     <acpi/>
Aug 01 20:38:48 user nova-compute[72504]:     <apic/>
Aug 01 20:38:48 user nova-compute[72504]:     <vmcoreinfo/>
Aug 01 20:38:48 user nova-compute[72504]:   </features>
Aug 01 20:38:48 user nova-compute[72504]:   <clock offset="utc">
Aug 01 20:38:48 user nova-compute[72504]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 20:38:48 user nova-compute[72504]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 20:38:48 user nova-compute[72504]:     <timer name="hpet" present="no"/>
Aug 01 20:38:48 user nova-compute[72504]:   </clock>
Aug 01 20:38:48 user nova-compute[72504]:   <cpu mode="custom" match="exact">
Aug 01 20:38:48 user nova-compute[72504]:     <model>Nehalem</model>
Aug 01 20:38:48 user nova-compute[72504]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 20:38:48 user nova-compute[72504]:   </cpu>
Aug 01 20:38:48 user nova-compute[72504]:   <devices>
Aug 01 20:38:48 user nova-compute[72504]:     <disk type="file" device="disk">
Aug 01 20:38:48 user nova-compute[72504]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 20:38:48 user nova-compute[72504]:       <source file="/opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk"/>
Aug 01 20:38:48 user nova-compute[72504]:       <target dev="vda" bus="virtio"/>
Aug 01 20:38:48 user nova-compute[72504]:     </disk>
Aug 01 20:38:48 user nova-compute[72504]:     <interface type="ethernet">
Aug 01 20:38:48 user nova-compute[72504]:       <mac address="fa:16:3e:e2:6c:cd"/>
Aug 01 20:38:48 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:38:48 user nova-compute[72504]:       <mtu size="1442"/>
Aug 01 20:38:48 user nova-compute[72504]:       <target dev="tap69d142c3-a1"/>
Aug 01 20:38:48 user nova-compute[72504]:     </interface>
Aug 01 20:38:48 user nova-compute[72504]:     <serial type="pty">
Aug 01 20:38:48 user nova-compute[72504]:       <log file="/opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/console.log" append="off"/>
Aug 01 20:38:48 user nova-compute[72504]:     </serial>
Aug 01 20:38:48 user nova-compute[72504]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 20:38:48 user nova-compute[72504]:     <video>
Aug 01 20:38:48 user nova-compute[72504]:       <model type="virtio"/>
Aug 01 20:38:48 user nova-compute[72504]:     </video>
Aug 01 20:38:48 user nova-compute[72504]:     <rng model="virtio">
Aug 01 20:38:48 user nova-compute[72504]:       <backend model="random">/dev/urandom</backend>
Aug 01 20:38:48 user nova-compute[72504]:     </rng>
Aug 01 20:38:48 user nova-compute[72504]:     <controller type="usb" index="0" model="none"/>
Aug 01 20:38:48 user nova-compute[72504]:     <memballoon model="virtio">
Aug 01 20:38:48 user nova-compute[72504]:       <stats period="10"/>
Aug 01 20:38:48 user nova-compute[72504]:     </memballoon>
Aug 01 20:38:48 user nova-compute[72504]:   </devices>
Aug 01 20:38:48 user nova-compute[72504]: </domain>
Aug 01 20:38:48 user nova-compute[72504]:  {{(pid=72504) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:38:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1143692478',display_name='tempest-SnapshotDataIntegrityTests-server-1143692478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1143692478',id=52,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3JWWNoHxQu8NzWqGkrQ1x/vzh0KDAoETAwBgXiU4rFa6CpcNZnixVMjA+EX5Xz2hu+VZ6Z4h14tRkPA86R6fo7snsjX9ejw9Tz3gxD+RvEnPmRI1EmpXV3zVzAhMFGkw==',key_name='tempest-keypair-588718392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c50747fa9b7f4bfaa00f791648e6bb11',ramdisk_id='',reservation_id='r-oq3cvc6p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1717350197',owner_user_name='tempest-SnapshotDataIntegrityTests-1717350197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T20:38:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf8f02d29dda43559e81ac57aea60a62',uuid=e416f888-2093-4bc2-99c8-bc5f62a4d06d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "address": "fa:16:3e:e2:6c:cd", "network": {"id": "9cf1b4e4-7f56-4588-a148-3ce6993fb7bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-133441995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c50747fa9b7f4bfaa00f791648e6bb11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d142c3-a1", "ovs_interfaceid": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Converting VIF {"id": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "address": "fa:16:3e:e2:6c:cd", "network": {"id": "9cf1b4e4-7f56-4588-a148-3ce6993fb7bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-133441995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c50747fa9b7f4bfaa00f791648e6bb11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d142c3-a1", "ovs_interfaceid": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:6c:cd,bridge_name='br-int',has_traffic_filtering=True,id=69d142c3-a14a-47c8-9c0c-37f166ae1355,network=Network(9cf1b4e4-7f56-4588-a148-3ce6993fb7bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69d142c3-a1') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG os_vif [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:6c:cd,bridge_name='br-int',has_traffic_filtering=True,id=69d142c3-a14a-47c8-9c0c-37f166ae1355,network=Network(9cf1b4e4-7f56-4588-a148-3ce6993fb7bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69d142c3-a1') {{(pid=72504) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69d142c3-a1, may_exist=True, interface_attrs={}) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69d142c3-a1, col_values=(('external_ids', {'iface-id': '69d142c3-a14a-47c8-9c0c-37f166ae1355', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:6c:cd', 'vm-uuid': 'e416f888-2093-4bc2-99c8-bc5f62a4d06d'}),), if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:48 user nova-compute[72504]: INFO os_vif [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:6c:cd,bridge_name='br-int',has_traffic_filtering=True,id=69d142c3-a14a-47c8-9c0c-37f166ae1355,network=Network(9cf1b4e4-7f56-4588-a148-3ce6993fb7bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69d142c3-a1')
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] No VIF found with MAC fa:16:3e:e2:6c:cd, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.network.neutron [req-2c56c020-e5f3-4966-b379-8aa0e487e879 req-86ec7277-41b9-42b1-bd74-a94ca8431faa service nova] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Updated VIF entry in instance network info cache for port 69d142c3-a14a-47c8-9c0c-37f166ae1355. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG nova.network.neutron [req-2c56c020-e5f3-4966-b379-8aa0e487e879 req-86ec7277-41b9-42b1-bd74-a94ca8431faa service nova] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Updating instance_info_cache with network_info: [{"id": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "address": "fa:16:3e:e2:6c:cd", "network": {"id": "9cf1b4e4-7f56-4588-a148-3ce6993fb7bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-133441995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c50747fa9b7f4bfaa00f791648e6bb11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d142c3-a1", "ovs_interfaceid": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:38:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-2c56c020-e5f3-4966-b379-8aa0e487e879 req-86ec7277-41b9-42b1-bd74-a94ca8431faa service nova] Releasing lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:38:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:50 user nova-compute[72504]: DEBUG nova.compute.manager [req-5dc4a64e-220f-499c-9fe6-828e7449d66f req-fe039cfc-f211-4511-a675-973e19ad2311 service nova] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Received event network-vif-plugged-69d142c3-a14a-47c8-9c0c-37f166ae1355 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:38:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5dc4a64e-220f-499c-9fe6-828e7449d66f req-fe039cfc-f211-4511-a675-973e19ad2311 service nova] Acquiring lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:38:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5dc4a64e-220f-499c-9fe6-828e7449d66f req-fe039cfc-f211-4511-a675-973e19ad2311 service nova] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:38:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-5dc4a64e-220f-499c-9fe6-828e7449d66f req-fe039cfc-f211-4511-a675-973e19ad2311 service nova] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:38:50 user nova-compute[72504]: DEBUG nova.compute.manager [req-5dc4a64e-220f-499c-9fe6-828e7449d66f req-fe039cfc-f211-4511-a675-973e19ad2311 service nova] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] No waiting events found dispatching network-vif-plugged-69d142c3-a14a-47c8-9c0c-37f166ae1355 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:38:50 user nova-compute[72504]: WARNING nova.compute.manager [req-5dc4a64e-220f-499c-9fe6-828e7449d66f req-fe039cfc-f211-4511-a675-973e19ad2311 service nova] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Received unexpected event network-vif-plugged-69d142c3-a14a-47c8-9c0c-37f166ae1355 for instance with vm_state building and task_state spawning.
Aug 01 20:38:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:50 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:52 user nova-compute[72504]: DEBUG nova.compute.manager [req-3b50a3ac-466a-4b93-af35-3f5199191f47 req-e80a8a93-92c2-4ed7-9812-237905bba560 service nova] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Received event network-vif-plugged-69d142c3-a14a-47c8-9c0c-37f166ae1355 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:38:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3b50a3ac-466a-4b93-af35-3f5199191f47 req-e80a8a93-92c2-4ed7-9812-237905bba560 service nova] Acquiring lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:38:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3b50a3ac-466a-4b93-af35-3f5199191f47 req-e80a8a93-92c2-4ed7-9812-237905bba560 service nova] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:38:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-3b50a3ac-466a-4b93-af35-3f5199191f47 req-e80a8a93-92c2-4ed7-9812-237905bba560 service nova] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:38:52 user nova-compute[72504]: DEBUG nova.compute.manager [req-3b50a3ac-466a-4b93-af35-3f5199191f47 req-e80a8a93-92c2-4ed7-9812-237905bba560 service nova] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] No waiting events found dispatching network-vif-plugged-69d142c3-a14a-47c8-9c0c-37f166ae1355 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:38:52 user nova-compute[72504]: WARNING nova.compute.manager [req-3b50a3ac-466a-4b93-af35-3f5199191f47 req-e80a8a93-92c2-4ed7-9812-237905bba560 service nova] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Received unexpected event network-vif-plugged-69d142c3-a14a-47c8-9c0c-37f166ae1355 for instance with vm_state building and task_state spawning.
Aug 01 20:38:52 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690922332.7346947, e416f888-2093-4bc2-99c8-bc5f62a4d06d => Resumed> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:38:52 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] VM Resumed (Lifecycle Event)
Aug 01 20:38:52 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Instance event wait completed in 0 seconds for  {{(pid=72504) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 20:38:52 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Guest created on hypervisor {{(pid=72504) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 20:38:52 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Instance spawned successfully.
Aug 01 20:38:52 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 20:38:52 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:38:52 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:38:52 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Found default for hw_cdrom_bus of ide {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:38:52 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Found default for hw_disk_bus of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:38:52 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Found default for hw_input_bus of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:38:52 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Found default for hw_pointer_model of None {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:38:52 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Found default for hw_video_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:38:52 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Found default for hw_vif_model of virtio {{(pid=72504) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 20:38:52 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:38:52 user nova-compute[72504]: DEBUG nova.virt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Emitting event <LifecycleEvent: 1690922332.7360814, e416f888-2093-4bc2-99c8-bc5f62a4d06d => Started> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:38:52 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] VM Started (Lifecycle Event)
Aug 01 20:38:52 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:38:52 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72504) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 20:38:52 user nova-compute[72504]: INFO nova.compute.manager [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 20:38:52 user nova-compute[72504]: INFO nova.compute.manager [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Took 6.54 seconds to spawn the instance on the hypervisor.
Aug 01 20:38:52 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:38:52 user nova-compute[72504]: INFO nova.compute.manager [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Took 7.33 seconds to build instance.
Aug 01 20:38:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7d20474f-0595-4202-b817-a99d8a3bdf43 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.448s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:38:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:38:55 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:38:56 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:38:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:39:01 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:39:01 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:39:02 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:39:02 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:39:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:39:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:39:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:39:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:39:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:39:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:39:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:39:06 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:39:07 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:39:07 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:39:07 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 20:39:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:39:07 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:39:07 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:39:07 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lazy-loading 'info_cache' on Instance uuid e416f888-2093-4bc2-99c8-bc5f62a4d06d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:39:08 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Updating instance_info_cache with network_info: [{"id": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "address": "fa:16:3e:e2:6c:cd", "network": {"id": "9cf1b4e4-7f56-4588-a148-3ce6993fb7bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-133441995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c50747fa9b7f4bfaa00f791648e6bb11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d142c3-a1", "ovs_interfaceid": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:39:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:39:08 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:39:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:39:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:39:10 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:39:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:39:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:39:10 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:39:10 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:39:10 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:39:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:39:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:39:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:39:11 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:39:11 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:39:11 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8499MB free_disk=25.05697250366211GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:39:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:39:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:39:12 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance e416f888-2093-4bc2-99c8-bc5f62a4d06d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:39:12 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:39:12 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:39:12 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:39:12 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:39:12 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:39:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:39:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:39:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:39:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:39:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:39:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:39:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:39:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:39:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:39:37 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:39:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:39:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:39:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:39:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:39:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:39:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:39:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:39:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:39:49 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:39:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:39:55 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:39:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:39:58 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:40:02 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:40:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:40:03 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:40:03 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:40:04 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:40:06 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:40:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:40:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:40:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:40:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:40:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:40:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:40:08 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:40:08 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:40:08 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 20:40:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:40:08 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:40:08 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:40:08 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lazy-loading 'info_cache' on Instance uuid e416f888-2093-4bc2-99c8-bc5f62a4d06d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:40:09 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Updating instance_info_cache with network_info: [{"id": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "address": "fa:16:3e:e2:6c:cd", "network": {"id": "9cf1b4e4-7f56-4588-a148-3ce6993fb7bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-133441995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c50747fa9b7f4bfaa00f791648e6bb11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d142c3-a1", "ovs_interfaceid": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:40:09 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:40:09 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:40:12 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:40:12 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:40:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:40:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:40:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:40:12 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:40:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:40:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:40:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:40:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:40:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:40:13 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:40:13 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:40:13 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8828MB free_disk=25.052879333496094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:40:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:40:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:40:13 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance e416f888-2093-4bc2-99c8-bc5f62a4d06d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:40:13 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:40:13 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:40:13 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:40:13 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:40:13 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:40:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:40:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:40:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:40:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:40:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:40:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:40:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:40:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:40:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:40:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:40:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:40:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:40:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:40:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:40:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:40:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:40:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:40:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:40:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:40:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:40:37 user nova-compute[72504]: DEBUG nova.compute.manager [req-c9a2edcc-991c-46cf-bf19-9f26bd60c680 req-a2a42a9b-aa0a-4955-823a-26a66918168d service nova] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Received event network-changed-69d142c3-a14a-47c8-9c0c-37f166ae1355 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:40:37 user nova-compute[72504]: DEBUG nova.compute.manager [req-c9a2edcc-991c-46cf-bf19-9f26bd60c680 req-a2a42a9b-aa0a-4955-823a-26a66918168d service nova] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Refreshing instance network info cache due to event network-changed-69d142c3-a14a-47c8-9c0c-37f166ae1355. {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 20:40:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c9a2edcc-991c-46cf-bf19-9f26bd60c680 req-a2a42a9b-aa0a-4955-823a-26a66918168d service nova] Acquiring lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:40:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c9a2edcc-991c-46cf-bf19-9f26bd60c680 req-a2a42a9b-aa0a-4955-823a-26a66918168d service nova] Acquired lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:40:37 user nova-compute[72504]: DEBUG nova.network.neutron [req-c9a2edcc-991c-46cf-bf19-9f26bd60c680 req-a2a42a9b-aa0a-4955-823a-26a66918168d service nova] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Refreshing network info cache for port 69d142c3-a14a-47c8-9c0c-37f166ae1355 {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 20:40:37 user nova-compute[72504]: DEBUG nova.network.neutron [req-c9a2edcc-991c-46cf-bf19-9f26bd60c680 req-a2a42a9b-aa0a-4955-823a-26a66918168d service nova] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Updated VIF entry in instance network info cache for port 69d142c3-a14a-47c8-9c0c-37f166ae1355. {{(pid=72504) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 20:40:37 user nova-compute[72504]: DEBUG nova.network.neutron [req-c9a2edcc-991c-46cf-bf19-9f26bd60c680 req-a2a42a9b-aa0a-4955-823a-26a66918168d service nova] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Updating instance_info_cache with network_info: [{"id": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "address": "fa:16:3e:e2:6c:cd", "network": {"id": "9cf1b4e4-7f56-4588-a148-3ce6993fb7bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-133441995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c50747fa9b7f4bfaa00f791648e6bb11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d142c3-a1", "ovs_interfaceid": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:40:37 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-c9a2edcc-991c-46cf-bf19-9f26bd60c680 req-a2a42a9b-aa0a-4955-823a-26a66918168d service nova] Releasing lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:40:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:40:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:40:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:40:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:40:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:40:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:40:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:40:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:40:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:40:42 user nova-compute[72504]: DEBUG nova.objects.instance [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lazy-loading 'flavor' on Instance uuid e416f888-2093-4bc2-99c8-bc5f62a4d06d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:40:42 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:40:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:40:43 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:40:43 user nova-compute[72504]: INFO nova.compute.manager [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Attaching volume 7f9e3096-5bb1-43f0-94c9-36abb26109d8 to /dev/vdb
Aug 01 20:40:43 user nova-compute[72504]: DEBUG os_brick.utils [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:40:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:40:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:40:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[708a4d32-a783-4c3d-bf27-f817f2e79e61]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:40:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:40:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:40:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d04817-76e8-40e5-a809-505bfba367a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:40:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:40:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:40:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a91253-f847-4b73-8934-f2cee4fa07b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:40:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b8259b-4d1d-4f08-9e51-e0086eb4a640]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:40:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:40:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:40:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:40:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:40:43 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:40:43 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:40:43 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2461e3a5-70b4-4163-9822-6ef8d0fcae89]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:40:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:40:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:40:43 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:40:43 user nova-compute[72504]: DEBUG os_brick.utils [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:40:43 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Updating existing volume attachment record: 778abbb7-1e11-4f9f-b47f-0e07424c8d63 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:40:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:40:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:40:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:40:49 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMkJuING', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:40:50 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:40:50 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:40:50 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:40:50 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:40:50 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0225a1c7-f72e-4e39-aad7-f95238692a8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:40:50 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cbc000-a1b3-4814-be59-621a5d04af58]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8] added
Aug 01 20:40:50 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddda8a70-bf6f-4de1-bebe-6a636e5f8aff]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7841b2-30e5-46c8-b1e4-d61465b84228]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jMkJuING {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jMkJuING" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[517eabf9-7451-4414-bfb3-00435698b1f1]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jMkJuING'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[33790f6b-93a5-40a7-be2e-5ca81b7bb7db]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[304d60c4-312d-4f37-b3af-abb8d512a871]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 20:40:50 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 20:40:50 user nova-compute[72504]:  {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:40:50 user nova-compute[72504]: WARNING os_brick.initiator.connectors.iscsi [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 20:40:50 user nova-compute[72504]: 
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa00f70c-fa08-45fd-b594-3d9b6d75699b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8, portal: 172.16.0.220,3260]
Aug 01 20:40:50 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8, portal: 172.16.0.220,3260] successful.
Aug 01 20:40:50 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9a2e09-dcfb-490a-ae56-dc6e49a673ba]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9f2840-0bd9-457c-83f2-062b8abcf825]: (4, ('tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8 (non-flash)
Aug 01 20:40:50 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsi session list stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8 (non-flash)
Aug 01 20:40:50 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] HCTL ('33', '-', '-', 0) found on session 66 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9140c4-fe66-49a9-9dc0-7dc6cafe27a2]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Searching for a device in session 66 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:40:50 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMkJuING', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:40:51 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:40:51 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23962663933623761', 'path': '/dev/sdb'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:40:51 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962663933623761', 'path': '/dev/sdb'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:40:51 user nova-compute[72504]: DEBUG nova.objects.instance [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lazy-loading 'flavor' on Instance uuid e416f888-2093-4bc2-99c8-bc5f62a4d06d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:40:51 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 20:40:51 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:40:51 user nova-compute[72504]:   <source dev="/dev/sdb"/>
Aug 01 20:40:51 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:40:51 user nova-compute[72504]:   <serial>7f9e3096-5bb1-43f0-94c9-36abb26109d8</serial>
Aug 01 20:40:51 user nova-compute[72504]: </disk>
Aug 01 20:40:51 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 20:40:52 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:40:52 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:40:52 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] No VIF found with MAC fa:16:3e:e2:6c:cd, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:40:52 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-cc7019c6-fead-4ded-9f1e-96c980be0b44 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.042s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:40:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:40:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:40:56 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:40:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:40:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:40:59 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:40:59 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Cleaning up deleted instances {{(pid=72504) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 20:40:59 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] There are 0 instances to clean {{(pid=72504) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 20:41:00 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:41:02 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:41:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:41:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:41:04 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:41:05 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:41:05 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:41:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:41:08 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:41:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:41:10 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:41:10 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:41:10 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lazy-loading 'info_cache' on Instance uuid e416f888-2093-4bc2-99c8-bc5f62a4d06d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:41:11 user nova-compute[72504]: INFO nova.compute.manager [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Detaching volume 7f9e3096-5bb1-43f0-94c9-36abb26109d8
Aug 01 20:41:11 user nova-compute[72504]: INFO nova.virt.block_device [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Attempting to driver detach volume 7f9e3096-5bb1-43f0-94c9-36abb26109d8 from mountpoint /dev/vdb
Aug 01 20:41:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Attempting to detach device vdb from instance e416f888-2093-4bc2-99c8-bc5f62a4d06d from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:41:11 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:41:11 user nova-compute[72504]:   <source dev="/dev/sdb"/>
Aug 01 20:41:11 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:41:11 user nova-compute[72504]:   <serial>7f9e3096-5bb1-43f0-94c9-36abb26109d8</serial>
Aug 01 20:41:11 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:41:11 user nova-compute[72504]: </disk>
Aug 01 20:41:11 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:41:11 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Successfully detached device vdb from instance e416f888-2093-4bc2-99c8-bc5f62a4d06d from the persistent domain config.
Aug 01 20:41:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e416f888-2093-4bc2-99c8-bc5f62a4d06d from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:41:11 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:41:11 user nova-compute[72504]:   <source dev="/dev/sdb"/>
Aug 01 20:41:11 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:41:11 user nova-compute[72504]:   <serial>7f9e3096-5bb1-43f0-94c9-36abb26109d8</serial>
Aug 01 20:41:11 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:41:11 user nova-compute[72504]: </disk>
Aug 01 20:41:11 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Updating instance_info_cache with network_info: [{"id": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "address": "fa:16:3e:e2:6c:cd", "network": {"id": "9cf1b4e4-7f56-4588-a148-3ce6993fb7bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-133441995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c50747fa9b7f4bfaa00f791648e6bb11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d142c3-a1", "ovs_interfaceid": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690922471.8301642, e416f888-2093-4bc2-99c8-bc5f62a4d06d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e416f888-2093-4bc2-99c8-bc5f62a4d06d {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 20:41:11 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Successfully detached device vdb from instance e416f888-2093-4bc2-99c8-bc5f62a4d06d from the live domain config.
Aug 01 20:41:11 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMkJuING', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:41:11 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:41:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0fa8c0-a7f0-4fcf-b72b-63ebf430eb45]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[95188245-04f6-4e87-afe3-83a43ee03d24]: (4, ('tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8 (non-flash)
Aug 01 20:41:11 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsi session list stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8 (non-flash)
Aug 01 20:41:11 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff40c195ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8'): ({'sdb'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Removing single pathed devices sdb {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbef8e57-ddbf-4ca5-a6d2-5e548841719a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4eb9e9a-cbf3-4628-8af8-9f2bafd04407]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Flushing IO for device /dev/sdb {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b561c7a2-ec33-4d0f-b0d4-5d76600e9af5]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:41:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:41:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:41:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3741f8-289d-49c1-8de9-4f9bb0f7e94e]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:41:12 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:41:12 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:41:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:41:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:41:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:41:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca65fcf-1d31-404f-8b25-5154ab8a358c]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:41:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:41:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:41:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:41:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[417cbac4-2403-47f1-9040-b616f8560107]: (4, ('Logging out of session [sid: 66, target: iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8, portal: 172.16.0.220,3260]\nLogout of [sid: 66, target: iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:41:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 66, target: iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8, portal: 172.16.0.220,3260]
Aug 01 20:41:12 user nova-compute[72504]: Logout of [sid: 66, target: iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8, portal: 172.16.0.220,3260] successful.
Aug 01 20:41:12 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:41:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:41:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f9e3096-5bb1-43f0-94c9-36abb26109d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:41:12 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5836af9d-8eea-4058-820f-1cee826be797]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:41:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:41:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:41:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] <== disconnect_volume: return (288ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:41:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:41:12 user nova-compute[72504]: DEBUG nova.objects.instance [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lazy-loading 'flavor' on Instance uuid e416f888-2093-4bc2-99c8-bc5f62a4d06d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:41:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a32bb551-c535-4495-9c7c-f9f01039464f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.640s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:41:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:41:14 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:41:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:41:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:41:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:41:14 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:41:14 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:41:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:41:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:41:15 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:41:15 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:41:15 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:41:15 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8794MB free_disk=25.051517486572266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:41:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:41:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:41:15 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance e416f888-2093-4bc2-99c8-bc5f62a4d06d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:41:15 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:41:15 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:41:15 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:41:15 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:41:15 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:41:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:41:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:41:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:41:24 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:41:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:41:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:41:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:41:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:41:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:41:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:41:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:41:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:41:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:41:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:41:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:41:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:41:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:41:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:41:45 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:41:45 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72504) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 20:41:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:41:48 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:41:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:41:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:41:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:41:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:41:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:41:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:41:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:41:58 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:42:00 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:42:02 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:42:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:42:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:42:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:42:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:42:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:42:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:42:04 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:42:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:42:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:42:05 user nova-compute[72504]: DEBUG nova.objects.instance [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lazy-loading 'flavor' on Instance uuid e416f888-2093-4bc2-99c8-bc5f62a4d06d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:42:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:42:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:42:05 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:42:05 user nova-compute[72504]: INFO nova.compute.manager [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Attaching volume c67b3614-0e42-4c00-abcf-98a7cbd789e6 to /dev/vdb
Aug 01 20:42:05 user nova-compute[72504]: DEBUG os_brick.utils [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:42:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:42:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:42:05 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[749d0692-71e2-407b-8713-05ea68fa25ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:42:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:42:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:42:05 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[69073c0e-cb0b-4234-8d7c-4a33afd99aeb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:42:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:42:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:42:05 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ecdf81-8a52-4d8b-919a-c2385eebe33d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:42:05 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3859b52-a1e6-4f99-a3c1-8d29fa982bdf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:42:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:42:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:42:05 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:42:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:42:05 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:42:05 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:42:05 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e789b983-2da2-4649-bf61-1d18057bb724]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:42:05 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:42:05 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:42:05 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:42:05 user nova-compute[72504]: DEBUG os_brick.utils [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:42:05 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Updating existing volume attachment record: 47f67c2d-7e98-4341-8489-29fea1e15250 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:42:06 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:42:06 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:42:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:42:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:42:10 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:42:12 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:42:12 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:42:12 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 20:42:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:42:12 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:42:12 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:42:12 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lazy-loading 'info_cache' on Instance uuid e416f888-2093-4bc2-99c8-bc5f62a4d06d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:42:12 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:42:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tmqYgsWC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:42:12 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:42:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:42:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:42:12 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:42:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:42:12 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:42:12 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:42:12 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[be27e648-e89a-47eb-9eea-71ccd9d21766]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:42:13 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2b73e8-8436-4171-8c7b-040e7e1efa63]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6] added
Aug 01 20:42:13 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbab1da3-704e-4b73-850a-89d7f9e240d5]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ebc3a9-69b8-434a-bfab-fd10e9f4ef43]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tmqYgsWC {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tmqYgsWC" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cd9f90-9942-47ba-866b-e8027907d299]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tmqYgsWC'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d24cfa3-c1df-462b-a408-75820978b684]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e75921-d2e6-401f-b601-40f5fe8cc3a9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 20:42:13 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 20:42:13 user nova-compute[72504]:  {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:42:13 user nova-compute[72504]: WARNING os_brick.initiator.connectors.iscsi [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 20:42:13 user nova-compute[72504]: 
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e040b95-9abb-48e6-9ca0-f4e014067d69]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6, portal: 172.16.0.220,3260]
Aug 01 20:42:13 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6, portal: 172.16.0.220,3260] successful.
Aug 01 20:42:13 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3444543e-a686-4c42-ae63-b3a73a9333dd]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efe4762-c4d0-43af-88c3-ed090de11ff0]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6 (non-flash)
Aug 01 20:42:13 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6 (non-flash)
Aug 01 20:42:13 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc6a1b5-66e8-4fa4-b147-765f051b8893]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Updating instance_info_cache with network_info: [{"id": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "address": "fa:16:3e:e2:6c:cd", "network": {"id": "9cf1b4e4-7f56-4588-a148-3ce6993fb7bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-133441995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c50747fa9b7f4bfaa00f791648e6bb11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d142c3-a1", "ovs_interfaceid": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:42:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:42:14 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:42:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tmqYgsWC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:42:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:42:14 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23862313061653563', 'path': '/dev/sdb'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:42:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862313061653563', 'path': '/dev/sdb'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:42:14 user nova-compute[72504]: DEBUG nova.objects.instance [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lazy-loading 'flavor' on Instance uuid e416f888-2093-4bc2-99c8-bc5f62a4d06d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:42:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 20:42:14 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:42:14 user nova-compute[72504]:   <source dev="/dev/sdb"/>
Aug 01 20:42:14 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:42:14 user nova-compute[72504]:   <serial>c67b3614-0e42-4c00-abcf-98a7cbd789e6</serial>
Aug 01 20:42:14 user nova-compute[72504]: </disk>
Aug 01 20:42:14 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 20:42:14 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:42:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:42:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:42:14 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] No VIF found with MAC fa:16:3e:e2:6c:cd, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:42:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-497ba73e-d901-490d-a830-fee5838cbda2 tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.232s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:42:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:42:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:42:16 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:42:16 user nova-compute[72504]: INFO nova.compute.manager [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Detaching volume c67b3614-0e42-4c00-abcf-98a7cbd789e6
Aug 01 20:42:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:42:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:42:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:42:16 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:42:16 user nova-compute[72504]: INFO nova.virt.block_device [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Attempting to driver detach volume c67b3614-0e42-4c00-abcf-98a7cbd789e6 from mountpoint /dev/vdb
Aug 01 20:42:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Attempting to detach device vdb from instance e416f888-2093-4bc2-99c8-bc5f62a4d06d from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 20:42:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:42:16 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:42:16 user nova-compute[72504]:   <source dev="/dev/sdb"/>
Aug 01 20:42:16 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:42:16 user nova-compute[72504]:   <serial>c67b3614-0e42-4c00-abcf-98a7cbd789e6</serial>
Aug 01 20:42:16 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:42:16 user nova-compute[72504]: </disk>
Aug 01 20:42:16 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:42:16 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Successfully detached device vdb from instance e416f888-2093-4bc2-99c8-bc5f62a4d06d from the persistent domain config.
Aug 01 20:42:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e416f888-2093-4bc2-99c8-bc5f62a4d06d from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 20:42:16 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:42:16 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:42:16 user nova-compute[72504]:   <source dev="/dev/sdb"/>
Aug 01 20:42:16 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:42:16 user nova-compute[72504]:   <serial>c67b3614-0e42-4c00-abcf-98a7cbd789e6</serial>
Aug 01 20:42:16 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:42:16 user nova-compute[72504]: </disk>
Aug 01 20:42:16 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:42:16 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72504) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690922537.3683727, e416f888-2093-4bc2-99c8-bc5f62a4d06d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e416f888-2093-4bc2-99c8-bc5f62a4d06d {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 20:42:17 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Successfully detached device vdb from instance e416f888-2093-4bc2-99c8-bc5f62a4d06d from the live domain config.
Aug 01 20:42:17 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:42:17 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:42:17 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8807MB free_disk=25.05063247680664GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tmqYgsWC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:42:17 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:42:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[235631e6-ed15-4bf2-ab77-f44f3e6c2c7d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5506dd-6940-43b0-aa4f-447c8cee1370]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6 (non-flash)
Aug 01 20:42:17 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6 (non-flash)
Aug 01 20:42:17 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3f44643a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6'): ({'sdb'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Removing single pathed devices sdb {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1179a6b7-efc8-4a9e-896a-14de6fb89621]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.038s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93d4721-e102-44de-9f4c-b2382e089745]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Flushing IO for device /dev/sdb {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c55ccc-6478-4313-8b19-35c9d1407887]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1799b1-73d9-44d6-9f9a-4e85dac5676d]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance e416f888-2093-4bc2-99c8-bc5f62a4d06d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa630e8-223b-4c23-ad98-579cf243c837]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Refreshing inventories for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Updating ProviderTree inventory for provider b951a798-e88c-472c-8347-2c5f6a05d47c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Updating inventory in ProviderTree for provider b951a798-e88c-472c-8347-2c5f6a05d47c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f556282-fe74-4115-a729-340376114702]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6, portal: 172.16.0.220,3260]
Aug 01 20:42:17 user nova-compute[72504]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6, portal: 172.16.0.220,3260] successful.
Aug 01 20:42:17 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Refreshing aggregate associations for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c, aggregates: None {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c67b3614-0e42-4c00-abcf-98a7cbd789e6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab746c8-595d-4562-b6b0-ac2516756704]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] <== disconnect_volume: return (311ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:42:17 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Refreshing trait associations for resource provider b951a798-e88c-472c-8347-2c5f6a05d47c, traits: HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW {{(pid=72504) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 20:42:18 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:42:18 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:42:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:42:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:42:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:42:18 user nova-compute[72504]: DEBUG nova.objects.instance [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lazy-loading 'flavor' on Instance uuid e416f888-2093-4bc2-99c8-bc5f62a4d06d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:42:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-73515143-100f-4b2d-99d7-29dff04ce85c tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.989s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:42:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:42:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:42:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:42:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:42:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:42:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:42:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:42:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:42:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:42:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:42:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:42:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:42:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:42:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:42:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:42:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:42:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:42:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:42:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:42:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:42:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:42:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:42:51 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:42:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:42:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:42:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:42:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:42:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:42:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:42:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:42:59 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:43:01 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:43:02 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:43:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:43:04 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:43:06 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:43:06 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:43:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:43:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:43:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:43:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:43:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:43:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:43:10 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:43:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:43:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:43:11 user nova-compute[72504]: DEBUG nova.objects.instance [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lazy-loading 'flavor' on Instance uuid e416f888-2093-4bc2-99c8-bc5f62a4d06d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:43:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.123s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:43:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:43:11 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:43:11 user nova-compute[72504]: INFO nova.compute.manager [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Attaching volume 02de627b-3734-42c2-b618-a989b7fc7182 to /dev/vdb
Aug 01 20:43:11 user nova-compute[72504]: DEBUG os_brick.utils [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:43:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:43:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:43:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8381a708-653e-46f8-a2a9-0df1a519e5af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:43:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:43:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:43:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3848ede6-e51b-4b87-ac7c-a313e30f3e95]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:43:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:43:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:43:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07aca8c-17c8-46fa-b811-0df080d5dc04]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:43:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a8a5b2-2c2f-40a2-9ae2-dc2d6f896fb6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:43:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:43:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:43:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:43:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:43:11 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:43:11 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:43:11 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[07037248-a79d-4e0f-91e7-8692e238306d]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:43:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:43:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:43:11 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:43:11 user nova-compute[72504]: DEBUG os_brick.utils [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:43:11 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Updating existing volume attachment record: 566c4656-9e2c-4296-b566-c323b56ac194 {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:43:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:43:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:43:14 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:43:14 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:43:14 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 20:43:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:43:14 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:43:14 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:43:14 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lazy-loading 'info_cache' on Instance uuid e416f888-2093-4bc2-99c8-bc5f62a4d06d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:43:15 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Updating instance_info_cache with network_info: [{"id": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "address": "fa:16:3e:e2:6c:cd", "network": {"id": "9cf1b4e4-7f56-4588-a148-3ce6993fb7bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-133441995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c50747fa9b7f4bfaa00f791648e6bb11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d142c3-a1", "ovs_interfaceid": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:43:15 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:43:15 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:43:17 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:43:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:43:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:43:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:43:17 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:43:17 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tMrnsfcD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:43:18 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:43:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:43:18 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:43:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:43:18 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:43:18 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:43:18 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:43:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8803MB free_disk=25.041942596435547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfedc98-2102-43c7-81ad-64c9fae8a440]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:43:18 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18e0404-9333-439c-9511-8020cb68b83e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182] added
Aug 01 20:43:18 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75bbdd9-6283-4eb6-bb92-525a7b47f0ac]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8603bf-26fc-42da-b9c5-a7689d239e86]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tMrnsfcD {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tMrnsfcD" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cc7deb-2f5a-4ad6-b97b-caaba401e21a]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tMrnsfcD'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9e412a-b452-45d0-8f73-c6c4bc2a94df]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b5e869-d82d-4c73-b1d9-187328a03ca9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 20:43:18 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 20:43:18 user nova-compute[72504]:  {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:43:18 user nova-compute[72504]: WARNING os_brick.initiator.connectors.iscsi [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 20:43:18 user nova-compute[72504]: 
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e7e9da-f8dc-402a-baf7-e73ef3eeb91f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182, portal: 172.16.0.220,3260]
Aug 01 20:43:18 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182, portal: 172.16.0.220,3260] successful.
Aug 01 20:43:18 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7391b353-cb08-4eee-adf4-9e858c846773]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e409a39-cf38-4d73-b916-b16dde022ee7]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182 (non-flash)
Aug 01 20:43:18 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182 (non-flash)
Aug 01 20:43:18 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance e416f888-2093-4bc2-99c8-bc5f62a4d06d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa9a862-9bb6-40c2-a262-59f6bbfc52dc]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:43:18 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:43:19 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:43:19 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:43:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:43:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.390s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:43:19 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:43:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tMrnsfcD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:43:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:43:19 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26463306137633838', 'path': '/dev/sdb'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:43:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463306137633838', 'path': '/dev/sdb'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:43:19 user nova-compute[72504]: DEBUG nova.objects.instance [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lazy-loading 'flavor' on Instance uuid e416f888-2093-4bc2-99c8-bc5f62a4d06d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:43:19 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 20:43:19 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:43:19 user nova-compute[72504]:   <source dev="/dev/sdb"/>
Aug 01 20:43:19 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:43:19 user nova-compute[72504]:   <serial>02de627b-3734-42c2-b618-a989b7fc7182</serial>
Aug 01 20:43:19 user nova-compute[72504]: </disk>
Aug 01 20:43:19 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 20:43:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:43:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:43:20 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] No VIF found with MAC fa:16:3e:e2:6c:cd, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:43:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-a9551105-fa3b-478b-af5d-54bf97da69bb tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.246s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:43:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:43:22 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:43:22 user nova-compute[72504]: INFO nova.compute.manager [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Detaching volume 02de627b-3734-42c2-b618-a989b7fc7182
Aug 01 20:43:22 user nova-compute[72504]: INFO nova.virt.block_device [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Attempting to driver detach volume 02de627b-3734-42c2-b618-a989b7fc7182 from mountpoint /dev/vdb
Aug 01 20:43:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Attempting to detach device vdb from instance e416f888-2093-4bc2-99c8-bc5f62a4d06d from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 20:43:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:43:22 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:43:22 user nova-compute[72504]:   <source dev="/dev/sdb"/>
Aug 01 20:43:22 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:43:22 user nova-compute[72504]:   <serial>02de627b-3734-42c2-b618-a989b7fc7182</serial>
Aug 01 20:43:22 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:43:22 user nova-compute[72504]: </disk>
Aug 01 20:43:22 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:43:22 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Successfully detached device vdb from instance e416f888-2093-4bc2-99c8-bc5f62a4d06d from the persistent domain config.
Aug 01 20:43:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e416f888-2093-4bc2-99c8-bc5f62a4d06d from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 20:43:22 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:43:22 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:43:22 user nova-compute[72504]:   <source dev="/dev/sdb"/>
Aug 01 20:43:22 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:43:22 user nova-compute[72504]:   <serial>02de627b-3734-42c2-b618-a989b7fc7182</serial>
Aug 01 20:43:22 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:43:22 user nova-compute[72504]: </disk>
Aug 01 20:43:22 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690922603.2604775, e416f888-2093-4bc2-99c8-bc5f62a4d06d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e416f888-2093-4bc2-99c8-bc5f62a4d06d {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 20:43:23 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Successfully detached device vdb from instance e416f888-2093-4bc2-99c8-bc5f62a4d06d from the live domain config.
Aug 01 20:43:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tMrnsfcD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:43:23 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:43:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[daff4e10-74c7-4a64-9c06-f256306d5e87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c657f6e9-b4d1-4d74-a0c0-c586afd0573c]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182 (non-flash)
Aug 01 20:43:23 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182 (non-flash)
Aug 01 20:43:23 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3f43e7370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182'): ({'sdb'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Removing single pathed devices sdb {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[19791af2-7aaa-4f54-8566-5cf76fe19ffc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8af4d9e-3809-45d5-9679-97cf6a8a30be]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Flushing IO for device /dev/sdb {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c541255-92b8-457e-96eb-dcdeaa4caf98]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14f4785-987c-440e-a36e-d71865646292]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c02ce9d-2abb-44a2-ac56-b2bb50f74d77]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f84198-fcdd-4eea-beef-d57498d06558]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182, portal: 172.16.0.220,3260]
Aug 01 20:43:23 user nova-compute[72504]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182, portal: 172.16.0.220,3260] successful.
Aug 01 20:43:23 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02de627b-3734-42c2-b618-a989b7fc7182 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9191c1f5-3f25-4680-b1af-ce6b5fa0dc1e]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.256s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] <== disconnect_volume: return (257ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:43:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:43:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:43:24 user nova-compute[72504]: DEBUG nova.objects.instance [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lazy-loading 'flavor' on Instance uuid e416f888-2093-4bc2-99c8-bc5f62a4d06d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:43:24 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-120a900f-633f-4236-bbe1-26e8a5d5340e tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.601s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:43:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:43:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:43:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:43:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:43:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:43:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:43:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:43:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:43:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:43:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:43:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:43:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:43:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:43:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:43:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:43:53 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:43:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:43:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:43:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:43:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:43:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:43:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:43:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:43:59 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:44:02 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:44:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:44:03 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:44:04 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:44:06 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:44:06 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:44:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:44:10 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:44:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:44:16 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:44:16 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:44:16 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 20:44:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:44:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:44:16 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:44:16 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lazy-loading 'info_cache' on Instance uuid e416f888-2093-4bc2-99c8-bc5f62a4d06d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:44:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:44:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:44:16 user nova-compute[72504]: DEBUG nova.objects.instance [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lazy-loading 'flavor' on Instance uuid e416f888-2093-4bc2-99c8-bc5f62a4d06d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:44:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:44:17 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Updating instance_info_cache with network_info: [{"id": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "address": "fa:16:3e:e2:6c:cd", "network": {"id": "9cf1b4e4-7f56-4588-a148-3ce6993fb7bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-133441995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c50747fa9b7f4bfaa00f791648e6bb11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d142c3-a1", "ovs_interfaceid": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:44:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:44:17 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:44:18 user nova-compute[72504]: INFO nova.compute.manager [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Attaching volume 4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 to /dev/vdb
Aug 01 20:44:18 user nova-compute[72504]: DEBUG os_brick.utils [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b78a71f-e211-408d-bc0d-5e94e630df75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e7b9ab445a0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ad81c5-8e7f-48c7-ade2-e9dcfb1de887]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e4781a-e41f-405e-b626-a4e4d7ce074b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4117fcc9-46a2-4e79-8de5-af8029e61659]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Running cmd (subprocess): nvme version {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] 'nvme version' failed. Not Retrying. {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] nvme not present on system {{(pid=72504) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 20:44:18 user nova-compute[72504]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 20:44:18 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a950b9-8f14-4357-bd25-41e777b65e59]: (4, '') {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72504) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.lightos [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] LIGHTOS: no hostnqn found. {{(pid=72504) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG os_brick.utils [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e7b9ab445a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG nova.virt.block_device [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Updating existing volume attachment record: 69afab0c-6db8-4f71-b2a1-aefef59e536d {{(pid=72504) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:44:18 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:44:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:44:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:44:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:44:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:44:19 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:44:19 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:44:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8813MB free_disk=25.040973663330078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:44:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:44:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:44:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance e416f888-2093-4bc2-99c8-bc5f62a4d06d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:44:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:44:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:44:19 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:44:19 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:44:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:44:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:44:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Calling os-brick to attach iSCSI Volume {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KrFndSBg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:44:25 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:44:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:44:25 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:44:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:44:25 user nova-compute[72504]: INFO os_brick.initiator.connectors.iscsi [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 -p 172.16.0.220:3260 {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55c84a6-d612-4bc7-9371-a673b1f0d52d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 20:44:25 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c654f2-a906-4253-afa4-a14a0317315e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0] added\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0] added
Aug 01 20:44:25 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f99147-7e00-438c-837a-d4bce3a5cc91]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a21724-6fa1-4f3e-9de5-91b5ba766e1d]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KrFndSBg {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KrFndSBg" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad4ea23-1c3f-4944-94b3-e4e776d096f8]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KrFndSBg'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f3e0c1-5bb3-4ddc-b558-08d15d9617c5]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea903c56-9ce4-43d3-b58e-033b2990bd3b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 20:44:25 user nova-compute[72504]:  {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 20:44:25 user nova-compute[72504]:  {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:44:25 user nova-compute[72504]: WARNING os_brick.initiator.connectors.iscsi [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 20:44:25 user nova-compute[72504]: 
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 -p 172.16.0.220:3260 --login {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5af93e-ab0d-46f4-a1a7-554d5d35c200]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0, portal: 172.16.0.220,3260]
Aug 01 20:44:25 user nova-compute[72504]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0, portal: 172.16.0.220,3260] successful.
Aug 01 20:44:25 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6a51bd-6ff8-4151-b87e-4ff0a135f48a]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[992ee8df-0f16-4f53-a68b-18c2e3aa29e9]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 (non-flash)
Aug 01 20:44:25 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 (non-flash)
Aug 01 20:44:25 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Connected to 172.16.0.220:3260 {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=72504) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72504) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[460af210-0ab3-438f-a2b8-a93da5347d12]: (4, ('- - 0', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:44:25 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:44:26 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72504) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 20:44:26 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KrFndSBg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72504) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 20:44:26 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:44:26 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23139356536323366', 'path': '/dev/sdb'} {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:44:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139356536323366', 'path': '/dev/sdb'} {{(pid=72504) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 20:44:26 user nova-compute[72504]: DEBUG nova.objects.instance [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lazy-loading 'flavor' on Instance uuid e416f888-2093-4bc2-99c8-bc5f62a4d06d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:44:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 20:44:26 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:44:26 user nova-compute[72504]:   <source dev="/dev/sdb"/>
Aug 01 20:44:26 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:44:26 user nova-compute[72504]:   <serial>4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0</serial>
Aug 01 20:44:26 user nova-compute[72504]: </disk>
Aug 01 20:44:26 user nova-compute[72504]:  {{(pid=72504) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 20:44:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] No BDM found with device name vda, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:44:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72504) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 20:44:26 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] No VIF found with MAC fa:16:3e:e2:6c:cd, not building metadata {{(pid=72504) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 20:44:27 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-16ef1b01-d1f6-419c-a34d-31518322d31d tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.922s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:44:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:44:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:44:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:44:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:44:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:44:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:44:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:44:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:44:29 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:44:29 user nova-compute[72504]: INFO nova.compute.manager [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Detaching volume 4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0
Aug 01 20:44:29 user nova-compute[72504]: INFO nova.virt.block_device [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Attempting to driver detach volume 4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 from mountpoint /dev/vdb
Aug 01 20:44:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Attempting to detach device vdb from instance e416f888-2093-4bc2-99c8-bc5f62a4d06d from the persistent domain config. {{(pid=72504) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 20:44:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:44:29 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:44:29 user nova-compute[72504]:   <source dev="/dev/sdb"/>
Aug 01 20:44:29 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:44:29 user nova-compute[72504]:   <serial>4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0</serial>
Aug 01 20:44:29 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:44:29 user nova-compute[72504]: </disk>
Aug 01 20:44:29 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:44:29 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Successfully detached device vdb from instance e416f888-2093-4bc2-99c8-bc5f62a4d06d from the persistent domain config.
Aug 01 20:44:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e416f888-2093-4bc2-99c8-bc5f62a4d06d from the live domain config. {{(pid=72504) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 20:44:29 user nova-compute[72504]: DEBUG nova.virt.libvirt.guest [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 20:44:29 user nova-compute[72504]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 20:44:29 user nova-compute[72504]:   <source dev="/dev/sdb"/>
Aug 01 20:44:29 user nova-compute[72504]:   <target dev="vdb" bus="virtio"/>
Aug 01 20:44:29 user nova-compute[72504]:   <serial>4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0</serial>
Aug 01 20:44:29 user nova-compute[72504]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 20:44:29 user nova-compute[72504]: </disk>
Aug 01 20:44:29 user nova-compute[72504]:  {{(pid=72504) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-7b159652-b207-469f-8e2e-0596df9bd19a None None] Received event <DeviceRemovedEvent: 1690922670.186288, e416f888-2093-4bc2-99c8-bc5f62a4d06d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72504) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.driver [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e416f888-2093-4bc2-99c8-bc5f62a4d06d {{(pid=72504) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 20:44:30 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Successfully detached device vdb from instance e416f888-2093-4bc2-99c8-bc5f62a4d06d from the live domain config.
Aug 01 20:44:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] calling os-brick to detach iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff40c1ee050>, {'target_iqns': ['iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KrFndSBg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 20:44:30 user nova-compute[72504]: WARNING os_brick.initiator.connectors.base [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 20:44:30 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0', 0)] {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea6d297-5ac6-4f45-b63e-1913f9c4b501]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b106bed0-557b-45b9-a77e-0f8122304356]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 (non-flash)\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 (non-flash)
Aug 01 20:44:30 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 (non-flash)
Aug 01 20:44:30 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3f43e5630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0'): ({'sdb'}, set())}) {{(pid=72504) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Removing single pathed devices sdb {{(pid=72504) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f039f8d-1855-4e48-974d-93bc2e105946]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d90030-59a4-4d6b-89d5-d33886a7e99e]: (4, ('ok\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Flushing IO for device /dev/sdb {{(pid=72504) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec0a489-4170-4c41-913d-d9252b943c65]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72504) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f29be67-6c99-42b2-b13e-4293186d902d]: (4, ('1', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG os_brick.initiator.linuxscsi [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] SCSI volumes sdb have been removed. {{(pid=72504) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0')] {{(pid=72504) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[deef9a44-8677-4c40-8c0e-625689cbd402]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 -p 172.16.0.220:3260 --logout {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[77667a38-cd84-44d4-a738-855d7f43d9e0]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0, portal: 172.16.0.220,3260]
Aug 01 20:44:30 user nova-compute[72504]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0, portal: 172.16.0.220,3260] successful.
Aug 01 20:44:30 user nova-compute[72504]:  stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 -p 172.16.0.220:3260 --op delete {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c02f92b-3f89-43a6-a2d4-717a6f5ec6f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83379) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b715852-f736-4020-b4a6-3f617992fa3f]: (4, ('', '')) {{(pid=83379) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72504) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.base [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] <== disconnect_volume: return (268ms) None {{(pid=72504) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 20:44:30 user nova-compute[72504]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Disconnected iSCSI Volume {{(pid=72504) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 20:44:31 user nova-compute[72504]: DEBUG nova.objects.instance [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lazy-loading 'flavor' on Instance uuid e416f888-2093-4bc2-99c8-bc5f62a4d06d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:44:31 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-fd28d827-7ce2-4259-bd0a-491bcef04d5b tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.586s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:44:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:44:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:44:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:44:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:44:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:44:53 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:44:53 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:44:58 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:44:59 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:45:03 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:45:03 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:45:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:45:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:45:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:45:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:45:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:45:03 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:45:05 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:45:07 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:45:07 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:45:07 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:45:08 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:45:11 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:45:13 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:45:16 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:45:16 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:45:16 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 20:45:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 20:45:16 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquired lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 20:45:16 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Forcefully refreshing network info cache for instance {{(pid=72504) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 20:45:16 user nova-compute[72504]: DEBUG nova.objects.instance [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lazy-loading 'info_cache' on Instance uuid e416f888-2093-4bc2-99c8-bc5f62a4d06d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:45:17 user nova-compute[72504]: DEBUG nova.network.neutron [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Updating instance_info_cache with network_info: [{"id": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "address": "fa:16:3e:e2:6c:cd", "network": {"id": "9cf1b4e4-7f56-4588-a148-3ce6993fb7bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-133441995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c50747fa9b7f4bfaa00f791648e6bb11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d142c3-a1", "ovs_interfaceid": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:45:17 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Releasing lock "refresh_cache-e416f888-2093-4bc2-99c8-bc5f62a4d06d" {{(pid=72504) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 20:45:17 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Updated the network info_cache for instance {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 20:45:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:45:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:45:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:45:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:45:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:45:18 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:45:19 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:45:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:45:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:45:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:45:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:45:19 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:45:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:45:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 20:45:20 user nova-compute[72504]: DEBUG oslo_concurrency.processutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72504) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 20:45:20 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:45:20 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:45:20 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8812MB free_disk=25.040042877197266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:45:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:45:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:45:20 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Instance e416f888-2093-4bc2-99c8-bc5f62a4d06d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72504) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 20:45:20 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:45:20 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:45:20 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:45:20 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:45:20 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:45:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:45:23 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:45:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:45:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:45:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:45:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:45:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:45:28 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:45:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:45:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:45:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:45:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:45:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:45:33 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:45:38 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:45:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:45:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:45:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:45:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:45:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:45:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:45:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7980dedb-e720-44ac-94e3-df4cb369412f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:45:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7980dedb-e720-44ac-94e3-df4cb369412f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:45:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7980dedb-e720-44ac-94e3-df4cb369412f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:45:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7980dedb-e720-44ac-94e3-df4cb369412f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:45:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7980dedb-e720-44ac-94e3-df4cb369412f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:45:48 user nova-compute[72504]: INFO nova.compute.manager [None req-7980dedb-e720-44ac-94e3-df4cb369412f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Terminating instance
Aug 01 20:45:48 user nova-compute[72504]: DEBUG nova.compute.manager [None req-7980dedb-e720-44ac-94e3-df4cb369412f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Start destroying the instance on the hypervisor. {{(pid=72504) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 20:45:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:45:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:45:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:45:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:45:48 user nova-compute[72504]: DEBUG nova.compute.manager [req-1e157821-4b34-4dae-97b0-3c3fb7782850 req-457fccc2-3ff0-414f-b4a1-78875408aa55 service nova] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Received event network-vif-unplugged-69d142c3-a14a-47c8-9c0c-37f166ae1355 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:45:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1e157821-4b34-4dae-97b0-3c3fb7782850 req-457fccc2-3ff0-414f-b4a1-78875408aa55 service nova] Acquiring lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:45:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1e157821-4b34-4dae-97b0-3c3fb7782850 req-457fccc2-3ff0-414f-b4a1-78875408aa55 service nova] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:45:48 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-1e157821-4b34-4dae-97b0-3c3fb7782850 req-457fccc2-3ff0-414f-b4a1-78875408aa55 service nova] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:45:48 user nova-compute[72504]: DEBUG nova.compute.manager [req-1e157821-4b34-4dae-97b0-3c3fb7782850 req-457fccc2-3ff0-414f-b4a1-78875408aa55 service nova] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] No waiting events found dispatching network-vif-unplugged-69d142c3-a14a-47c8-9c0c-37f166ae1355 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:45:48 user nova-compute[72504]: DEBUG nova.compute.manager [req-1e157821-4b34-4dae-97b0-3c3fb7782850 req-457fccc2-3ff0-414f-b4a1-78875408aa55 service nova] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Received event network-vif-unplugged-69d142c3-a14a-47c8-9c0c-37f166ae1355 for instance with task_state deleting. {{(pid=72504) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 20:45:48 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:45:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:45:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:45:49 user nova-compute[72504]: INFO nova.virt.libvirt.driver [-] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Instance destroyed successfully.
Aug 01 20:45:49 user nova-compute[72504]: DEBUG nova.objects.instance [None req-7980dedb-e720-44ac-94e3-df4cb369412f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lazy-loading 'resources' on Instance uuid e416f888-2093-4bc2-99c8-bc5f62a4d06d {{(pid=72504) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 20:45:49 user nova-compute[72504]: DEBUG nova.virt.libvirt.vif [None req-7980dedb-e720-44ac-94e3-df4cb369412f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T20:38:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1143692478',display_name='tempest-SnapshotDataIntegrityTests-server-1143692478',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1143692478',id=52,image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3JWWNoHxQu8NzWqGkrQ1x/vzh0KDAoETAwBgXiU4rFa6CpcNZnixVMjA+EX5Xz2hu+VZ6Z4h14tRkPA86R6fo7snsjX9ejw9Tz3gxD+RvEnPmRI1EmpXV3zVzAhMFGkw==',key_name='tempest-keypair-588718392',keypairs=<?>,launch_index=0,launched_at=2023-08-01T20:38:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c50747fa9b7f4bfaa00f791648e6bb11',ramdisk_id='',reservation_id='r-oq3cvc6p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3f5e9e2d-95fb-46b2-b205-6c41a2b0b089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1717350197',owner_user_name='tempest-SnapshotDataIntegrityTests-1717350197-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T20:38:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf8f02d29dda43559e81ac57aea60a62',uuid=e416f888-2093-4bc2-99c8-bc5f62a4d06d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "address": "fa:16:3e:e2:6c:cd", "network": {"id": "9cf1b4e4-7f56-4588-a148-3ce6993fb7bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-133441995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c50747fa9b7f4bfaa00f791648e6bb11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d142c3-a1", "ovs_interfaceid": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 20:45:49 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-7980dedb-e720-44ac-94e3-df4cb369412f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Converting VIF {"id": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "address": "fa:16:3e:e2:6c:cd", "network": {"id": "9cf1b4e4-7f56-4588-a148-3ce6993fb7bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-133441995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c50747fa9b7f4bfaa00f791648e6bb11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69d142c3-a1", "ovs_interfaceid": "69d142c3-a14a-47c8-9c0c-37f166ae1355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 20:45:49 user nova-compute[72504]: DEBUG nova.network.os_vif_util [None req-7980dedb-e720-44ac-94e3-df4cb369412f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:6c:cd,bridge_name='br-int',has_traffic_filtering=True,id=69d142c3-a14a-47c8-9c0c-37f166ae1355,network=Network(9cf1b4e4-7f56-4588-a148-3ce6993fb7bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69d142c3-a1') {{(pid=72504) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 20:45:49 user nova-compute[72504]: DEBUG os_vif [None req-7980dedb-e720-44ac-94e3-df4cb369412f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:6c:cd,bridge_name='br-int',has_traffic_filtering=True,id=69d142c3-a14a-47c8-9c0c-37f166ae1355,network=Network(9cf1b4e4-7f56-4588-a148-3ce6993fb7bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69d142c3-a1') {{(pid=72504) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 20:45:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:45:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69d142c3-a1, bridge=br-int, if_exists=True) {{(pid=72504) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 20:45:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:45:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:45:49 user nova-compute[72504]: INFO os_vif [None req-7980dedb-e720-44ac-94e3-df4cb369412f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:6c:cd,bridge_name='br-int',has_traffic_filtering=True,id=69d142c3-a14a-47c8-9c0c-37f166ae1355,network=Network(9cf1b4e4-7f56-4588-a148-3ce6993fb7bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69d142c3-a1')
Aug 01 20:45:49 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-7980dedb-e720-44ac-94e3-df4cb369412f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Deleting instance files /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d_del
Aug 01 20:45:49 user nova-compute[72504]: INFO nova.virt.libvirt.driver [None req-7980dedb-e720-44ac-94e3-df4cb369412f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Deletion of /opt/stack/data/nova/instances/e416f888-2093-4bc2-99c8-bc5f62a4d06d_del complete
Aug 01 20:45:49 user nova-compute[72504]: INFO nova.compute.manager [None req-7980dedb-e720-44ac-94e3-df4cb369412f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 01 20:45:49 user nova-compute[72504]: DEBUG oslo.service.loopingcall [None req-7980dedb-e720-44ac-94e3-df4cb369412f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72504) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 20:45:49 user nova-compute[72504]: DEBUG nova.compute.manager [-] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Deallocating network for instance {{(pid=72504) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 20:45:49 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] deallocate_for_instance() {{(pid=72504) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 20:45:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:45:50 user nova-compute[72504]: DEBUG nova.network.neutron [-] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Updating instance_info_cache with network_info: [] {{(pid=72504) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 20:45:50 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Took 0.91 seconds to deallocate network for instance.
Aug 01 20:45:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7980dedb-e720-44ac-94e3-df4cb369412f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:45:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7980dedb-e720-44ac-94e3-df4cb369412f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:45:50 user nova-compute[72504]: DEBUG nova.compute.manager [req-3d65321e-49e4-454e-a282-2cd8eb9a4fe2 req-883341f4-a18f-45f2-9ea8-be8b69661718 service nova] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Received event network-vif-deleted-69d142c3-a14a-47c8-9c0c-37f166ae1355 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:45:50 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-7980dedb-e720-44ac-94e3-df4cb369412f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:45:50 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-7980dedb-e720-44ac-94e3-df4cb369412f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:45:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7980dedb-e720-44ac-94e3-df4cb369412f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:45:50 user nova-compute[72504]: INFO nova.scheduler.client.report [None req-7980dedb-e720-44ac-94e3-df4cb369412f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Deleted allocations for instance e416f888-2093-4bc2-99c8-bc5f62a4d06d
Aug 01 20:45:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-7980dedb-e720-44ac-94e3-df4cb369412f tempest-SnapshotDataIntegrityTests-1717350197 tempest-SnapshotDataIntegrityTests-1717350197-project-member] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.072s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:45:50 user nova-compute[72504]: DEBUG nova.compute.manager [req-ae477783-ff56-4543-8b32-99a48561f202 req-bcafb243-b3ec-4067-b411-84a092324b21 service nova] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Received event network-vif-plugged-69d142c3-a14a-47c8-9c0c-37f166ae1355 {{(pid=72504) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 20:45:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ae477783-ff56-4543-8b32-99a48561f202 req-bcafb243-b3ec-4067-b411-84a092324b21 service nova] Acquiring lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:45:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ae477783-ff56-4543-8b32-99a48561f202 req-bcafb243-b3ec-4067-b411-84a092324b21 service nova] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:45:50 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [req-ae477783-ff56-4543-8b32-99a48561f202 req-bcafb243-b3ec-4067-b411-84a092324b21 service nova] Lock "e416f888-2093-4bc2-99c8-bc5f62a4d06d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:45:50 user nova-compute[72504]: DEBUG nova.compute.manager [req-ae477783-ff56-4543-8b32-99a48561f202 req-bcafb243-b3ec-4067-b411-84a092324b21 service nova] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] No waiting events found dispatching network-vif-plugged-69d142c3-a14a-47c8-9c0c-37f166ae1355 {{(pid=72504) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 20:45:50 user nova-compute[72504]: WARNING nova.compute.manager [req-ae477783-ff56-4543-8b32-99a48561f202 req-bcafb243-b3ec-4067-b411-84a092324b21 service nova] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Received unexpected event network-vif-plugged-69d142c3-a14a-47c8-9c0c-37f166ae1355 for instance with vm_state deleted and task_state None.
Aug 01 20:45:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:45:54 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:45:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:45:59 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:46:02 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:46:02 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Cleaning up deleted instances {{(pid=72504) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 20:46:02 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] There are 0 instances to clean {{(pid=72504) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 20:46:03 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:46:04 user nova-compute[72504]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690922749.117153, e416f888-2093-4bc2-99c8-bc5f62a4d06d => Stopped> {{(pid=72504) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 20:46:04 user nova-compute[72504]: INFO nova.compute.manager [-] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] VM Stopped (Lifecycle Event)
Aug 01 20:46:04 user nova-compute[72504]: DEBUG nova.compute.manager [None req-ce93945f-838d-4897-87f6-f955fb48f0c5 None None] [instance: e416f888-2093-4bc2-99c8-bc5f62a4d06d] Checking state {{(pid=72504) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 20:46:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:46:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:46:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:46:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:46:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:46:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:46:04 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:46:06 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:46:07 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:46:07 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72504) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 20:46:08 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:46:09 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:46:13 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:46:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:46:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:46:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:46:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:46:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:46:14 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:46:16 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:46:16 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Starting heal instance info cache {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 20:46:16 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Rebuilding the list of instances to heal {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 20:46:16 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Didn't find any instances for network info cache update. {{(pid=72504) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 20:46:19 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:46:19 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:46:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:46:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:46:19 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:46:19 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Auditing locally available compute resources for user (node: user) {{(pid=72504) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 20:46:20 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:46:20 user nova-compute[72504]: WARNING nova.virt.libvirt.driver [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 20:46:20 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Hypervisor/Node resource view: name=user free_ram=8926MB free_disk=25.067108154296875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72504) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 20:46:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 20:46:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 20:46:20 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 20:46:20 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72504) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 20:46:20 user nova-compute[72504]: DEBUG nova.compute.provider_tree [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed in ProviderTree for provider: b951a798-e88c-472c-8347-2c5f6a05d47c {{(pid=72504) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 20:46:20 user nova-compute[72504]: DEBUG nova.scheduler.client.report [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Inventory has not changed for provider b951a798-e88c-472c-8347-2c5f6a05d47c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72504) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 20:46:20 user nova-compute[72504]: DEBUG nova.compute.resource_tracker [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Compute_service record updated for user:user {{(pid=72504) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 20:46:20 user nova-compute[72504]: DEBUG oslo_concurrency.lockutils [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=72504) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 20:46:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:46:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:46:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:46:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:46:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:46:24 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:46:24 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:46:24 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:46:29 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:46:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:46:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:46:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:46:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:46:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:46:34 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:46:39 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:46:40 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:46:43 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:46:44 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:46:46 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:46:49 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 20:46:53 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:46:54 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:46:58 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:46:58 user nova-compute[72504]: DEBUG nova.compute.manager [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72504) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 20:46:59 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:47:00 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:47:01 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:47:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:47:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:47:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72504) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 20:47:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:47:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72504) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 20:47:04 user nova-compute[72504]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72504) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 20:47:05 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:47:06 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 20:47:06 user nova-compute[72504]: DEBUG oslo_service.periodic_task [None req-e213561a-62f2-4c96-b83e-6f15a0291c89 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72504) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}